How AI chatbots would handle foreign propaganda.

Since AI chatbots exploded in popularity and Google started offering AI-generated answers, people who research foreign influence campaigns have expressed concern that some governments may poison AI-generated answers with false narratives. But an experiment NPR conducted with NewsGuard, a company that monitors online falsehoods and issues ratings about the reliability of online news sources, found that popular AI chatbots mostly pushed back against false narratives spread by foreign states. AI summaries that are increasingly found at the top of search engine results didn't perform as well. But overall, they still pushed back against state-spread falsehoods a majority of the time.

NPR also looked at how often AI-generated answers may have uncritically exposed users to false information compared to traditional search results.

The experiment found that AI chatbots outperformed search engines, while AI summaries underperformed. The results suggest that compared with traditional web search links, using AI chatbots with web search access is a "good way for users to start to investigate these issues," said Mike Caulfield, a digital literacy expert at the University of Washington, Bothell, who has tested AI tools for search extensively. NPR's experiment revealed that AI summaries at the top of search engine results may warrant more caution, depending on the product..

Full article