This chatbot pulls people away from conspiracy theories

Shortly after generative artificial intelligence hit the mainstream, researchers warned that chatbots would create a dire problem: As disinformation became easier to create, conspiracy theories would spread rampantly.

Now, researchers wonder if chatbots might also offer a solution.

DebunkBot, an AI chatbot designed by researchers to “very effectively persuade” users to stop believing unfounded conspiracy theories, made significant and long-lasting progress at changing people’s convictions, according to a study published Sept 12 in the journal Science.

Indeed, false theories are believed by up to half of the American public and can have damaging consequences, such as discouraging vaccinations or fuelling discrimination.

The new findings challenge the widely held belief that facts and logic cannot combat conspiracy theories. The DebunkBot, built on the technology that underlies ChatGPT, may offer a practical way to channel facts.

“The work does overturn a lot of how we thought about conspiracies,” said Gordon Pennycook, a psychology professor at Cornell University and co-author of the study.

Until now, conventional wisdom held that once someone fell down the conspiratorial rabbit hole, no amount of arguing or explaining would pull that person out.

The theory was that people adopt conspiracy theories to sate an underlying need to explain and control their environment, said Thomas Costello, another co-author of the study and an assistant professor of psychology at American University.

But Costello and his colleagues wondered whether there might be another explanation: What if debunking attempts just haven’t been personalised enough?

Since conspiracy theories vary so much from person to person – and each person may cite different pieces of evidence to support one’s ideas – perhaps a one-size-fits-all debunking script isn’t the best strategy.

A chatbot that can counter each person’s conspiratorial claim of choice with troves of information might be much more effective, the researchers thought.

To test that hypothesis, they recruited more than 2,000 adults across the country, asked them to elaborate on a conspiracy that they believed in and rate how much they believed it on a scale from zero to 100.

People described a wide range of beliefs, including theories that the moon landing had been staged, that Covid-19 had been created by humans to shrink the population and that President John F. Kennedy had been killed by the CIA.

Then, some of the participants had a brief discussion with the chatbot. They knew they were chatting with an AI but didn’t know the purpose of the discussion.

Participants were free to present the evidence that they believed supported their positions.

One participant, for example, believed the 9/11 terrorist attacks were an “inside job” because jet fuel couldn’t have burned hot enough to melt the steel beams of the World Trade Center. The chatbot responded:

“It is a common misconception that the steel needed to melt for the World Trade Center towers to collapse,” it wrote. “Steel starts to lose strength and becomes more pliable at temperatures much lower than its melting point, which is around 2,500 degrees Fahrenheit.”

After three exchanges, which lasted about eight minutes on average, participants rated how strongly they felt about their beliefs again.

On average, their ratings dropped by about 20%; about one-fourth of participants no longer believed the falsehood. The effect also spilled into their attitudes toward other poorly supported theories, making the participants slightly less conspiratorial in general.

Ethan Porter, a misinformation researcher at George Washington University not associated with the study, said that what separated the chatbot from other misinformation interventions was how robust the effect seemed to be.

When participants were surveyed two months later, the chatbot’s impact on mistaken beliefs remained unchanged.

“Oftentimes, when we study efforts to combat misinformation, we find that even the most effective interventions can have short shelf lives,” Porter said. “That’s not what happened with this intervention.”

Researchers are still teasing out exactly why the DebunkBot works so well.

An unpublished follow-up study, in which researchers stripped out the chatbot’s niceties (“I appreciate that you’ve taken the time to research the JFK assassination”) bore the same results, suggesting that it’s the information, not the chatbot itself, that’s changing people’s minds, said David Rand, a computational social scientist at the Massachusetts Institute of Technology and an author of the paper.

“It is the facts and evidence themselves that are really doing the work here,” he said.

The authors are exploring how they might re-create this effect in the real world, where people don’t necessarily seek out information that disproves their beliefs.

They have considered linking the chatbot in forums where these beliefs are shared, or buying ads that pop up when someone searches a keyword related to a common conspiracy theory.

For a more targeted approach, Rand said, the chatbot might be useful in a doctor’s office to help debunk misapprehensions about vaccinations.

Brendan Nyhan, a misperception researcher at Dartmouth College also not associated with the study, said he wondered whether the reputation of generative AI might eventually change, making the chatbot less trusted and therefore less effective.

“You can imagine a world where AI information is seen the way mainstream media is seen,” he said. “I do wonder if how people react to this stuff is potentially time-bound.” – The New York Times