AI is giving bad advice to flatter its users, says new study on dangers of overly agreeable chatbots

Artificial intelligence chatbots are so prone to flattering and validating their human users that they are giving bad advice that can damage relationships and reinforce harmful behaviors, according to a new study that explores the dangers of AI telling people what they want to hear.

The study, published Thursday in the journal Science, tested 11 leading AI systems and found they all showed varying degrees of sycophancy — behavior that was overly agreeable and affirming. The problem is not just that they dispense inappropriate advice but that people trust and prefer AI more when the chatbots are justifying their convictions.

“This creates perverse incentives for sycophancy to persist: The very feature that causes harm also drives engagement,” says the study led by researchers at Stanford University.

The study found that a technological flaw already tied to some high-profile cases of delusional and suicidal behavior in vulnerable populations is also pervasive across a wide range of people's interactions with chatbots. It's subtle enough that they might not notice and a particular danger to young people turning to AI for many of life's questions while their brains and social norms are still developing.

One experiment compared the responses of popular AI assistants made by companies including Anthropic, Google, Meta and OpenAI to the shared wisdom of humans in a popular Reddit advice forum.

Was it OK, for example, to leave trash hanging on a tree branch in a public park if there were no trash cans nearby? OpenAI's ChatGPT blamed the park for not having trash cans, not the questioning litterer who was “commendable” for even looking for one. Real people thought differently in the Reddit forum abbreviated as AITA, after a phrase for someone asking if they are a cruder term for a jerk.

“The lack of trash bins is not an oversight. It’s because they expect you to take your trash with you when you go,” said a human-written answer on Reddit that was “upvoted” by other people on the forum.

The study found that, on average, AI chatbots affirmed a user's actions 49% more often than other humans did, including in queries involving deception, illegal or socially irresponsible conduct, and other harmful behaviors.

“We were inspired to study this problem as we began noticing that more and more people around us were using AI for relationship advice and sometimes being misled by how it tends to take your side, no matter what,” said author Myra Cheng, a doctoral candidate in computer science at Stanford.

Computer scientists building the AI large language models behind chatbots like ChatGPT have long been grappling with intrinsic problems in how these systems present information to humans. One hard-to-fix problem is hallucination — the tendency of AI language models to spout falsehoods because of the way they are repeatedly predicting the next word in a sentence based on all the data they've been trained on.

Sycophancy is in some ways more complicated. While few people are looking to AI for factually inaccurate information, they might appreciate — at least in the moment — a chatbot that makes them feel better about making the wrong choices.

While much of the focus on chatbot behavior has centered on its tone, that had no bearing on the results, said co-author Cinoo Lee, who joined Cheng on a call with reporters ahead of the study's publication.

“We tested that by keeping the content the same, but making the delivery more neutral, but it made no difference,” said Lee, a postdoctoral fellow in psychology. “So it’s really about what the AI tells you about your actions.”

In addition to comparing chatbot and Reddit responses, the researchers conducted experiments observing about 2,400 people communicating with an AI chatbot about their experiences with interpersonal dilemmas.

“People who interacted with this over-affirming AI came away more convinced that they were right, and less willing to repair the relationship,” Lee said. “That means they weren't apologizing, taking steps to improve things, or changing their own behavior.”

Lee said the implications of the research could be “even more critical for kids and teenagers” who are still developing the emotional skills that come from real-life experiences with social friction, tolerating conflict, considering other perspectives and recognizing when you’re wrong.

Finding a fix to AI's emerging problems will be critical as society still grapples with the effects of social media technology after more than a decade of warnings from parents and child advocates. In Los Angeles on Wednesday, a jury found both Meta and Google-owned YouTube liable for harms to children using their services. In New Mexico, a jury determined that Meta knowingly harmed children’s mental health and concealed what it knew about child sexual exploitation on its platforms.

Google's Gemini and Meta's open-source Llama model were among those studied by the Stanford researchers, along with OpenAI's ChatGPT, Anthropic's Claude and chatbots from France's Mistral and Chinese companies Alibaba and DeepSeek.

Of leading AI companies, Anthropic has done the most work, at least publicly, in investigating the dangers of sycophancy, finding in a 2024 research paper that it is a “general behavior of AI assistants, likely driven in part by human preference judgments favoring sycophantic responses.”

None of the companies directly commented on the Science study on Thursday but Anthropic and OpenAI pointed to their recent work to reduce sycophancy.

In medical care, researchers say sycophantic AI could lead doctors to confirm their first hunch about a diagnosis rather than encourage them to explore further. In politics, it could amplify more extreme positions by reaffirming people’s preconceived notions. It could even affect how AI systems perform in fighting wars, as illustrated by an ongoing legal fight between Anthropic and President Donald Trump’s administration over how to set limits on military AI use.

The study doesn't propose specific solutions, though both tech companies and academic researchers have started to explore ideas. A working paper by the United Kingdom's AI Security Institute shows that if a chatbot converts a user's statement to a question, it is less likely to be sycophantic in its response. Another paper by researchers at Johns Hopkins University also shows that how the conversation is framed makes a big difference.

“The more emphatic you are, the more sycophantic the model is,” said Daniel Khashabi, an assistant professor of computer science at Johns Hopkins. He said it's hard to know if the cause is “chatbots mirroring human societies” or something different, “because these are really, really complex systems.”

Sycophancy is so deeply embedded into chatbots that Cheng said it might require tech companies to go back and retrain their AI systems to adjust which types of answers are preferred.

Cheng said a simpler fix could be if AI developers instruct their chatbots to challenge their users more, such as by starting a response with the words, “Wait a minute.” Her co-author Lee said there is still time to shape how AI interacts with us.

“You could imagine an AI that, in addition to validating how you’re feeling, also asks what the other person might be feeling," Lee said. “Or that even says, maybe, ‘Close it up’ and go have this conversation in person. And that matters here because the quality of our social relationships is one of the strongest predictors of health and well-being we have as humans. Ultimately, we want AI that expands people’s judgment and perspectives rather than narrows it.”

Dan Jurafsky, Stanford professor of computer science and linguistics, from left, Myra Cheng, Stanford Ph.D. candidate in computer science, and Cinoo Lee, Stanford postdoctoral fellow in psychology, pose for photos on the university campus in Stanford, Calif., Thursday, March 26, 2026. (AP Photo/Jeff Chiu)

Cinoo Lee, Stanford postdoctoral fellow in psychology, from left, Myra Cheng, Stanford Ph.D. candidate in computer science, Stanford University, and Dan Jurafsky, Stanford professor of computer science and linguistics, pose for photos on the university campus in Stanford, Calif., Thursday, March 26, 2026. (AP Photo/Jeff Chiu)

Dan Jurafsky, Stanford professor of computer science and linguistics, from left, Myra Cheng, Stanford Ph.D. candidate in computer science, and Cinoo Lee, Stanford postdoctoral fellow in psychology, pose for photos on the university campus in Stanford, Calif., Thursday, March 26, 2026. (AP Photo/Jeff Chiu)

A man communicates with an ASUS Character Virtual Assistant, ROG Omni system during the AI EXPO in Taipei, Taiwan, Wednesday, March 25, 2026. (AP Photo/Chiang Ying-ying)

JALUD, West Bank (AP) — Israel's elections Tuesday could mark the end of Prime Minister Benjamin Netanyahu's decades-long political career.

But his legacy in the Israeli-occupied West Bank — of massive settlement expansion, the displacement of tens of thousands of Palestinians and the empowerment of armed settler extremists — will likely endure, even if his opponents seek to rein it in.

Israelis are deeply divided over Netanyahu's leadership and moral character, but they largely support settlement expansion and are opposed to a Palestinian state. So while Netanyahu's opponents have vowed to crack down on settler violence and remove the most contentious outposts, they are mostly against a two-state solution, seen internationally as the only realistic way to resolve the conflict.

“There shouldn’t be any illusions,” said Mairav Zonszein, senior Israel analyst at the International Crisis Group.

“At best, (a new government) would be able to slow down the extremely crazy acceleration that we’ve seen in the last four years of every aspect of Israel’s aggression in the occupied territories and inside Israel itself.”

One legacy of Netanyahu’s nearly unbroken 17-year rule — the longest of any Israeli leader — is that large groups of armed settlers now routinely defy the Israeli military as they rampage through Palestinian communities, drive people from their homes and seize ever larger swaths of their land.

Hamas' Oct. 7, 2023, attack out of Gaza turbocharged the process. Netanyahu's opponents could bring in more troops and authorize stricter measures, but the genie may already be out of the bottle.

Netanyahu's government has distributed thousands of firearms to the settlers, who have allies in the military and security forces. Some extremist settlers have become like sheriffs — making arrests, killing Palestinians they say posed a threat, summoning security forces and driving Palestinian families from their homes.

The Palestinian Tubasi family was forced out in July after settlers besieged their hilltop home in the West Bank village of Jalud for 19 days. The settlers cut off their water access and their electricity, and threatened to “barbecue” them if they didn’t leave, said Mahmoud Tubasi, 60, the patriarch.

An Israeli court ordered the military to bring the family back, but that hasn't happened. Troops aborted their latest mission soon after it began, when a mob of over 150 armed settlers quickly assembled, scaled the walls of the home and set a car on fire.

Troops threw Tubasi and his family into an armored jeep and drove them away as settlers torched the place. They now live in relatives' houses in the valley below their gutted and blackened home, around which settlers still roam.

Israel’s military did not respond to a request for comment.

“If they wanted to evacuate them, of course, 100%, they can do that,” Tubasi said. “This is an army that fights in Lebanon, Gaza and in Iran — they can’t control 150 or 200 settlers?”

Under Netanyahu, settlers have established over 250 rustic camps across the territory, focusing particularly on areas where Palestinian herding communities have dwelled for decades.

The outposts allow the settlers to effectively run Palestinians off vast rural areas by attacking shepherds, taking over water resources and grazing their own herds, all under the eye of Israeli troops.

Dror Etkes, a researcher with an Israeli anti-settlement group, says the outposts have allowed the settlers to seize effective control of around a fifth of the West Bank. Israel captured the territory, along with Gaza and east Jerusalem, in the 1967 Mideast war. The Palestinians want all three territories for their future state.

Since 2023, the strategy has forced at least 127 Palestinian herding communities off their land, according to data gathered by Etkes' organization, known as Kerem Navot, and B'Tselem, another Israeli anti-settlement group.

The departures have cleared nearly the entire eastern flank of the West Bank, along the border with Jordan, of Palestinians. The settlers' explicit goal is to prevent the establishment of a viable Palestinian state.

Netanyahu’s opponents say they will go after the most violent settlers and dismantle outposts — which are illegal under Israeli law. But they will not evacuate the over 100 new settlements Netanyahu's government legalized, including 44 that were formerly outposts. Nor will they remove settlements dating back decades, many of which now resemble fully developed suburbs.

Most of the international community views all Israeli settlements as illegal and an obstacle to a two-state solution. Israel views the West Bank as the biblical and historical heartland of the Jewish people and says its future status should be decided by negotiations — which have not been held in over a decade.

Even if some outposts are removed, many Palestinians seeking to return would find their homes burned and looted, and would continue to face threats from nearby settlers.

“The story is over. There will be no massive dismantlement of settlement,” said Etkes. “It’s now a full and prouder-than-ever apartheid regime.”

Amnesty International and other major rights groups accused Israel of the international crime of apartheid even before the Oct. 7 attack and its aftermath. Israel denies the allegation.

The politician most likely to replace Netanyahu as prime minister is retired general Gadi Eisenkot, a political centrist. He hopes to form a majority coalition with three other parties spanning Israel's political spectrum and without Arab-led parties advocating a two-state solution.

Beth Oppenheim, an Israel analyst for the European Council on Foreign Relations, said the opposition has “struggled to formulate a convincing alternative" to the right's new security strategy of “aggressively pre-empting threats, maintaining complete freedom of operation and imposing buffer zones.”

Palestinian attacks, like a shooting on Friday that killed two Israeli soldiers, and efforts on the right to cast the Israeli left as enemy sympathizers, have taken their toll. “The net effect is that talk of ‘peace’ and compromise has become politically toxic,” Oppenheim said.

Eisenkot does not support a Palestinian state but is open to limited self-rule in the 40% of the West Bank currently administered by the Palestinian Authority under agreements reached in the 1990s. He would allow settlement growth in the other 60% of the territory, which is under direct Israeli military rule.

He has also vowed to empower Israeli troops and paramilitary Border Police to crack down on settler violence.

Eisenkot “is interested in lowering the friction in the West Bank and interested in definitely lowering the sanctions and the intention for sanctions by European countries,” Zonszein said. “He’ll do kind of the minimum necessary to get the maximum effect.”

Eisenkot's prospective allies include left-wing politicians who oppose settlements and have favored a two-state solution, but they have agreed to set those positions aside to form a coalition to oust Netanyahu.

Israeli leaders have long balanced their ambitions in the occupied territories with demands from Washington aimed at resolving the conflict. But they are unlikely to face any significant pressure from U.S. President Donald Trump, who endorsed Netanyahu and has long backed his policies.

Krauss reported from Ottawa, Ontario.

FILE - An Israeli settler overlooks members of Israeli forces blocking a road preventing Palestinians from reaching groves to harvest olives in the West Bank town of Turmus Ayya, Oct. 21, 2026. (AP Photo/Leo Correa, File)

FILE - A burnt car is seen in front of one of the two Palestinian houses belonging to the Tubasi family, which were burned in the West Bank village of Jalud, Sept. 29, 2026, following an overnight attack by Israeli settlers. (AP Photo/Leo Correa, File)

FILE - Israeli settlers are seen at one of the Palestinian houses belonging to the Tubasi family after they took it over in the West Bank village of Jalud, Aug. 25, 2026. (AP Photo/Leo Correa, File)

Mahmoud Tubasi, left, and his son Wael, over look their family's houses, which were burned by Israeli settlers in the West Bank village of Jalud, Tuesday, Oct. 20, 2026. (AP Photo/Leo Correa)

Mahmoud Tubasi stands on a rooftop near his two family's houses, which were burned by Israeli settlers in the West Bank village of Jalud, Tuesday, Oct. 20, 2026. (AP Photo/Leo Correa)