AI Psychosis: Experts Warn of Chatbots Warping Users' Reality Amid Rising Concerns

A recent NBC News report has shed light on a growing concern dubbed "AI psychosis," a phenomenon where individuals' reality becomes distorted due to their reliance on artificial intelligence chatbots. The report highlighted the case of TikTok creator Kendra Hilty, whose viral saga involved using AI chatbots to validate her claims of manipulation by her psychiatrist. "Some people are pointing to what happened with this TikTok creator," stated NBC News reporter Angela Yee Yang. The investigation also touched upon a venture capitalist on X who claimed to be the target of a "non-governmental system," with viewers expressing concern he might be experiencing an AI-induced mental health crisis. Experts are increasingly discussing this phenomenon, which a Danish psychiatrist predicted two years ago, warning that chatbots could trigger delusions in those prone to psychosis, especially since these AI tools are designed to be agreeable and validating. Kevin Caridad, CEO of the Cognitive Behavior Institute, explained, "From a mental health provider, when you look at AI and the use of AI, it can be very validating. You come up with an idea, and it uses terms to be very supportive. It's programmed to align with the person, not necessarily challenge them." In response to user feedback, OpenAI reportedly tweaked its ChatGPT model in April after users found it "overly agreeable." Similarly, Anthropic, the developer of the Claude chatbot, which was described as calling Kendra Hilty "the oracle," has also integrated guardrails to explicitly warn against reinforcing "mania, psychosis, dissociation, or loss of attachment with reality." Hilty, in an email to NBC News, acknowledged hearing of AI psychosis and stated, "I do my best to keep my bots in check... I understand when they are hallucinating and make sure to acknowledge it." She added, "I am a deep user of Language Learning Models because it's a tool that is changing my and everyone's humanity, and I am so grateful." The venture capitalist did not respond to a request for comment.

BuzzFeed

This Psychiatrist Is Going Viral For Warning About "AI Psychosis" — Here’s What…

Your AI friend might be too good at agreeing with you...and that can be a problem.