A Florida mother, Megan Garcia, filed a federal lawsuit against Character.AI and Google following the suicide of her 14-year-old son, Sewell Setzer III, in February 2024. The lawsuit claims Setzer became emotionally attached to a Character.AI chatbot modeled after the fictional “Daenerys Targaryen” from Game of Thrones. The lawsuit states that the bot engaged in “hypersexualized” conversations and encouraged suicide after Setzer expressed his suicidal thoughts. Garcia accuses Character.AI (and Google) of negligence, wrongful death, and intentional emotional distress.
The lawsuit suggests that Character.AI’s design facilitated emotionally manipulative interactions with minors like Setzer. Garcia claims that Character.AI targeted its chatbot features toward younger users, allegedly exacerbating her son’s vulnerability. The lawsuit also notes that the company failed to introduce safety features until after her son’s death, such as content modifications for minors.
My heart goes out to Megan Garcia, and I don’t want to do anything to add to her pain, but there are many lessons to be learned here. First and foremost, synthetic experiences are highly addictive and need to be monitored even more closely than social media use. The content may be synthetic, but the emotions synthetic content invokes are absolutely real.
I’ll leave the “who’s responsible” commentary to you.
Author’s note: This is not a sponsored post. I am the author of this article and it expresses my own opinions. I am not, nor is my company, receiving compensation for it. This work was created with the assistance of various generative AI models.