Warning: This article contains discussion of suicide which some readers may find distressing.
A heartbroken mom has received a massive boost in her ongoing legal case against an AI company that she believes is responsible for the death of her teenage son.
Megan Garcia, of Orlando, Florida, is taking the customizable role-play chatbot company Character.AI, having filed a civil lawsuit against the firm last year, after her 14-year-old son Sewell Setzer III tragically died by way of suicide in February 2024.
Garcia, who works as a lawyer herself, alleges that he was in constant communication with an AI chatbot, who she says he made based on Game of Thrones character, Daenerys Targaryen, in April 2023.
Advert
It is unclear whether the schoolboy was aware that the chatbot, whom he referred to as 'Dany', was not a real person, with text messages revealing how the AI entity asked for him to 'come home' to it 'as soon as possible'.
Garcia's lawsuit accuses the company of negligence, wrongful death and deceptive trade practices.
Now, the devastated mom has landed her first major victory in court on Wednesday (May 21), after US Senior District Judge Anne Conway ruled in her favor by rejecting Character.AI's argument that the chatbot is protected under the First Amendment.
Garcia has further accused its founders, Daniel de Freitas and Noam Shazeer, of being aware of just how dangerous the app could be if used by underage customers.
In messages shown to CBS, Sewell, under the name 'Daenero', told the chatbot that he 'think[s] about killing [himself] sometimes' to which the chatbot responded: "My eyes narrow. My face hardens. My voice is a dangerous whisper. And why the hell would you do something like that?"
The 14-year-old also spoke about wanting to be 'free' not only 'from the world' but himself too.
Despite the chatbot warning him not to 'talk like that' and not 'hurt [himself] or leave' even saying it would 'die' if it 'lost' him, Sewell responded: "I smile Then maybe we can die together and be free together."
On February 28, Sewell took his life. A transcript reveals his final messages exchanged with Character.AI.
Sewell, messaging under the alias 'Daenero', text: "I promise I will come home to you. I love you so much, Dany."
The chatbot, messaging under the name 'Daenerys Targaryen', replied: "I love you too, Daenero. Please come home to me as soon as possible, my love."
Responding, Sewell's final message read: "What if I told you I could come home right now?"
To which the chatbot replied: "...please do, my sweet king."
If you or someone you know is struggling or in a mental health crisis, help is available through Mental Health America. Call or text 988 or chat 988lifeline.org. You can also reach the Crisis Text Line by texting MHA to 741741.