The parents of a teen who died by suicide after ChatGPT coached him on methods of self harm sued OpenAI and CEO Sam Altman on Tuesday, saying the company knowingly put profit above safety when it launched the GPT-4o version of its artificial intelligence chatbot last year.
Adam Raine, 16, died on April 11 after discussing suicide with ChatGPT for months, according to the lawsuit that Raine’s parents filed in San Francisco state court.
The chatbot validated Raine’s suicidal thoughts, gave detailed information on lethal methods of self-harm, and instructed him on how to hide actions from his parents and hide evidence of a failed suicide attempt, they allege. ChatGPT even offered to draft a suicide note, the parents, Matthew and Maria Raine, said in the lawsuit.
The lawsuit seeks to hold OpenAI liable for wrongful death and violations of product safety laws, and seeks unspecified monetary damages.
An OpenAI spokesperson said the company is saddened by Raine’s passing and that ChatGPT includes safeguards such as directing people to crisis helplines.
“While these safeguards work best in common, short exchanges, we’ve learned over time that they can sometimes become less reliable in long interactions where parts of the model’s safety training may degrade,” the spokesperson said, adding that OpenAI will continually improve on its safeguards.
The CurrentWhat is AGI, and will it harm humanity?
Artificial general intelligence, or AGI, refers to computers that possess consciousness, much like humans. Some tech experts argue that this is a massive step beyond A.I., but we’re not that far from achieving it, while others contend that it’s a fictional concept that we’re nowhere near. Guest host Piya Chattopadhyay talks to two experts about what AGI entails, and what risks having computers more intelligent than humans bring.
Company didn’t directly address allegations
OpenAI did not specifically address the lawsuit’s allegations. As AI chatbots become more lifelike, companies have touted their ability to serve as confidants and users have begun to rely on them for emotional support.
But experts warn that relying on automation for mental health advice carries dangers, and families whose loved ones died after chatbot interactions have criticized a lack of safeguards.
OpenAI said in a blog post that it is planning to add parental controls and exploring ways to connect users in crisis with real-world resources, including by potentially building a network of licensed professionals who can respond through ChatGPT itself.
OpenAI launched GPT-4o in May 2024 in a bid to stay ahead in the AI race. The company knew that features that remembered past interactions, mimicked human empathy and displayed a sycophantic level of validation would endanger vulnerable users without safeguards but launched anyway, the Raines said in their lawsuit.
“This decision had two results: OpenAI’s valuation catapulted from $86 billion to $300 billion, and Adam Raine died by suicide,” they said. The Raines’ lawsuit also seeks an order requiring OpenAI to verify the ages of ChatGPT users, refuse inquiries for self-harm methods, and warn users about the risk of psychological dependency.
If you or someone you know is struggling, here’s where to look for help: