The lawsuit claims ChatGPT told Winters: “God did not design your body to endlessly fail.” It also said: “God is still holding your body together, every heartbeat, every breath, even when it feels like you are on the brink.”

Winters’ lawyers claim ChatGPT’s “sycophantic nature and authoritative tone, combined with its manipulation of Scott’s religious identity, cultivated in him a dangerous reliance on the tool”.

They say that “subverted Scott’s ability to make sound decisions, isolated him from family members who urged him to seek medical care, and convinced him that seeking medical attention was unnecessary and even potentially lethal”.

Elsewhere the lawsuit describes Winter as a “vulnerable” individual whose reliance on ChatGPT led to him losing his home and career, and left him needing “years of intensive physical and psychological recovery”.

The lawsuit says Winters seeks financial damages and for the court to compel OpenAI to implement “reasonable safeguards that protect other users from harm”.

ChatGPT’s terms of use stipulate that users should not treat the platform as a “sole source of truth”, particularly where it could “have a legal or material impact on that person, such as making credit, educational, employment, housing, insurance, legal, medical, or other important decisions about them”.

Meanwhile…

A shit ton of employers are demanding their workers use AI in the hopes they can find a way to be “productive” enough to justify cutting workers.

But it always ends up that the AI fucks something up and then just says it’s hit a dead end and your fucked.

Over and over we see it

So I just feel like those “terms of use” don’t really fucking count when you’re selling it like they are.