I feel that the death is not really ChatGPT's fault, this was a drug addict putting a lot of effort into pushing past guardrails and safety blocks to get the answer he wanted.
If you prompt an LLM long enough you can get it to say whatever you want, and that's what happened here.
I think they already have a usage disclaimer on the use of ChatGPT. Correct me if I'm wrong, but isn't it already stated one cannot use their services for:
"provision of tailored advice that requires a license, such as legal or medical advice, without appropriate involvement by a licensed professional." — How else could this be interpreted/twisted in court?
https://openai.com/policies/usage-policies/
I feel that the death is not really ChatGPT's fault, this was a drug addict putting a lot of effort into pushing past guardrails and safety blocks to get the answer he wanted.
If you prompt an LLM long enough you can get it to say whatever you want, and that's what happened here.
I think they already have a usage disclaimer on the use of ChatGPT. Correct me if I'm wrong, but isn't it already stated one cannot use their services for: "provision of tailored advice that requires a license, such as legal or medical advice, without appropriate involvement by a licensed professional." — How else could this be interpreted/twisted in court? https://openai.com/policies/usage-policies/