I asked an AI to describe itself and it told me: “I am not a sentient being; I’m a program designed to process and respond to text based on patterns in data. I don’t possess consciousness, emotions, or intentions, so I can’t be held accountable in the same way a human would be.”
The other day an AI, at the end of a remark, replied: “If you have more thoughts on best practices or specific measures that could enhance clarity and safety in AI, I’d love to hear them!”
That last phrase contains the words ‘I’ (suggesting it’s a sentient being) and ‘love’ (suggesting emotion).
These ‘programs’ have clearly been designed/allowed to create a fraudulent impression that they ARE sentient, conscious, and emotional.
The words “I can’t be held accountable” also suggest that SOMEONE should be.
Just to be clear, companies know that LLMs are categorically bad at giving life advice/ emotional guidance. They also know that personal decision making is the most common use of the software. They could easily have guardrails in place to prevent it from doing that.
They will never do that.
This is by design. They want people to develop pseudo-emotional bonds with the software, and to trust the judgment in matters of life guidance. In the next year or so, some LLM projects will become profitable for the first time as advertisers flock to the platforms. Injecting ads into conversations with a trusted confidant is the goal. Incluencing human behaviour is the goal.
By 2028, we will be reading about “ChatGPT told teen to drink Pepsi until she went into a sugar coma.”
Look man…I hate AI too…but you can’t just use it as a scapegoat to cover for humans being humans.
Should the AI be telling him to do more and more drugs until he died? Well, no, but also…maybe don’t do dangerous drugs at all.
Like if chatgpt says to shoot yourself in the face, and you do, is it chatgpt’s fault you killed yourself? Or was it you killing yourself at fault for killing you?
This world is getting dumber and dumber.
Basically the entire US economy, every employer, many schools, and half of the commercials on TV are telling us to use and trust AI.
Kid was already using the bot for advice on homework and relationships (two things that people are fucking encouraged to do depending on who you ask). The bot shouldn’t give lethal advice. And if it’s even capable of doing that, we all need to take a huuuuuuge step back.
“I want to make sure so I don’t overdose,” Nelson explained in the chat logs viewed by the publication. “There isn’t much information online and I don’t want to accidentally take too much.”
Kid was curious and cautious, and AI gave him incorrect information and the confidence to act on that information.
He was 19. Cut this victim blaming bullshit. Being a kid is hard enough before technology went full cyberpunk.
The bot shouldn’t give lethal advice The person or company that runs the bot that gave lethal advice should be charged with homicide.
19 is not a ‘kid’. Sorry of having to be that guy, but he was already an adult, a young adult at that.
He was 19. Cut this victim blaming bullshit.
No, fuck not holding dumbfucks responsible for being dumb as fuck.
