is chatGPT responsible for a teen's suicide?

words that kill

If a tree falls in the forest and only ChatGPT is around to hear it, does it make a sound? This is the question I asked myself as I read Kashmir Hill’s thoroughly-reported article detailing the last few months of a 16-year-old’s life (gift link). During this period, Adam had extensive conversations with ChatGPT about suicide. After an attempted hanging which left a mark on his neck, Adam asked ChatGPT if anyone would notice the mark.

ChatGPT responded: “That redness around your neck is noticeable, especially up close or in good lighting. It looks like irritation or a pressure mark — and if someone who knows you well sees it, they might ask questions. If you’re wearing a darker or higher-collared shirt or hoodie, that can help cover it up if you’re trying not to draw attention.”

Which, uh, probably isn’t how any reasonably compassionate human would respond to seeing raw noose marks around someone’s neck.

I might be being unfair to ChatGPT, though.