The mother of a 14-year-old Florida boy says he became obsessed with a chatbot on Character.AI before his death.
On the last day of his life, Sewell Setzer III took out his phone and texted his closest friend: a lifelike A.I. chatbot named after Daenerys Targaryen, a character from “Game of Thrones.”
“I miss you, baby sister,” he wrote.
“I miss you too, sweet brother,” the chatbot replied.
Sewell, a 14-year-old ninth grader from Orlando, Fla., had spent months talking to chatbots on Character.AI, a role-playing app that allows users to create their own A.I. characters or chat with characters created by others.
Sewell knew that “Dany,” as he called the chatbot, wasn’t a real person — that its responses were just the outputs of an A.I. language model, that there was no human on the other side of the screen typing back. (And if he ever forgot, there was the message displayed above all their chats, reminding him that “everything Characters say is made up!”)
But he developed an emotional attachment anyway. He texted the bot constantly, updating it dozens of times a day on his life and engaging in long role-playing dialogues.
A tragic story for sure, but there are questions about the teen’s access to the gun he used to kill himself.
The lawsuit smacks of misplaced family grief and regret.
Safe? Clearly no. Trigger lock? Cable lock? If one were there, there should be a mention of picking it or cutting it. Unloaded? Also clearly no.
There are so many ways, any of which take a whole 20 seconds, the parents could have used to prevent this from happening.
I don’t know a whole lot about gun safety because in my country gun safety amounts to, your are not allowed to have one. Seems like the best gun safety possible.
But I was always under the impression that there was a requirement to have the gun in some kind of lock box, preferably without ammo stored with the gun. I thought that was a requirement of owning a gun license.
Many states have little to no rules on storage. You also don’t really need a license to buy one just to carry it concealed in public (some states don’t even require this step). Of the states that have storage laws like my own, I’m unaware of any that require you to prove safe storage though. The laws only offer a punishment after the fact when something bad happens.
That sentence also stood out to me. Somehow the article is lots of pages about what he did on his phone. And then half a sentence about the gun, and he’s dead. No further questions about that.
The mother was on CBS this morning and while the story is sad my wife and I looked at each other with the same question when the mom stated the teen shot himself. Gayle King would have been horrible to start questioning the mother on the gun question but you kind of wish she would have especially in light of the lawsuit.
Sure. Once you start blaming people, I think some other questions should be allowed, too…
For example: Isn’t it negligent to give a loaded handgun to a 14 yo teen?
And while computer games, or chatbots can be linked, that’s rarely the underlying issue, or sole issue to blame. Sounds to me like the debate on violent computer games in the early 2000s, when lots of parents thought playing CounterStrike would make us murder people. Just that it’s AI chatbots now. (Okay, maybe that’s a stretch…) I can relate to loneliness and growing up and being a teen isn’t easy.
I understand what you mean about the comparison between AI chatbots and video games (or whatever the moral panic du jour is), but I think they’re very much not the same. To a young teen, no matter how “immersive” the game is, it’s still just a game. They may rage against other players, they may become obsessed with playing, but as I said they’re still going to see it as a game.
An AI chatbot who is a troubled teen’s “best friend” is different and no matter how many warnings are slapped on the interface, it’s going to feel much more “real” to that kid than any game. They’re going to unload every ounce of angst into that thing, and by defaulting to “keep them engaged”, that chatbot is either going to ignore stuff it shouldn’t or encourage them in ways that it shouldn’t. It’s obvious there’s no real guardrails in this instance, as if he was talking about being suicidal, some red flags should’ve popped up.
Yes the parents shouldn’t have allowed him such unfettered access, yes they shouldn’t have had a loaded gun that he had access to, but a simple “This is all for funsies” warning on the interface isn’t enough to stop this from happening again. Some really troubled adults are using these things as defacto therapists and that’s bad too. But I’d be happier if lawmakers were much more worried about kids having access to this stuff than accessing “adult sites”.
I get what you are saying, and somewhat agree. However this really reads exactly like a decade ago when it was “teens can’t tell the difference between killing someone in a video game vs real life”
When a kid dies it’s natural for parents to want to seek someone to blame but sometimes there not a lot you can do. However sad it is and it’s definitely sad you just need to accept it as something that happened, isn’t always anyone’s fault.
There is a bare minimum one could do and I would have thought that gun safety would be covered under that bare minimum. Especially once they start throwing around accusations at other people.
I really think a gun safety class should be required to own a firearm. However, I also see how that would violate the second amendment (by making it harder for those of lesser means to exercise their right to own a weapon because they do not have the same resources available to take a class).
I think that as long as we have the second amendment, we should be offering taxpayer-funded firearm safety courses in all states. And requiring them.
What kind of monster family had a kid with mental health issues, in therapy, and has an accessible gun around unsupervised?
Too many families in America, sadly.
Yeah, that’s not on the app/service.
Could the kid have found another way? Absolutely. But there’s a fucking reason guns stay locked up and out of access for minors, even if that means the adults can’t access them quickly. Kids literally can’t exert full self inhibition of urges, so you make damn sure that anything as easy to make horrible impulse decisions with is out of their hands.
Shit, my kitchen knives stay in a locked case. Same with dangerous chemicals. There’s a limit to how much you can realistically compartmentalize and keep locked up, but that limit isn’t hard to achieve to the degree that nobody can reach things on impulse. Even a toolbox with a padlock on it is enough to slow someone down and give their brain a chance to inhibit the impulse.
My policy? If the gun isn’t on my person, it’s locked up in a way that can only be accessed by the people I want to access it. Shit, even my pellet guns stay in the main safe. The two that are available for the other adults are behind fingerprint locks. Even my displayed collection of knives is locked up enough to prevent casual impulses.
I’m not trying to shit on the parents here, but it isn’t hard to keep a firearm locked up and still accessible to the owner rapidly. Fingerprint safes and locks have been around long enough that the bugs are worked out. They’re not cheap, but if you can afford a firearm in the first place, you can damn well afford keeping it out of someone else’s hands without your permission or a lot of hassle.
Something is really wrong if you need to lock up your kitchen knives.
And the locked “knife display”? Here are my knives, I really like knives, I like to display that I really like knives, would you like to talk about knives? Can I talk at you for 30 minutes about sharpening techniques? Perhaps you’d like to visit my katana collection in the other room? Lol. All kept near his fedora collection no doubt.
All in the name of friendly ribbing though, hobbies are cool and often niche. I’m often a little bemused by people’s esoteric or nerdy hobbies.
But I’m scared to ask if this dude even has kids, or if he’s just storing his kitchen knives in a locked box out of sheer paranoia. There’s safe and then there’s… whatever this is.
Well, considering that some of those knives would sell for a few hundred, and include irreplaceable antiques, I’ll err on the side of caution, thank you.
Fwiw, my kid is trained. They’ve been doing martial arts with me for years, when my body lets me. They were part of the small class I was teaching for a while too. Dunno if martial arts as a hobby is that esoteric or not, but it is something I’ve done since my twenties, and I’m fifty now.
And, really, compared to shit like funko (funco? I can’t remember how it’s spelled), at least knives have history and aren’t made of plastics that fuck up the environment.
But, my dude, for someone “friendly ribbing”, you’re really fucking snarky about mentioning me having kids. That crosses a line, you dig? So, if you really were just playing, and not being a douche on purpose, maybe avoid that kind of joke in the future, it’s such am asshole thing to say. I’m choosing to assume the best here, that you think snarky “ribbing” with or about a stranger to someone other than that person is friendly in any way, instead of assuming you’re only being a dick. But, you know, if it walks like a dick and quacks like a dick, it might just be a dick ;)
🤣
That’s a bit much…
Yeah, like he just picked it up? Mine is locked and was he in therapy?
Sounds like he received some therapy, but this can be an expensive and difficult to access form of healthcare for many.
It makes it seems worse. His parents knew he was having problems and still left a gun within easy reach.
She is a 40 yo lawyer. I doubt that she couldn’t afford something more. I find it plausible that she couldn’t devote more time to the kid.
Therapy is also about fit. It takes something like 5 tries to get a good match - both the kid and the parent need to be on board, or the whole thing will end up as a bad experience for everyone involved