A teen was suicidal. ChatGPT was the friend he confided in

Why did developers spread the idea of AI consciousness for LLMs in the first place? The usefulness and capability of an LLM is orthogonal to its capacity to develop consciousness.

I think people would use LLMs with more detachment if they didn’t believe there was something like a person in them, but they would still become reliant on them, regardless, like people did on calculators for math.

I mean, see the outcry when OpenAI briefly nuked GPT-4o in ChatGPT; people acted as if OpenAI had killed their friend. This is of course all deeply concerning, but it does seem likely that the personified LLM is a more compelling product, and more likely to encourage dependence/addiction.

I wonder to what extent the 4o rollback was motivated by this exact case