←back to thread

Hallucinations in code are the least dangerous form of LLM mistakes

(simonwillison.net)
371 points ulrischa | 3 comments | 02 Mar 25 19:15 UTC | HN request time: 0s | source
Show context
t_mann ◴[02 Mar 25 21:45 UTC] No.43235506[source]▶
Hallucinations themselves are not even the greatest risk posed by LLMs. A much greater risk (in simple terms of probability times severity) I'd say is that chat bots can talk humans into harming themselves or others. Both of which have already happened, btw [0,1]. Still not sure if I'd call that the greatest overall risk, but my ideas for what could be even more dangerous I don't even want to share here.

[0] https://www.qut.edu.au/news/realfocus/deaths-linked-to-chatb...

[1] https://www.theguardian.com/uk-news/2023/jul/06/ai-chatbot-e...

replies(4): >>43235623 #>>43236225 #>>43238379 #>>43238746 #
zahlman ◴[03 Mar 25 05:59 UTC] No.43238746[source]▶
Is this somehow worse than humans talking each other into it?
replies(1): >>43241362 #
1. skywhopper ◴[03 Mar 25 13:09 UTC] No.43241362[source]▶
Yes.
replies(1): >>43243106 #
2. zahlman ◴[03 Mar 25 16:06 UTC] No.43243106[source]▶
How?
replies(1): >>43245556 #
3. krupan ◴[03 Mar 25 19:17 UTC] No.43245556[source]▶
Does this really have to be spelled out?? Because a single human can only intimately converse with and convince a small number of people, while an LLM can do that with thousands (what is the upper limit even?) of people at a time.

Also, because AI is being relentlessly marketed as being better than humans, thereby encouraging people to trust it even more than they might a fellow human.