←back to thread

The slow collapse of critical thinking in OSINT due to AI

(www.dutchosintguy.com)
446 points walterbell | 2 comments | 03 Apr 25 18:21 UTC | HN request time: 0s | source
Show context
BariumBlue ◴[03 Apr 25 22:29 UTC] No.43576242[source]▶
Good point in the post about confidence - most people equate confidence with accuracy - and since AIs always sound confident, they always sound correct
replies(3): >>43576578 #>>43576627 #>>43576944 #
rglover ◴[03 Apr 25 23:19 UTC] No.43576627[source]▶
Yep. Last night I was asking ChatGPT (4o) to help me generate a simple HTML canvas that users could draw on. Multiple times, it spoke confidently of its not even kind of working solution (copying the text from the chat below):

- "Final FIXED & WORKING drawing.html" (it wasn't working at all)

- "Full, Clean, Working Version (save as drawing.html)" (not working at all)

- "Tested and works perfectly with: Chrome / Safari / Firefox" (not working at all)

- "Working Drawing Canvas (Vanilla HTML/JS — Save this as index.html)" (not working at all)

- "It Just Works™" (not working at all)

The last one was so obnoxious I moved over to Claude (3.5 Sonnet) and it knocked it out in 3-5 prompts.

replies(3): >>43576690 #>>43577124 #>>43579586 #
dullcrisp ◴[03 Apr 25 23:27 UTC] No.43576690[source]▶
To be fair, I wouldn't really expect working software if someone described it that way either.
replies(1): >>43576829 #
1. rglover ◴[03 Apr 25 23:48 UTC] No.43576829[source]▶
Those are not my prompts. Those were the headings it put above the code it generated in its responses.

Even if my prompt was low-quality, it doesn't matter. It's confidently stating that what it produced was both tested and working. I personally understand that's not true, but of all the safety guards they should be putting in place, not lying should be near the top of the list.

replies(1): >>43577052 #
2. mattgreenrocks ◴[04 Apr 25 00:25 UTC] No.43577052[source]▶
Intellectual humility is just as rare with AI as it is with humans.