←back to thread

The "confident idiot" problem: Why AI needs hard rules, not vibe checks

(steerlabs.substack.com)
323 points steerlabs | 1 comments | 04 Dec 25 20:48 UTC | HN request time: 0s | source
Show context
nickdothutton ◴[08 Dec 25 13:30 UTC] No.46192002[source]▶
- Claude, please optimise the project for performance.

o Claude goes away for 15 minutes, doesn't profile anything, many code changes.

o Announces project now performs much better, saving 70% CPU.

- Claude, test the performance.

o Performance is 1% _slower_ than previous.

- Claude, can I have a refund for the $15 you just wasted?

o [Claude waffles], "no".

replies(7): >>46192071 #>>46192493 #>>46192534 #>>46192607 #>>46193483 #>>46194123 #>>46194739 #
jama211 ◴[08 Dec 25 14:29 UTC] No.46192607[source]▶
While you’re making unstructured requests and expecting results, why don’t you ask your barista to make you a “better coffee” with no instructions. Then, when they make a coffee with their own brand of creativity, complain that it tastes worse and you want your money back.
replies(5): >>46192820 #>>46192865 #>>46193079 #>>46195156 #>>46197842 #
1. hexbin010 ◴[08 Dec 25 17:35 UTC] No.46195156[source]▶
I could also argue if a barista gets multiple complaints about their coffee it's very much their and their employer's job to go away and figure out to make good coffee.

It's very much not the customers job to learn about coffee and to direct them how to make a quality basic coffee

And it's not rocket science.