(steerlabs.substack.com)

323 points steerlabs | 1 comments | 04 Dec 25 20:48 UTC | HN request time: 0s | source

Show context

- Claude, please optimise the project for performance.

o Claude goes away for 15 minutes, doesn't profile anything, many code changes.

o Announces project now performs much better, saving 70% CPU.

- Claude, test the performance.

o Performance is 1% _slower_ than previous.

- Claude, can I have a refund for the $15 you just wasted?

o [Claude waffles], "no".

1. bongodongobob ◴[08 Dec 25 17:03 UTC] No.46194739[source]▶

You need to let it actually benchmark. They are only as good as the tools you give them.

The "confident idiot" problem: Why AI needs hard rules, not vibe checks