←back to thread

I failed to recreate the 1996 Space Jam website with Claude

(j0nah.com)
549 points thecr0w | 1 comments | 07 Dec 25 17:18 UTC | HN request time: 0.201s | source
Show context
micromacrofoot ◴[07 Dec 25 18:26 UTC] No.46183822[source]▶
I wouldn't call it entirely defeated, it got maybe 90% of the way there. Before LLMs you couldn't get 50% of the way there in an automated way.

> What he produces

I feel like personifying LLMs more than they currently are is a mistake people make (though humans always do this), they're not entities, they don't know anything. If you treat them too human you might eventually fool yourself a little too much.

replies(2): >>46184461 #>>46184589 #
thecr0w ◴[07 Dec 25 19:58 UTC] No.46184589[source]▶
As a couple other comments pointed out, it's also not fair to judge Claude based on a one shot like this. I sort of assume these limitations will remain even if we went back and forth but to be fair, I didn't try that more than a few times in this investigation. Maybe on try three it totally nails it.
replies(1): >>46194910 #
1. micromacrofoot ◴[08 Dec 25 17:17 UTC] No.46194910[source]▶
Very true, I would also caution this with test projects with real humans in the hiring process. Comparing one-shots from actual people is unfair too, and often the most valid assessment comes with giving them feedback and seeing how they respond to it.

Aside from that point: if you are reading this and making people do a project as part of the hiring process, you should absolutely be paying them for their time (even a token amount).