←back to thread

LLM Inevitabilism

(tomrenner.com)
1613 points SwoopsFromAbove | 2 comments | | HN request time: 0.428s | source
Show context
kazinator ◴[] No.44568164[source]
LLM is an almost complete waste of time. Advocates of LLM are not accurately measuring their time and productivity, and comparing that to LLM-free alternative approaches.
replies(1): >>44569387 #
phito ◴[] No.44569387[source]
Indeed, I keep seeing comments stating that LLMs have completely changed their way of programming or even changed their lives. All I can think is, they must have been pretty bad at programming for the impact to be that dramatic.
replies(3): >>44570033 #>>44570199 #>>44575304 #
saati ◴[] No.44570199[source]
And never back it up with hard data on productivity and defect rate before and after.
replies(1): >>44575323 #
1. immibis ◴[] No.44575323[source]
Well, we have at least one bit of data now: https://metr.org/blog/2025-07-10-early-2025-ai-experienced-o...

Take a quick look at that summary graph. Then read the X axis labels, and laugh, and weep.

LLMs are literally basically cocaine addiction: delivering the feeling of competence and success directly to your brain, while all actual real-world evidence points to the opposite. They also actually work for some purposes, of course.

replies(1): >>44578289 #
2. kazinator ◴[] No.44578289[source]
Developers will discount the time they spent formulating prompts, and criticailly evaluating the results, because those activities don't feel like development.

It's like if you nag a kid into cleaning their room, and give them detailed instructions on what to do next once they begin the activity, you might underestimate the time you spent, focusing only on the actual clean up time executed by the kid.

Part of the reason may be that the interactions are not recorded. The record of development consists of deliverables like source code, bug reports and documentation. Interactions with AI are gone, just like editor keystrokes.