←back to thread

LLM Inevitabilism

(tomrenner.com)
1612 points SwoopsFromAbove | 1 comments | | HN request time: 0.321s | source
Show context
mg ◴[] No.44568158[source]
In the 90s a friend told me about the internet. And that he knows someone who is in a university and has access to it and can show us. An hour later, we were sitting in front of a computer in that university and watched his friend surfing the web. Clicking on links, receiving pages of text. Faster than one could read. In a nice layout. Even with images. And links to other pages. We were shocked. No printing, no shipping, no waiting. This was the future. It was inevitable.

Yesterday I wanted to rewrite a program to use a large library that would have required me to dive deep down into the documentation or read its code to tackle my use case. As a first try, I just copy+pasted the whole library and my whole program into GPT 4.1 and told it to rewrite it using the library. It succeeded at the first attempt. The rewrite itself was small enough that I could read all code changes in 15 minutes and make a few stylistic changes. Done. Hours of time saved. This is the future. It is inevitable.

PS: Most replies seem to compare my experience to experiences that the responders have with agentic coding, where the developer is iteratively changing the code by chatting with an LLM. I am not doing that. I use a "One prompt one file. No code edits." approach, which I describe here:

https://www.gibney.org/prompt_coding

replies(58): >>44568182 #>>44568188 #>>44568190 #>>44568192 #>>44568320 #>>44568350 #>>44568360 #>>44568380 #>>44568449 #>>44568468 #>>44568473 #>>44568515 #>>44568537 #>>44568578 #>>44568699 #>>44568746 #>>44568760 #>>44568767 #>>44568791 #>>44568805 #>>44568823 #>>44568844 #>>44568871 #>>44568887 #>>44568901 #>>44568927 #>>44569007 #>>44569010 #>>44569128 #>>44569134 #>>44569145 #>>44569203 #>>44569303 #>>44569320 #>>44569347 #>>44569391 #>>44569396 #>>44569574 #>>44569581 #>>44569584 #>>44569621 #>>44569732 #>>44569761 #>>44569803 #>>44569903 #>>44570005 #>>44570024 #>>44570069 #>>44570120 #>>44570129 #>>44570365 #>>44570482 #>>44570537 #>>44570585 #>>44570642 #>>44570674 #>>44572113 #>>44574176 #
benreesman ◴[] No.44568791[source]
As someone who has historically been very much an LLM inevitabalism skeptic and has recently decided that we've crossed the breakeven point with indiscriminant use of Opus 4, eh, it's precisely because we're in late LLM === AGI hype world. They're actually cutting the shit on "this can do anything, and in a month, twice that!". This thing is crazy operator aligned, wildly SFT'd on curated codebases, and running a TTFT and cost that means it's basically Chinchilla maxed out, back to work boys, sell some NVIDIA stock.

This is precisely the opposite data point to the one you'd expect if the TESCREAL hype men were right: you do that when the writing is on the wall that this thing is uniquely suited to coding and the only way you'll ever do better than quantize and ad support it is to go after a deep pocketed vertical (our employers).

Nothing whatsoever to do with making a military drone or a car that can handle NYC or an Alexa that's useful instead of an SNL skit. That's other ML (very cool ML).

So the frontier lab folks have finally replaced the information commons they first destroyed, except you need a nuclear reactor and a bunch of Taiwan hawks that make Dick Cheney look like a weak-kneed feminist to run it at a loss forever.

The thing is, this kind of one ine itabalism isn't new: David Graeber spent a luminous career tearing strips off of hacks like Harari for the same exact moral and intellectual failure perpetrated by the same class warfare dynamics for the same lowbrow reasons.

replies(2): >>44569152 #>>44570100 #
polotics ◴[] No.44569152[source]
Can you translate "SFT'd" and "TTFT" and "TESCREAL" for the less clued-in members of the audience? On "one ine itabalism" I just gave up.
replies(3): >>44569539 #>>44569548 #>>44575828 #
1. sudhirb ◴[] No.44569539[source]
I think:

SFT = Supervised Fine Tuning TTFT = Time To First Token TESCREAL = https://en.wikipedia.org/wiki/TESCREAL (bit of a long definition)

"on ine itabalism" = online tribalism?