←back to thread

The wall confronting large language models

(arxiv.org)
170 points PaulHoule | 1 comments | 03 Sep 25 11:40 UTC | HN request time: 0s | source
Show context
dcre ◴[03 Sep 25 20:10 UTC] No.45119904[source]▶
Always fun to see a theoretical argument that something clearly already happening is impossible.
replies(2): >>45120040 #>>45120369 #
crowbahr ◴[03 Sep 25 21:00 UTC] No.45120369[source]▶
Really? It sure seems like we're at the top of the S curve with LLMs. Wiring them up to talk the themselves as reasoning isn't scaling the core models, which have only made incremental gains for all the billions invested.

There's plenty more room to grow with agents and tooling, but the core models are only slightly bumping YoY rather than the rocketship changes of 2022/23.

replies(3): >>45121228 #>>45123377 #>>45125522 #
1. skeezyboy ◴[04 Sep 25 10:05 UTC] No.45125522[source]▶
> There's plenty more room to grow with agents and tooling, but the core models are only slightly bumping YoY rather than the rocketship changes of 2022/23.

understandable. the real innovation was the process/technique underlying LLMs. the rest is just programmers automating it. similar happened with blockchain, everything after was just tinkering the initial idea