←back to thread

Adaptive LLM routing under budget constraints

(arxiv.org)
204 points tdchaitanya | 3 comments | 01 Sep 25 16:57 UTC | HN request time: 0.749s | source
Show context
andrewflnr ◴[01 Sep 25 17:48 UTC] No.45094933[source]▶
Is this really the frontier of LLM research? I guess we really aren't getting AGI any time soon, then. It makes me a little less worried about the future, honestly.

Edit: I never actually expected AGI from LLMs. That was snark. I just think it's notable that the fundamental gains in LLM performance seem to have dried up.

replies(7): >>45094979 #>>45094995 #>>45095059 #>>45095198 #>>45095374 #>>45095383 #>>45095463 #
yahoozoo ◴[01 Sep 25 18:37 UTC] No.45095374[source]▶
That and LLMs are seemingly plateauing. Earlier this year, it seemed like the big companies were releasing noticeable improvements every other week. People would joke a few weeks is “an eternity” in AI…so what time span are we looking at now?
replies(3): >>45095505 #>>45095842 #>>45096023 #
muldvarp ◴[01 Sep 25 19:31 UTC] No.45095842[source]▶
There have been very large improvements in code generation in the last 6 months. A few weeks without improvement are not necessarily a plateau.
replies(1): >>45096061 #
ACCount37 ◴[01 Sep 25 19:57 UTC] No.45096061[source]▶
Wait until it ramps up so much that people will say "it's a plateau, for real this time" when they go 3 days without a +10% capability jump.
replies(1): >>45096195 #
1. muldvarp ◴[01 Sep 25 20:10 UTC] No.45096195[source]▶
I mean I wish there were a plateau, without one we're well onto our way into techno-feudalism. I just don't see it.
replies(1): >>45096748 #
2. ACCount37 ◴[01 Sep 25 21:24 UTC] No.45096748[source]▶
That's what it is: wishful thinking. A lot of people really, really want AI tech to fail - because they don't like the alternative.
replies(1): >>45099262 #
3. muldvarp ◴[02 Sep 25 04:51 UTC] No.45099262[source]▶
Yeah, obviously nobody that actually though about the consequences wants a large part of the population to become unemployed. Even if your job is not threatened by automation, it will be threatened by a lot of people looking for new jobs.

And the kind of automation brought by LLMs is decidely different than automation in the past which almost always created new (usually better) jobs. LLMs won't do this (at least to extent where it would matter) I think. Most people in ten years will have worse jobs (more physically straining, longer hours, less pay) unless there will be a political intervention.