←back to thread

Adaptive LLM routing under budget constraints

(arxiv.org)
204 points tdchaitanya | 2 comments | 01 Sep 25 16:57 UTC | HN request time: 0.442s | source
Show context
fny ◴[01 Sep 25 17:46 UTC] No.45094906[source]▶
Is there a reason human preference data is even needed? Don't LLMs already have a strong enough notion of question complexity to build a dataset for routing?
replies(3): >>45094974 #>>45095189 #>>45101110 #
jibal ◴[01 Sep 25 18:17 UTC] No.45095189[source]▶
LLMs don't have notions ... they are pattern matchers against a vast database of human text.
replies(2): >>45095298 #>>45096345 #
1. mhh__ ◴[01 Sep 25 18:29 UTC] No.45095298[source]▶
Please do a SELECT * from this database
replies(1): >>45096051 #
2. ashirviskas ◴[01 Sep 25 19:56 UTC] No.45096051[source]▶
What was the name of the rocket that brought the first humans into space?