←back to thread

Adaptive LLM routing under budget constraints

(arxiv.org)
204 points tdchaitanya | 1 comments | 01 Sep 25 16:57 UTC | HN request time: 0.322s | source
Show context
fny ◴[01 Sep 25 17:46 UTC] No.45094906[source]▶
Is there a reason human preference data is even needed? Don't LLMs already have a strong enough notion of question complexity to build a dataset for routing?
replies(3): >>45094974 #>>45095189 #>>45101110 #
1. imtringued ◴[02 Sep 25 10:18 UTC] No.45101110[source]▶
This is like asking someone to make you a sandwich and expect them to read your mind to determine what kind of sandwich you want.