←back to thread

2127 points bakugo | 1 comments | | HN request time: 0.215s | source
1. zora_goron ◴[] No.43168558[source]
Does anyone know how this “user decides how much compute” is implemented architecturally? I assume it’s the same underlying model, so what factor pushes the model to <think> for longer or shorter? Just a prompt-time modification or something else?