←back to thread

S1: A $6 R1 competitor?

(timkellogg.me)
851 points tkellogg | 1 comments | | HN request time: 0.22s | source
Show context
cowsaymoo ◴[] No.42948512[source]
The part about taking control of a reasoning model's output length using <think></think> tags is interesting.

> In s1, when the LLM tries to stop thinking with "</think>", they force it to keep going by replacing it with "Wait".

I had found a few days ago that this let you 'inject' your own CoT and jailbreak it easier. Maybe these are related?

https://pastebin.com/G8Zzn0Lw

https://news.ycombinator.com/item?id=42891042#42896498

replies(2): >>42948587 #>>42965658 #
1. zamalek ◴[] No.42965658[source]
It's weird that you need to do that at all, couldn't you just reject that token and use the next most probable?