←back to thread

361 points mseri | 1 comments | | HN request time: 0.3s | source
Show context
thot_experiment ◴[] No.46002543[source]
Qwen3-30B-VL is going to be fucking hard to beat as a daily driver, it's so good for the base 80% of tasks I want an AI for, and holy fuck is it fast. 90tok/s on my machine, I pretty much keep it in vram permanently. I think this sort of work is important and I'm really glad it's being done, but in terms of something I want to use every day there's no way a dense model can compete unless it's smart as fuck. Even dumb models like Qwen3-30B get a lot of stuff right and not having to wait is amazing.
replies(3): >>46002752 #>>46005422 #>>46005940 #
1. comp_raccoon ◴[] No.46005940[source]
Olmo author here! Qwenmodels are in general amazing, but 30B is v fast cuz it’s an MoE. MoEs very much on the roadmap for next Olmo.