Qwen3-Omni-Flash-2025-12-01：a next-generation native multimodal large model

Does Qwen3-Omni support real-time conversation like GPT-4o? Looking at their documentation it doesn't seem like it does.

Are there any open weight models that do? Not talking about speech to text -> LLM -> text to speech btw I mean a real voice <-> language model.

edit:

It does support real-time conversation! Has anybody here gotten that to work on local hardware? I'm particularly curious if anybody has run it with a non-nvidia setup.

None of inference frameworks (vLLM/SGLang) supports the full model, let alone non-nvidia.

Makes sense, I think streaming audio->audio inference is a relatively big lift.

Correct, it's breaks the single prompt, single completion assumption baked into the frameworks. Conceptually it's still prompt/completion but for low latency response you have to do streaming KV cache prefill with a websocket server.