←back to thread

Qwen2.5-VL-32B: Smarter and Lighter

(qwenlm.github.io)
544 points tosh | 2 comments | 24 Mar 25 18:35 UTC | HN request time: 0.496s | source
Show context
simonw ◴[24 Mar 25 18:52 UTC] No.43464227[source]▶
Big day for open source Chinese model releases - DeepSeek-v3-0324 came out today too, an updated version of DeepSeek v3 now under an MIT license (previously it was a custom DeepSeek license). https://simonwillison.net/2025/Mar/24/deepseek/
replies(5): >>43464375 #>>43464498 #>>43464686 #>>43465383 #>>43467111 #
chaosprint ◴[24 Mar 25 19:06 UTC] No.43464375[source]▶
it seems that this free version "may use your prompts and completions to train new models"

https://openrouter.ai/deepseek/deepseek-chat-v3-0324:free

do you think this needs attention?

replies(7): >>43464399 #>>43464480 #>>43464512 #>>43464616 #>>43464961 #>>43468548 #>>43470210 #
huijzer ◴[24 Mar 25 19:21 UTC] No.43464512[source]▶
Since we are on HN here, I can highly recommend open-webui with some OpenAI-compatible provider. I'm running with Deep Infra for more than a year now and am very happy. New models are usually available within one or two days after release. Also have some friends who use the service almost daily.
replies(7): >>43464718 #>>43465081 #>>43466430 #>>43466464 #>>43466949 #>>43469369 #>>43473139 #
unquietwiki ◴[24 Mar 25 19:45 UTC] No.43464718[source]▶
I'm using open-webui at home with a couple of different models. gemma2-9b fits in VRAM on a NV 3060 card + performs nicely.
replies(2): >>43465594 #>>43469350 #
1. zakki ◴[24 Mar 25 21:30 UTC] No.43465594[source]▶
What is the memory of your NV3060? 8GB?
replies(1): >>43466243 #
2. ngvjmfgb ◴[24 Mar 25 22:53 UTC] No.43466243[source]▶
12GB (edit: that is what mine is)