←back to thread

Qwen2.5-VL-32B: Smarter and Lighter

(qwenlm.github.io)
544 points tosh | 1 comments | 24 Mar 25 18:35 UTC | HN request time: 0.233s | source
Show context
101008 ◴[24 Mar 25 20:15 UTC] No.43464981[source]▶
Silly question: how can OpenAI, Claude and all, have a valuation so large considering all the open source models? Not saying they will disappear or be tiny (closed models), but why so so so valuable?
replies(10): >>43465120 #>>43465472 #>>43465899 #>>43465934 #>>43466072 #>>43466079 #>>43467117 #>>43467174 #>>43467244 #>>43468107 #
elorant ◴[24 Mar 25 22:32 UTC] No.43466079[source]▶
The average user won't self-host a model.
replies(2): >>43466158 #>>43467849 #
epolanski ◴[24 Mar 25 22:42 UTC] No.43466158[source]▶
...yet
replies(2): >>43468526 #>>43475614 #
1. _xtrimsky ◴[25 Mar 25 20:31 UTC] No.43475614[source]▶
I've tried self hosting. It is quite difficult, and either you are limited to low models, either you need a very expensive setup. I couldn't run this model on my gaming computer.

If I try other models, I basically end up with a very bad version of AI. Even if I'm someone who uses Anthropic APIs a lot, it's absolutely not worth it to try and self host it. The APIs are much better and you get much cheaper results.

Self hosting for AI might be useful for 0.001% of people honestly.