←back to thread

Gemma 3 QAT Models: Bringing AI to Consumer GPUs

(developers.googleblog.com)
602 points emrah | 1 comments | 20 Apr 25 12:22 UTC | HN request time: 0.207s | source
Show context
emrah ◴[20 Apr 25 12:22 UTC] No.43743338[source]▶
Available on ollama: https://ollama.com/library/gemma3
replies(2): >>43743657 #>>43743658 #
jinay ◴[20 Apr 25 13:31 UTC] No.43743657[source]▶
Make sure you're using the "-it-qat" suffixed models like "gemma3:27b-it-qat"
replies(2): >>43743770 #>>43745740 #
1. ein0p ◴[20 Apr 25 18:57 UTC] No.43745740[source]▶
Thanks. I was wondering why my open-webui said that I already had the model. I bet a lot of people are making the same mistake I did and downloading just the old, post-quantized 27B.