←back to thread

Gemma 3 QAT Models: Bringing AI to Consumer GPUs

(developers.googleblog.com)

602 points emrah | 3 comments | 20 Apr 25 12:22 UTC | HN request time: 0.414s | source

Show context

emrah ◴[20 Apr 25 12:22 UTC] No.43743338[source]▶

>>43743337 (OP) #

Available on ollama: https://ollama.com/library/gemma3

replies(2): >>43743657 #>>43743658 #

1. jinay ◴[20 Apr 25 13:31 UTC] No.43743657[source]▶

Make sure you're using the "-it-qat" suffixed models like "gemma3:27b-it-qat"

replies(2): >>43743770 #>>43745740 #

2. Zambyte ◴[20 Apr 25 13:53 UTC] No.43743770[source]▶

>>43743657 (TP) #

Here are the direct links:

https://ollama.com/library/gemma3:27b-it-qat

https://ollama.com/library/gemma3:12b-it-qat

https://ollama.com/library/gemma3:4b-it-qat

https://ollama.com/library/gemma3:1b-it-qat

3. ein0p ◴[20 Apr 25 18:57 UTC] No.43745740[source]▶

>>43743657 (TP) #

Thanks. I was wondering why my open-webui said that I already had the model. I bet a lot of people are making the same mistake I did and downloading just the old, post-quantized 27B.