←back to thread

Gemma 3 QAT Models: Bringing AI to Consumer GPUs

(developers.googleblog.com)
602 points emrah | 1 comments | 20 Apr 25 12:22 UTC | HN request time: 0.211s | source
Show context
porphyra ◴[20 Apr 25 17:31 UTC] No.43745158[source]▶
It is funny that Microsoft had been peddling "AI PCs" and Apple had been peddling "made for Apple Intelligence" for a while now, when in fact usable models for consumer GPUs are only barely starting to be a thing on extremely high end GPUs like the 3090.
replies(4): >>43745683 #>>43746489 #>>43746510 #>>43746780 #
1. icedrift ◴[20 Apr 25 21:00 UTC] No.43746489[source]▶
Capable local models have been usable on Macs for a while now thanks to their unified memory.