←back to thread

Gemma 3 QAT Models: Bringing AI to Consumer GPUs

(developers.googleblog.com)
602 points emrah | 1 comments | 20 Apr 25 12:22 UTC | HN request time: 0s | source
Show context
justanotheratom ◴[20 Apr 25 14:23 UTC] No.43743956[source]▶
Anyone packaged one of these in an iPhone App? I am sure it is doable, but I am curious what tokens/sec is possible these days. I would love to ship "private" AI Apps if we can get reasonable tokens/sec.
replies(4): >>43743983 #>>43744244 #>>43744274 #>>43744863 #
Alifatisk ◴[20 Apr 25 14:26 UTC] No.43743983[source]▶
If you ever ship a private AI app, don't forget to implement the export functionality, please!
replies(2): >>43744861 #>>43747697 #
1. ◴[20 Apr 25 16:43 UTC] No.43744861[source]▶