←back to thread

Chrome is adding `window.ai` – a Gemini Nano AI model right inside the browser

(twitter.com)
229 points modinfo | 3 comments | 30 Jun 24 01:56 UTC | HN request time: 0.001s | source
1. btown ◴[30 Jun 24 03:12 UTC] No.40834882[source]▶
If we thought websites mining Monera in ads was bad, wait until every site sells its users’ CPU cycles on a gray market for distributed LLM processing!
replies(1): >>40835021 #
2. asadalt ◴[30 Jun 24 03:50 UTC] No.40835021[source]▶
but that’s not much useful if the model is nano. Webgpu would be a better point of misuse maybe
replies(1): >>40835275 #
3. btown ◴[30 Jun 24 05:08 UTC] No.40835275[source]▶
The latency to download all the weights would be a limiting factor on WebGPU. But if the weights are already downloaded and optimized locally…