Chrome is adding `window.ai` – a Gemini Nano AI model right inside the browser

I mostly think it's an interesting concept that can allow many interesting user experiences.

At the same time, it is a major risk for browser compatibility. Despite many articles claiming otherwise, I think we mostly avoided repeating the "works only on IE6" situation with chrome. Google did kinda try at times, but most things didn't catch on. This I think has the potential to do some damage on that front.

Microsoft, Mozilla and Apple all have the resources to provide competitive small LLMs in their own browsers’ implementation of window.ai if this catches on. A 3B sized model isn’t a moat for Chrome.

You can run Gemini Nano locally in all web browsers supporting WebGPU through MediaPipe: https://x.com/niu_tech/status/1807073666888266157

I'm looking forward to see a cross-browser polyfill, possibly as a web extension.