←back to thread

229 points modinfo | 1 comments | | HN request time: 0s | source
Show context
simonw ◴[] No.40835549[source]
If this is the API that Google are going with here:

    const model = await window.ai.createTextSession();
    const result = await model.prompt("3 names for a pet pelican");
There's a VERY obvious flaw: is there really no way to specify the model to use?

Are we expecting that Gemini Nano will be the one true model, forever supported by this API baked into the world's most popular browser?

Given the rate at which models are improving that would be ludicrous. But... if the browser model is being invisibly upgraded, how are we supposed to test out prompts and expect them to continue working without modifications against whatever future versions of the bundled model show up?

Something like this would at least give us a fighting chance:

    const supportedModels = await window.ai.getSupportedModels();
    if (supportedModels.includes("gemini-nano:0.4")) {
        const model = await window.ai.createTextSession("gemini-nano:0.4");
        // ...
replies(7): >>40835678 #>>40835703 #>>40835717 #>>40835757 #>>40836197 #>>40836971 #>>40843533 #
luke-stanley ◴[] No.40835717[source]
Presumably something like model.includes("gemini-nano:0.4") could work?
replies(1): >>40836178 #
damacaner ◴[] No.40836178[source]
can we make everything constant like C# does please

Models.GeminiNano04

boom

replies(2): >>40837121 #>>40843547 #
1. langcss ◴[] No.40843547[source]
That would be like making a constant for every nuget package/version tuple: unworkable because new versions and packages come out all the time.

Or making constants for every device manufacturer you can connect to via web Bluetooth.