←back to thread

168 points selvan | 2 comments | | HN request time: 0.423s | source
Show context
TekMol ◴[] No.44461758[source]
It seems the only code that runs in the browser here is the code that talks to LLMs on servers.

Why would you need WASM for this?

replies(3): >>44461907 #>>44462433 #>>44465568 #
1. m13rar ◴[] No.44462433[source]
From a quick gander. WASM is not to talk to the servers. WASM can be utilized to run AI Agents to talk to local LLMs from a sandboxed environment through the browser.

For example in the next few years if Operating System companies and PC producers make small local models stock standards to improve the operating system functions and other services. This local LLM engine layer can be used by browser applications too and that being done through WASM without having to write Javascript and using WASM sandboxed layer to safely expose the this system LLM Engine Layer.

replies(1): >>44463502 #
2. TekMol ◴[] No.44463502[source]
No matter if the LLM is on the same machine or elsewhere, why would you need WASM to talk to it and not just JS?