AI models need a virtual machine

When you use ChatGPT and it executes code, i.e. when you tell it to do something with a CSV file, it seems to run in a VM with certain tools and libraries available to it, and a sandboxed disk access; no internet access though. So it's kind of already there.

That’s also how Devin works, and OpenHands.

The agent running in a VM - at least by default - was a key feature during the AI pilot I ran a few months ago.

It runs in Kubernetes, on AKS (Azure Kubernetes) with some gvisor stuff. Though Jupyter if i recall.

`to=python.exec` is how it runs python code, and `to=container.exec` is how it runs bash commands, with attached files showing up in `/many/data`. Unfortunately the stdout is heavily truncated prior to being shown to the model so it's not a hack for longer context via printing file attachment's contents.

Not really.

Now imagine you run two AIs (like ChatGPT) on your machine or on a server. You maybe even want them to cooperate on something. How do you do that? Right, you cannot, there is no standard, no interoperability, nothing.