←back to thread

AI models need a virtual machine

(blog.sigplan.org)
224 points azhenley | 2 comments | 30 Aug 25 13:25 UTC | HN request time: 0.431s | source
Show context
armcat ◴[30 Aug 25 15:53 UTC] No.45075670[source]▶
When you use ChatGPT and it executes code, i.e. when you tell it to do something with a CSV file, it seems to run in a VM with certain tools and libraries available to it, and a sandboxed disk access; no internet access though. So it's kind of already there.
replies(3): >>45076177 #>>45076186 #>>45079490 #
1. hhh ◴[30 Aug 25 17:04 UTC] No.45076186[source]▶
It runs in Kubernetes, on AKS (Azure Kubernetes) with some gvisor stuff. Though Jupyter if i recall.
replies(1): >>45076520 #
2. energy123 ◴[30 Aug 25 17:40 UTC] No.45076520[source]▶
`to=python.exec` is how it runs python code, and `to=container.exec` is how it runs bash commands, with attached files showing up in `/many/data`. Unfortunately the stdout is heavily truncated prior to being shown to the model so it's not a hack for longer context via printing file attachment's contents.