←back to thread

Show HN: Katakate – Dozens of VMs per node for safe code exec

(github.com)
120 points gbxk | 2 comments | 21 Oct 25 15:22 UTC | HN request time: 0s | source

I've built this to make it easy to host your own infra for lightweight VMs at large scale.

Intended for exec of AI-generated code, for CICD runners, or for off-chain AI DApps. Mainly to avoid Docker-in-Docker dangers and mess.

Super easy to use with CLI / Python SDK, friendly to AI engs who usually don't like to mess with VM orchestration and networking too much.

Defense-in-depth philosophy.

Would love to get feedback (and contributors: clear & exciting roadmap!), thx

Show context
mentalgear ◴[21 Oct 25 16:22 UTC] No.45657697[source]▶
I would really like to see a good local sandboxing solution in this space, something that is truly local-first. This is especially important since many coding models / agentic builders will eventually become lightweight enough to run them on-device instead of having to buy tokens and share user data with big LLM cloud providers.
replies(7): >>45658204 #>>45658498 #>>45659517 #>>45661176 #>>45662480 #>>45662484 #>>45666374 #
gbxk ◴[21 Oct 25 17:19 UTC] No.45658498[source]▶
(sorry I didn't reply in-thread, I'm new to HN, re-posting response here:)

Exactly! The main local requirement is to have hardware virtualization available (e.g. /dev/kvm) but that should be fine on your local linux machine. Won't work in cloud machines or on Mac ARM in current form but maybe if I extend

replies(1): >>45658539 #
ofrzeta ◴[21 Oct 25 17:21 UTC] No.45658539[source]▶
There are some providers that offer KVM nested virtualization, I think Google Cloud, Digital Ocean ... any others?
replies(1): >>45658639 #
gbxk ◴[21 Oct 25 17:27 UTC] No.45658639[source]▶
True! GCP does. I haven't tested it yet. I didn't know D.O does. If anyone knows others, I'm interested too!
replies(1): >>45661910 #
1. eyberg ◴[21 Oct 25 21:23 UTC] No.45661910{3}[source]▶
We (NanoVMs) can run (both unikernel and normal linux) virtualized workloads on plain old ec2 instances (eg: t2.small).
replies(1): >>45666616 #
2. gbxk ◴[22 Oct 25 09:20 UTC] No.45666616[source]▶
Interesting, thanks for sharing!