(codesandbox.io)

169 points hunvreus | 2 comments | 08 Apr 25 14:55 UTC | HN request time: 0s | source

1. nodesocket ◴[11 Apr 25 16:06 UTC] No.43655402[source]▶

Has anybody tried running ollama and Open WebUI in firecracker instead of full VMs? I assume this should work, but not sure about GPU (single and multi) passthrough.

replies(1): >>43667825 #

2. nkko ◴[12 Apr 25 20:47 UTC] No.43667825[source]▶

>>43655402 (TP) #

As far as I understand Firecracker, you can't do a GPU passthrough

↑

We clone a running VM in 2 seconds (2022)