←back to thread

Nano-Vllm: Lightweight vLLM implementation built from scratch

(github.com)
124 points simonpure | 1 comments | 23 Jun 25 05:10 UTC | HN request time: 0.326s | source
1. zackify ◴[23 Jun 25 11:32 UTC] No.44354627[source]▶
Will this end up getting an open ai compatible web server or is that out of scope.