←back to thread

Nano-Vllm: Lightweight vLLM implementation built from scratch

(github.com)
124 points simonpure | 1 comments | 23 Jun 25 05:10 UTC | HN request time: 0.339s | source
1. mountainriver ◴[23 Jun 25 16:03 UTC] No.44357159[source]▶
Love this project, we need more simplifications like this in the current ML environment