←back to thread

Kvcached: Virtualized, elastic KV cache for LLM serving on shared GPUs

(www.notion.so)
69 points Jrxing | 1 comments | 21 Oct 25 17:29 UTC | HN request time: 0s | source
Show context
BergAndCo ◴[21 Oct 25 20:32 UTC] No.45661310[source]▶
[flagged]
replies(2): >>45664064 #>>45672501 #
1. dang ◴[22 Oct 25 17:38 UTC] No.45672501[source]▶
Please don't cross into personal attack.

https://news.ycombinator.com/newsguidelines.html