←back to thread

Llama.cpp 30B runs with only 6GB of RAM now

(github.com)
1311 points msoad | 1 comments | 31 Mar 23 20:37 UTC | HN request time: 0.203s | source
1. boppo1 ◴[02 Apr 23 04:47 UTC] No.35407271[source]▶
What about Slaren?

https://rentry.org/Jarted