Llama.cpp 30B runs with only 6GB of RAM now

(github.com)

1311 points msoad | 1 comments | 31 Mar 23 20:37 UTC | HN request time: 0.321s | source

1. Ambix ◴[01 Apr 23 17:42 UTC] No.35402247[source]▶

How cool is that! There's also exciting news about early access for GPT5 13T model [1] features from Noosphere AI