Running a 180B parameter LLM on a single Apple M2 Ultra

(twitter.com)

255 points tbruckner | 1 comments | 07 Sep 23 14:36 UTC | HN request time: 0.214s | source

1. growt ◴[07 Sep 23 17:48 UTC] No.37422780[source]▶

So how much ram did the machine have?