←back to thread

Running a 180B parameter LLM on a single Apple M2 Ultra

(twitter.com)
255 points tbruckner | 1 comments | 07 Sep 23 14:36 UTC | HN request time: 0.275s | source
Show context
sbierwagen ◴[07 Sep 23 15:18 UTC] No.37420216[source]▶
The screenshot shows a working set size of 147,456 mb, so he's using the mac studio with 192 gb of ram?
replies(1): >>37420327 #
1. ◴[07 Sep 23 15:25 UTC] No.37420327[source]▶