←back to thread

Running a 180B parameter LLM on a single Apple M2 Ultra

(twitter.com)
255 points tbruckner | 1 comments | 07 Sep 23 14:36 UTC | HN request time: 0.363s | source
Show context
superkuh[dead post] ◴[07 Sep 23 15:33 UTC] No.37420475[source]▶
[flagged]
sbierwagen ◴[07 Sep 23 15:34 UTC] No.37420490[source]▶
M2 Mac Studio with 192gb of ram is US$5,599 right now.
replies(3): >>37420616 #>>37420693 #>>37427799 #
1. catchnear4321 ◴[08 Sep 23 00:45 UTC] No.37427799[source]▶
i really can’t afford comments like this.