←back to thread

Running a 180B parameter LLM on a single Apple M2 Ultra

(twitter.com)
255 points tbruckner | 1 comments | 07 Sep 23 14:36 UTC | HN request time: 0.417s | source
Show context
superkuh[dead post] ◴[07 Sep 23 15:33 UTC] No.37420475[source]▶
[flagged]
sbierwagen ◴[07 Sep 23 15:34 UTC] No.37420490[source]▶
M2 Mac Studio with 192gb of ram is US$5,599 right now.
replies(3): >>37420616 #>>37420693 #>>37427799 #
superkuh[dead post] ◴[07 Sep 23 15:45 UTC] No.37420693[source]▶
[flagged]
bananapub ◴[07 Sep 23 16:00 UTC] No.37420958[source]▶
> gets price wrong

> is corrected

> pivots to some weird rant about 1TB of extremely high performance flash being "useless"

wouldn't it have saved time to just not post either of these comments?

replies(2): >>37421235 #>>37421807 #
acdha ◴[07 Sep 23 16:48 UTC] No.37421807[source]▶
Yeah, I flagged that because it’s basically indistinguishable from trolling. All it’s going to do is distract from the actual thread topic - nobody is going to learn something useful.
replies(1): >>37422339 #
superkuh[dead post] ◴[07 Sep 23 17:21 UTC] No.37422339[source]▶
[flagged]
1. acdha ◴[07 Sep 23 18:32 UTC] No.37423503[source]▶
Dude, just admit you were wrong. This is just painful - especially as other people are pointing out that this is a hard number to beat.