←back to thread

Running a 180B parameter LLM on a single Apple M2 Ultra

(twitter.com)
255 points tbruckner | 1 comments | 07 Sep 23 14:36 UTC | HN request time: 0.206s | source
Show context
superkuh[dead post] ◴[07 Sep 23 15:33 UTC] No.37420475[source]▶
[flagged]
1. m3kw9 ◴[07 Sep 23 16:47 UTC] No.37421791[source]▶
I just rather pay 20 a month to get a share of 10000 h100 running the benchmark LLM instead