←back to thread

Running a 180B parameter LLM on a single Apple M2 Ultra

(twitter.com)
255 points tbruckner | 1 comments | 07 Sep 23 14:36 UTC | HN request time: 0.213s | source
1. two_in_one ◴[08 Sep 23 04:58 UTC] No.37429522[source]▶
Just wondering what are local LLMs used for today? So far they look more like a.. promising.