(twitter.com)

255 points tbruckner | 1 comments | 07 Sep 23 14:36 UTC | HN request time: 0.207s | source

1. Havoc ◴[07 Sep 23 22:42 UTC] No.37426643[source]▶

Great progress, but I also can't help but feel a sense of apprehension on the access front.

An M2 Ultra while consumer tech is affordable to a fairly small % of the world population.

Running a 180B parameter LLM on a single Apple M2 Ultra