←back to thread

577 points simonw | 1 comments | | HN request time: 0.443s | source
Show context
maksimur ◴[] No.44725348[source]
A $xxxx 2.5 year old laptop, one that's probably much more powerful than an average laptop bought today and probably next year as well. I don't think it's a fair reference point.
replies(3): >>44725487 #>>44725524 #>>44727645 #
bprew ◴[] No.44725524[source]
His point isn't that you can run a model on an average laptop, but that the same laptop can still run frontier models.

It speaks to the advancements in models that aren't just throwing more compute/ram at it.

Also, his laptop isn't that fancy.

> It claims to be small enough to run on consumer hardware. I just ran the 7B and 13B models on my 64GB M2 MacBook Pro!

From: https://simonwillison.net/2023/Mar/11/llama/

replies(1): >>44733482 #
1. ◴[] No.44733482[source]