←back to thread

My Impressions of the MacBook Pro M4

(michael.stapelberg.ch)
240 points secure | 1 comments | | HN request time: 0.241s | source
Show context
__mharrison__ ◴[] No.45775330[source]
Incredible hardware. Love that I can also run local llms on mine. https://github.com/Aider-AI/aider/issues/4526
replies(3): >>45775520 #>>45775670 #>>45775821 #
ericmcer ◴[] No.45775821[source]
Can't you run small LLMs on like... a Macbook air M1? Some models are under 1B weights, they will be almost useless but I imagine you could run them on anything from the last 10 years.

But yeah if you wanna run 600B+ weights models your gonna need an insane setup to run it locally.

replies(2): >>45777812 #>>45779635 #
1. jen729w ◴[] No.45777812[source]
They "run" in the most technical sense, yes. But they're unusably slow.