←back to thread

577 points simonw | 2 comments | | HN request time: 0.44s | source
Show context
pmarreck ◴[] No.44729718[source]
I have an M4 Mac with 128GB RAM and I'm currently downloading GLM-4.5-Air-q5-hi-mlx via LM Studio (80GB) and will report back!
replies(1): >>44730516 #
rexreed ◴[] No.44730516[source]
How is it going? Intrigued enough to possibly get an M4 Mac with 128GB RAM if it's worthwhile...
replies(2): >>44730648 #>>44735845 #
1. ls-a ◴[] No.44730648[source]
Apple is going to make so much money if they keep pushing on-device LLMs. It makes absolute sense to sell more macbook pros
replies(1): >>44735853 #
2. pmarreck ◴[] No.44735853[source]
Assuming they keep improving, yes. The one I tried (I responded to the other reply with some output, which was great) is as fast as the cloud ones and nearly as good.