←back to thread

577 points simonw | 5 comments | | HN request time: 0.206s | source
1. pmarreck ◴[] No.44729718[source]
I have an M4 Mac with 128GB RAM and I'm currently downloading GLM-4.5-Air-q5-hi-mlx via LM Studio (80GB) and will report back!
replies(1): >>44730516 #
2. rexreed ◴[] No.44730516[source]
How is it going? Intrigued enough to possibly get an M4 Mac with 128GB RAM if it's worthwhile...
replies(2): >>44730648 #>>44735845 #
3. ls-a ◴[] No.44730648[source]
Apple is going to make so much money if they keep pushing on-device LLMs. It makes absolute sense to sell more macbook pros
replies(1): >>44735853 #
4. pmarreck ◴[] No.44735845[source]
Pretty impressive. Spit out perfectly-working Asteroids on the first try. https://gist.github.com/pmarreck/db782fdb68053292ca746d6c756...

I want to hook it up to Zed next and see how that goes

5. pmarreck ◴[] No.44735853{3}[source]
Assuming they keep improving, yes. The one I tried (I responded to the other reply with some output, which was great) is as fast as the cloud ones and nearly as good.