←back to thread

577 points simonw | 2 comments | | HN request time: 0.405s | source
Show context
msikora ◴[] No.44726445[source]
With 48GB MAcBook Pro M3 I'm probably out of luck, right?
replies(1): >>44726689 #
1. simonw ◴[] No.44726689[source]
For this particular model, yes.

This new one from Qwen should fit though - it looks like that only needs ~30GB of RAM: https://huggingface.co/lmstudio-community/Qwen3-30B-A3B-Inst...

replies(1): >>44727147 #
2. omneity ◴[] No.44727147[source]
It takes ~17-20GB on Q4 depending on context length & settings (running it as we speak)

~30GB in Q8 sure, but it's a minimal gain for double the VRAM usage.