←back to thread

My 2.5 year old laptop can write Space Invaders in JavaScript now (GLM-4.5 Air)

(simonwillison.net)
577 points simonw | 1 comments | 29 Jul 25 13:45 UTC | HN request time: 0s | source
Show context
joelthelion ◴[29 Jul 25 14:58 UTC] No.44724227[source]▶
Apart from using a Mac, what can you use for inference with reasonable performance? Is a Mac the only realistic option at the moment?
replies(6): >>44724398 #>>44724419 #>>44724553 #>>44724563 #>>44724959 #>>44727049 #
1. AlexeyBrin ◴[29 Jul 25 15:12 UTC] No.44724398[source]▶
A gaming PC with an NVIDIA 4090/5090 will be more than adequate for running local models.

Where a Mac may beat the above is on the memory side, if a model requires more than 24/32 GB of GPU memory you are usually better off with a Mac with 64/128 GB of RAM. On a Mac the memory is shared between CPU and GPU, so the GPU can load larger models.