←back to thread

Snapdragon X2 Elite ARM Laptop CPU

(www.qualcomm.com)
163 points wmf | 1 comments | 24 Sep 25 22:01 UTC | HN request time: 0s | source
Show context
smcleod ◴[24 Sep 25 23:21 UTC] No.45367136[source]▶
Their top model still only has "Up to 228 GB/s" bandwdith which places it in the low end category for anything AI related, for comparison Apple Silicon is up to 800GB/s and Nvidia cards around 1800GB/s and no word if it supports 256-512GB of memory.
replies(2): >>45367166 #>>45367523 #
Aurornis ◴[25 Sep 25 00:02 UTC] No.45367523[source]▶
> Their top model still only has "Up to 228 GB/s" bandwdith which places it in the low end category for anything AI related, for comparison Apple Silicon is up to 800GB/s

Most Apple Silicon is much less than 800 GB/s.

The base M4 is only 120GB/s and the next step up M4 Pro is 273GB/s. That’s in the same range as this part.

It’s not until you step up to the high end M4 Max parts that Apple’s memory bandwidth starts to diverge.

For the target market with long battery life as a high priority target, this memory bandwidth is reasonable. Buying one of these as a local LLM machine isn’t a good idea.

replies(2): >>45367582 #>>45368317 #
1. Rohansi ◴[25 Sep 25 00:09 UTC] No.45367582[source]▶
This, and always check benchmarks instead of assuming memory bandwidth is the only possible bottleneck. Apple Silicon definitely does not fully use its advertised memory bandwidth when running LLMs.