←back to thread

623 points magicalhippo | 7 comments | | HN request time: 0.003s | source | bottom
Show context
fweimer ◴[] No.42621548[source]
If they end up actually shipping this, lots of people will buy these machines to get an AArch64 Linux workstation—even if they are not interested in AI or Nvidia GPUs.

At $3,000, it will be considerably cheaper than alternatives available today (except for SoC boards with extremely poor performance, obviously). I also expect that Nvidia will use its existing distribution channels for this, giving consumers a shot at buying the hardware (without first creating a company and losing consumer protections along the way).

replies(1): >>42621651 #
kllrnohj ◴[] No.42621651[source]
> At $3,000, it will be considerably cheaper than alternatives available today

$3000 gets me a 64-core Altra Q64-22 from a major-enough SI today: https://system76.com/desktops/thelio-astra-a1-n1/configure

And of course if you don't care about the SI part, then you can just buy that motherboard & CPU directly for $1400 https://www.newegg.com/asrock-rack-altrad8ud-1l2t-q64-22-amp... with the 128-core variant being $2400 https://www.newegg.com/asrock-rack-altrad8ud-1l2t-q64-22-amp...

replies(3): >>42622742 #>>42623188 #>>42625402 #
1. adrian_b ◴[] No.42622742[source]
That Altra may be a good choice for certain server applications, like a Web server, but when used as a workstation it will be sluggish, because it uses weak cores, with much lower single-threaded performance than the Arm cores used in NVIDIA Digits.

For certain applications, e.g. for those with many array operations, the 20 cores of Digits might match 40 cores of Altra at equal clock frequency, but the cores of Digits are likely to also have a higher clock frequency, so for some applications the 20 Arm cores of Digits may provide a higher throughput than 64 Altra cores, while also having a much higher single-thread performance, perhaps about double.

So at equal price, NVIDIA Digits is certainly preferable as a workstation instead of a 64-core Altra. As a server, the latter should be better.

replies(1): >>42623860 #
2. kllrnohj ◴[] No.42623860[source]
I mean I can get a Snapdragon X Elite laptop for $1200 that'll have a faster CPU than the one in the Digits, too...
replies(2): >>42624176 #>>42627764 #
3. adrian_b ◴[] No.42624176[source]
Their speeds should be very similar, but which is faster is uncertain.

There have not been any published benchmarks demonstrating the speed of Cortex-X925 in a laptop/mini-PC environment.

In smartphones, Cortex-X925 and Snapdragon Elite have very similar speeds in single thread.

For multithreaded applications, 10 big + 10 medium Arm cores should be somewhat faster than 12 Snapdragon Elite.

The fact that NVIDIA Digits has a wider memory interface should give it even more advantages in some applications.

The Blackwell GPU should have much better software support in graphics applications, not only in ML/AI, in comparison with the Qualcomm GPU.

So NVIDIA Digits should be faster than a Qualcomm laptop, but unless one is interested in ML/AI applications the speed difference should not be worth the more than double price of NVIDIA.

replies(1): >>42625479 #
4. fweimer ◴[] No.42625479{3}[source]
If the Nvidia system runs reasonably well with stock distribution kernels, it may well be worth the extra price. Usually, an optimized, custom kernel is a warning sign, but maybe they have upstreaming plans, and support for other distributions is planned.
5. sliken ◴[] No.42627764[source]
Sure, but less than half the memory bandwidth and inference is largely bandwidth bound.
replies(1): >>42628732 #
6. kllrnohj ◴[] No.42628732{3}[source]
The context was people that don't care about AI or Nvidia GPUs and just want an AArch64 system. So inference performance is irrelevant here

> lots of people will buy these machines to get an AArch64 Linux workstation—even if they are not interested in AI or Nvidia GPUs.

replies(1): >>42628795 #
7. sliken ◴[] No.42628795{4}[source]
Ah, sure the Oryon cores are decent, GPU is a bit weak, even compared to the normal cheap/low end APUs.