←back to thread

Nvidia's Project Digits is a 'personal AI supercomputer'

(techcrunch.com)
623 points magicalhippo | 1 comments | 07 Jan 25 04:14 UTC | HN request time: 0.219s | source
Show context
theptip ◴[07 Jan 25 15:44 UTC] No.42623585[source]▶
$3k for a 128GB standalone is quite favorable pricing considering the next best option at home is going to be a 32GB 5090 at $2k for the card alone, so probably $3k when you’re done building a rig around it.
replies(3): >>42623673 #>>42623699 #>>42627614 #
lhl ◴[07 Jan 25 15:52 UTC] No.42623699[source]▶
The memory bandwidth has not been announced for this device. It's probably going to be more appropriate to compare vs a 128GB M4 Max (410-546GB/s MBW) or an AMD Ryzen AI Max+ 395 (yes, that's its real name) at 256GB/s of MBW.

The 5090 has 1.8TB/s of MBW and is in a whole different class performance-wise.

The real question is how big of a model will you actually want to run based on how slowly tokens generate.

replies(1): >>42626024 #
1. elorant ◴[07 Jan 25 19:04 UTC] No.42626024[source]▶
Well obviously it has to be low otherwise they would cannibalize their high end GPUs.