←back to thread

Nvidia's Project Digits is a 'personal AI supercomputer'

(techcrunch.com)
623 points magicalhippo | 4 comments | 07 Jan 25 04:14 UTC | HN request time: 0.457s | source
Show context
quick_brown_fox ◴[07 Jan 25 09:11 UTC] No.42620719[source]▶
How about “We sell a computer called the tinybox. It comes in two colors + pro.

tinybox red and green are for people looking for a quiet home/office machine. tinybox pro is for people looking for a loud compact rack machine.” [0]

[0] https://tinygrad.org/#tinybox

replies(4): >>42620758 #>>42621266 #>>42621741 #>>42623779 #
1. loudmax ◴[07 Jan 25 15:59 UTC] No.42623779[source]▶
Going by the specs, this pretty much blows Tinybox out of the water.

For $40,000, a Tinybox pro is advertised as offering 1.36 petaflops processing and 192 GB VRAM.

For about $6,000 a pair of Nvidia Project Digits offer about a combined 2 petaflops processing and 256 GB VRAM.

The market segment for Tinybox always seemed to be people that were somewhat price-insensitive, but unless Nvidia completely fumbles on execution, I struggle to think of any benefits of a Tinygrad Tinybox over an Nvidia Digits. Maybe if you absolutely, positively, need to run your OS on x86.

I'd love to see if AMD or Intel has a response to these. I'm not holding my breath.

replies(2): >>42624000 #>>42626120 #
2. nilstycho ◴[07 Jan 25 16:13 UTC] No.42624000[source]▶
> For about $6,000 a pair of Nvidia Project Digits offer about a combined 2 petaflops processing and 256 GB VRAM.

2 PFLOPS at FP4.

256 GB RAM, not VRAM. I think they haven't specified the memory bandwidth.

replies(1): >>42624313 #
3. loudmax ◴[07 Jan 25 16:37 UTC] No.42624313[source]▶
You're right. Tinybox's 1.36 petaflops is FP16 so that is a significant difference.

Also, the Tinybox's memory bandwidth is 8064 GB/s, while the Digits seems to be around 512 GB/s, according to speculation on Reddit.

Moreover, Nvidia's announced their RTX 5090s priced at $2k, which could put downward pressure on the price of Tinybox's 4090s. So the Tinybox green or pro models might get cheaper, or they might come out with a 5090-based model.

If you're the kind of person that's ready to spend $40k on a beastly ML workstation, there's still some upside to Tinybox.

4. elorant ◴[07 Jan 25 19:12 UTC] No.42626120[source]▶
You're missing the most critical part though. Memory bandwidth. It hasn't been announced yet for Digits and it probably won't be comparable to that of dedicated GPUs.