←back to thread

Nvidia's Project Digits is a 'personal AI supercomputer'

(techcrunch.com)
623 points magicalhippo | 4 comments | 07 Jan 25 04:14 UTC | HN request time: 0.835s | source
Show context
Karupan ◴[07 Jan 25 04:41 UTC] No.42619320[source]▶
I feel this is bigger than the 5x series GPUs. Given the craze around AI/LLMs, this can also potentially eat into Apple’s slice of the enthusiast AI dev segment once the M4 Max/Ultra Mac minis are released. I sure wished I held some Nvidia stocks, they seem to be doing everything right in the last few years!
replies(21): >>42619339 #>>42619433 #>>42619472 #>>42619544 #>>42619769 #>>42620175 #>>42620289 #>>42620359 #>>42620740 #>>42621569 #>>42621821 #>>42622149 #>>42622154 #>>42622259 #>>42622359 #>>42622567 #>>42622577 #>>42622621 #>>42622863 #>>42627093 #>>42627188 #
qwertox ◴[07 Jan 25 05:10 UTC] No.42619472[source]▶
This is somewhat similar to what GeForce was to gamers back in the days, but for AI enthusiasts. Sure, the price is much higher, but at least it's a completely integrated solution.
replies(1): >>42619685 #
1. Karupan ◴[07 Jan 25 05:51 UTC] No.42619685[source]▶
Yep that's what I'm thinking as well. I was going to buy a 5090 mainly to play around with LLM code generation, but this is a worthy option for roughly the same price as building a new PC with a 5090.
replies(1): >>42620744 #
2. qwertox ◴[07 Jan 25 09:16 UTC] No.42620744[source]▶
It has 128 GB of unified RAM. It will not be as fast as the 32 GB VRAM of the 5090, but what gamer cards have always lacked was memory.

Plus you have fast interconnects, if you want to stack them.

I was somewhat attracted by the Jetson AGX Orin with 64 GB RAM, but this one is a no-brainer for me, as long as idle power is reasonable.

replies(2): >>42621291 #>>42621307 #
3. moffkalast ◴[07 Jan 25 11:02 UTC] No.42621291[source]▶
Having your main pc as an LLM rig also really sucks for multitasking, since if you want to keep a model loaded to use it when needed, it means you have zero resources left to do anything else. GPU memory maxed out, most of the RAM used. Having a dedicated machine even if it's slower is a lot more practical imo, since you can actually do other things while it generates instead of having to sit there and wait, not being able to do anything else.
4. ◴[07 Jan 25 11:07 UTC] No.42621307[source]▶