←back to thread

Nvidia's Project Digits is a 'personal AI supercomputer'

(techcrunch.com)
623 points magicalhippo | 7 comments | 07 Jan 25 04:14 UTC | HN request time: 0.64s | source | bottom
Show context
Karupan ◴[07 Jan 25 04:41 UTC] No.42619320[source]▶
I feel this is bigger than the 5x series GPUs. Given the craze around AI/LLMs, this can also potentially eat into Apple’s slice of the enthusiast AI dev segment once the M4 Max/Ultra Mac minis are released. I sure wished I held some Nvidia stocks, they seem to be doing everything right in the last few years!
replies(21): >>42619339 #>>42619433 #>>42619472 #>>42619544 #>>42619769 #>>42620175 #>>42620289 #>>42620359 #>>42620740 #>>42621569 #>>42621821 #>>42622149 #>>42622154 #>>42622259 #>>42622359 #>>42622567 #>>42622577 #>>42622621 #>>42622863 #>>42627093 #>>42627188 #
1. csomar ◴[07 Jan 25 08:03 UTC] No.42620359[source]▶
Am I the only one disappointed by these? They cost roughly half the price of a macbook pro and offer hmm.. half the capacity in RAM. Sure speed matters in AI, but what do I do with speed when I can't load a 70b model.

On the other hand, with a $5000 macbook pro, I can easily load a 70b model and have a "full" macbook pro as a plus. I am not sure I fully understand the value of these cards for someone that want to run personal AI models.

replies(4): >>42620448 #>>42620456 #>>42620481 #>>42632079 #
2. macawfish ◴[07 Jan 25 08:20 UTC] No.42620448[source]▶
Then buy two and stack them!

Also I'm unfamiliar with macs is there really a MacBook pro with 256GB of RAM?

replies(1): >>42620521 #
3. rictic ◴[07 Jan 25 08:21 UTC] No.42620456[source]▶
Hm? They have 128GB of RAM. Macbook Pros cap out at 128GB as well. Will be interesting to see how a Project Digits machine performs in terms of inference speed.
4. gnabgib ◴[07 Jan 25 08:26 UTC] No.42620481[source]▶
Are you, perhaps, commenting on the wrong thread? Project Digits is a $3k 128GB computer.. the best your your $5K MBP can have for ram is.. 128GB.
5. csomar ◴[07 Jan 25 08:34 UTC] No.42620521[source]▶
No, macbooks pro cap at 128GB. But, still, they are a laptop. It'll be interesting to see if Apple can offer a good counter for the desktop. The mac pro can go to 192Gb which is closer to the 128Gb Digits + your Desktop machine. At $9299 price tag, it's not too competitive but close.
replies(1): >>42621527 #
6. lr1970 ◴[07 Jan 25 11:57 UTC] No.42621527{3}[source]▶
> It'll be interesting to see if Apple can offer a good counter for the desktop.

Mac Pro [0] is a desktop with M2 Ultra and up to 192GB of unified memory.

[0] https://www.apple.com/mac-pro/

7. maniroo ◴[08 Jan 25 07:59 UTC] No.42632079[source]▶
Bro we can connect two ProjectDigits as well. I was only looking at the M4 macbook because 128gb unified memory. Now this beast can cook better LLMs at just 3K with 4TB SSD too. M4 Macbook Max (128 GB unified ram and 4TB Storage) is 5999. So, No more apple for me. I will just get the Digits. And can create a workstation as well.