←back to thread

623 points magicalhippo | 3 comments | | HN request time: 2.773s | source
Show context
modeless ◴[] No.42619310[source]
Finally a real ARM workstation from Nvidia! This will be much faster than Apple's offerings for AI work. And at $3000 it is much cheaper than any Mac with 128 GB RAM.
replies(1): >>42619631 #
sliken ◴[] No.42619631[source]
On the CPU size the Neoverse N2 doesn't compete particularly well with apple's M4, or the Zen5 for the matter.

Bit bit hard to tell what's on offer on the GPU side, I wouldn't be surprised if it was RTX 4070 to 5070 in that range.

If the price/perf is high enough $3k wouldn't be a bad deal, I suspect a Strix Halo (better CPU cores, 256GB/sec memory interface, likely slower GPU cores) will be better price/perf, same max ram for unified memory, and cheaper.

replies(2): >>42619696 #>>42619746 #
modeless ◴[] No.42619696[source]
AI work happens predominantly on the GPU, not the CPU. This GPU with CUDA will run rings around M4 with MLX. And with much more RAM than you can get in a Mac for $3k.

A lot of people have been justifying their Mac Studio or Mac Pro purchases by the potential for running large AI models locally. Project Digits will be much better at that for cheaper. Maybe it won't run compile Chromium as fast, but that's not what it's for.

replies(2): >>42619789 #>>42620510 #
sliken ◴[] No.42619789[source]
The quotes I've seen mention the maximum config (128GB ram and 4TB of storage) and the minimum price. Nothing saying $3k for 128GB ram and 4TB of storage. I hope I'm wrong, but I'm betting the max price is at least twice the minimum price.
replies(3): >>42619894 #>>42620296 #>>42620861 #
rfoo ◴[] No.42620861[source]
This is NVIDIA, not Apple. They don't charge you a RAM tax (at least for this product). There is only one config for RAM: 128GB.
replies(1): >>42620991 #
1. sliken ◴[] No.42620991[source]
It's been far from clear what config options are going to be available, and the $3,000 price is the "starting at" price. Not sure what the options will be, but people have collectively found statements that imply all configs will have 128GB ram. Sounds good, I hope it's true.

Seems like the storage will have options, because it's "up to 4TB". Unsure if there will be differently binned CPUs (clock or number of cores). Or connectX optional or at different speeds.

replies(1): >>42621154 #
2. rfoo ◴[] No.42621154[source]
Doubt it. I don't remember NVIDIA ever doing binning and having different SKUs for their Jetson Developer Kit line, which is similar to this Project Digits thing.
replies(1): >>42623724 #
3. sliken ◴[] No.42623724[source]
Well presumably there's some different configurations supported, otherwise they would say $2,999 instead of starting at $2,999.