←back to thread

Nvidia's Project Digits is a 'personal AI supercomputer'

(techcrunch.com)
623 points magicalhippo | 5 comments | 07 Jan 25 04:14 UTC | HN request time: 1.013s | source
Show context
ryao ◴[07 Jan 25 06:44 UTC] No.42619962[source]▶
This looks like a successor to the Nvidia Jetson AGX Orin 64GB Developer Kit:

https://www.okdo.com/wp-content/uploads/2023/03/jetson-agx-o...

I wonder what the specifications are in terms of memory bandwidth and computational capability.

replies(3): >>42619979 #>>42620718 #>>42622001 #
moffkalast ◴[07 Jan 25 09:11 UTC] No.42620718[source]▶
The AGX Orin was only 64GB of LPDDR5 and priced at $5k so this does seem like a bargain in comparison with 128GB of presumably HBM. But Nvidia never lowers their prices, so there's a caveat somewhere.
replies(1): >>42621056 #
1. fulafel ◴[07 Jan 25 10:09 UTC] No.42621056[source]▶
The memory is LPDDR accordning to the specs graphic on the NV product page: https://www.nvidia.com/en-us/project-digits/

Anyone willing to guess how wide?

replies(1): >>42621211 #
2. moffkalast ◴[07 Jan 25 10:45 UTC] No.42621211[source]▶
I've seen some claims that it can do 512 GB/s on Reddit (not sure where they got that from), which would imply a ~300 bit bus with LPDDR5X depending on the frequency.
replies(1): >>42622947 #
3. pella ◴[07 Jan 25 14:51 UTC] No.42622947[source]▶
probably:

"According to the Grace Blackwell's datasheet- Up to 480 gigabytes (GB) of LPDDR5X memory with up to 512GB/s of memory bandwidth. It also says it comes in a 120 gb config that does have the full fat 512 GB/s."

via https://www.reddit.com/r/LocalLLaMA/comments/1hvj1f4/comment...

"up to 512GB/s of memory bandwidth per Grace CPU"

https://resources.nvidia.com/en-us-data-center-overview/hpc-...

replies(2): >>42624265 #>>42625773 #
4. moffkalast ◴[07 Jan 25 16:33 UTC] No.42624265{3}[source]▶
Yep I think that's it. So it's referencing the GB200, it could have absolutely nothing in common with this low power version.
5. sliken ◴[07 Jan 25 18:42 UTC] No.42625773{3}[source]▶
Keep in mind the "full" grace is a completely different beast with Neoverse cores. This new GB10 uses different cores and might well have a different memory interface. I believe the "120 GB" config includes ECC overhead (which is inline on Nvidia GPUs) and Neoverse cores have various tweaks for larger configurations that are absent in the Cortex-x925.

I'd be happy to be wrong, but I don't see anything from Nvidia that implies a 512 bit wide memory interface on the Nvidia Project DIgits.