←back to thread

623 points magicalhippo | 1 comments | | HN request time: 0s | source
Show context
ryao ◴[] No.42619962[source]
This looks like a successor to the Nvidia Jetson AGX Orin 64GB Developer Kit:

https://www.okdo.com/wp-content/uploads/2023/03/jetson-agx-o...

I wonder what the specifications are in terms of memory bandwidth and computational capability.

replies(3): >>42619979 #>>42620718 #>>42622001 #
moffkalast ◴[] No.42620718[source]
The AGX Orin was only 64GB of LPDDR5 and priced at $5k so this does seem like a bargain in comparison with 128GB of presumably HBM. But Nvidia never lowers their prices, so there's a caveat somewhere.
replies(1): >>42621056 #
fulafel ◴[] No.42621056[source]
The memory is LPDDR accordning to the specs graphic on the NV product page: https://www.nvidia.com/en-us/project-digits/

Anyone willing to guess how wide?

replies(1): >>42621211 #
moffkalast ◴[] No.42621211{3}[source]
I've seen some claims that it can do 512 GB/s on Reddit (not sure where they got that from), which would imply a ~300 bit bus with LPDDR5X depending on the frequency.
replies(1): >>42622947 #
pella ◴[] No.42622947{4}[source]
probably:

"According to the Grace Blackwell's datasheet- Up to 480 gigabytes (GB) of LPDDR5X memory with up to 512GB/s of memory bandwidth. It also says it comes in a 120 gb config that does have the full fat 512 GB/s."

via https://www.reddit.com/r/LocalLLaMA/comments/1hvj1f4/comment...

"up to 512GB/s of memory bandwidth per Grace CPU"

https://resources.nvidia.com/en-us-data-center-overview/hpc-...

replies(2): >>42624265 #>>42625773 #
1. moffkalast ◴[] No.42624265{5}[source]
Yep I think that's it. So it's referencing the GB200, it could have absolutely nothing in common with this low power version.