The AMD Radeon Instinct MI300A's Giant Memory Subsystem

MI300 is an insanely good GPU. There is nothing that Nvidia sells that even comes close. The H100 only has 80GB of memory, whereas MI300 has 192GB. If you are training large models, AMD is the way to go.

H200has more memory and B200 just takes it even more home with cluster wide NVLink.

AMD has zero response to it.

1.8TB/s interconnect, check.

AWS has this on their new platform as well.

H200 has less memory than MI300