The AMD Radeon Instinct MI300A's Giant Memory Subsystem

ROCm is the stack that people write code against to talk to AMD hardware.

George wrote some incomplete non-perfomant drivers for a consumer grade product. Certainly not an easy task, but it also isn't something that most people would use. George just makes loud noises to get attention, but few in the HPC industry pay any attention to him.

Nobody cares what HPC industry has to say; until recently, they have happily been jerking off Monte-Carlo simulations on overpriced nation-grade supercomputer NUMA clusters and didn't know what a "GPU" was anyway! Also please stop spreading "consumer grade product" propaganda. I had used AMD Instinct MI50's—supposedly datacenter-grade hardware, and have faced the exact same problems as George. Except in my case there was no call-line at Lisa's.

Guess what, the AI industry has spoken: hyper-scalers would buy NVIDIA, or rather design their own silicon. Any thing, any how, but nothing to do with AMD.

Also: if your business is doing so great, how come you're constantly in all these Hacker News threads talking and talking and talking but not actually releasing products of any kind, of any bread, that any of the hackers on here could use?

> but not actually releasing products of any kind, of any bread, that any of the hackers on here could use?

Our "product" is open access to a very specific type of HPC compute that previously was locked up and only available to a short list of researchers.

Thanks for asking, we just added 1 GPU / 1 minute docker container access through our excellent partners: https://shadeform.ai

1 GPU / 1 VM / 1 minute is coming soon.

From the looks of it, YOU ARE the product. That is, manufacturing optics of a "partner" and "distributer" ecosystem for AMD. And on borrowed time, too.

> From the looks of it, YOU ARE the product.

Sweet, thanks! That's at least part of what a CEO is supposed to be.

Yes ROCm is for the GPU, but the MI300A also includes 4 clusters of cpus connected by an infinity fabric. Generally this kind of thing is handled by the OS but there is no OS for this product.

AMD has had APU's for years, the PS5 chip is an APU.

I did a quick google search and found this presentation which details the programming model...

https://nowlab.cse.ohio-state.edu/static/media/workshops/pre...

Please don't be salty; the only person here who may embarrass you is yourself. I'm happy that you like to think about yourself as CEO, but perhaps it's worth reflecting you may be doing a better job if you had spent less time on Hacker News, and more time figuring out how to get Hacker News excited about your product? So far you have pledged allegiance to AMD every chance you got, and spun tall tales of great capability, with not much to show for it besides "partners." You know nobody has trained a thing with your GPU's yet? That would be a great place to start for a CEO. To make something people would use. To justify it to us; as AMD themselves have clearly justified your existence there's no work there!

It's just tough words from a nobody, don't worry you'll be fine!

> You know nobody has trained a thing with your GPU's yet?

https://x.com/zealandic1/status/1877005338324427014

AMD has been doing IF-connected CCDs/chiplets for a while now - since Zen 1, released in 2017. All the x86 OSes work fine on each iteration.

Application authors who care about wringing out the last drop of performance need to be mindful about how they manage processes and cache lines on this hardware - as they would on any other architecture

What do you mean no OS? You log into whatever Linux distribution someone put on it, that's one of the better magic tricks from having a collection of x64 cores on the same chip. Or I suppose you roll a unikernel style system if you want to.