Evaluating the Infinity Cache in AMD Strix Halo

I don't quite get it. What's so special about having 32MB of cache? Why is it called "infinity"?

This article from the same site goes into the Infinity Cache design in a bit more detail: https://chipsandcheese.com/p/amds-cdna-3-compute-architectur...

The summary is that it's a cache attached to the memory controllers, rather than the CPUs, so it doesn't have to worry about cache coherency so much. This could be useful for shared memory parallelism.

What makes Intel's SMT implementation "hyper"? What makes Mario "Super"? It's just marketing.

Thank you!

AMD named their memory fabric "infinity fabric" for marketing reasons. So when they developed their memory attached cache solution (which lives in the memory fabric, unlike a traditional cache), the obvious marketing name is "infinity cache"

The main advantage of a memory attached cache is that it's cheaper than a regular cache, and can even be put on a seperate die, allowing you to have much more of it.

AMDs previous memory fabric from the early 2000s was called "Hyper Transport", which has a confusing overlap with Intel's Hyper Threading, but I think AMD actually bet intel to the name by a few years.

> What makes Mario "Super"?

The Super Mushroom power-up.

Hyperthreading is technically a level above superscalar?

How's latency vs a traditional?

SCNR: What makes the Mushroom power-up "Super"?

It has a higher latency than AMD's L2 caches, but similar compared to Nvidia's L2. [0]

I think AMD might be ditching it for the next gen in exchange for growing the L2's, because the lower latency is beneficial to ray tracing.

[0]: https://substackcdn.com/image/fetch/$s_!LHJo!,f_auto,q_auto:...

It's got what mario craves

Apparently, Mario actually was the super for the building that they were in. He was not super, he was the super (supervisor) fixing stuff

Since it is attached to the memory controller, one could argue that it is truly the final level of the cache hierarchy and the term infinity is not only a marketing term.

Electrolytes?

But then you could add another level of slower (but still faster than RAM) and larger cache. So it is after all the CPU caches, but the first of all the memory caches. A more mathematically correct name would be L_omega.

IBM Power8 and Power9 used Centaur chips which had similar "last level cache" onboard.

Because it is last level before the actual ram chips, no coherency involved.

Sounds a bit like a tightly coupled memory (TCM) in an embedded CPU; Fast single cycle RAM shared across the system.

This is quite exactly the opposite of TCM in fact

> Apparently, Mario actually was the super for the building that they were in. He was not super, he was the super (supervisor) fixing stuff

+1 insightful.

Infinity Fabric is, in fact, the current superset of HyperTransport. HyperTransport is an IO architecture for chip to chip communication and has been used by pretty much everyone. It's also an open spec and has a consortium managing it.

https://en.wikipedia.org/wiki/HyperTransport

Confusing, yes, but at least they didn't call it "HyperLink".

Also, Ross Technology beat them both to "hyper" names with the hyperSPARC CPU.