←back to thread

Evaluating the Infinity Cache in AMD Strix Halo

(chipsandcheese.com)
141 points zdw | 2 comments | 22 Oct 25 04:20 UTC | HN request time: 0s | source
Show context
andrewstuart ◴[22 Oct 25 05:17 UTC] No.45665124[source]▶
Despite this APU being deeply interesting to people who want to do local AI, anecdotally I hear that it’s hard to get models to run on it.

Why would AMD not have focused everything it possibly has on demonstrating and documenting and fixing and showing and smoothing the path for AI on their systems?

Why does AMD come across as so generally clueless when it comes to giving developers what they want, compared to Nvidia?

AMD should do whatever it takes to avoid these sort of situations:

https://youtu.be/cF4fx4T3Voc?si=wVmYmWVIya4DQ8Ut

replies(10): >>45665138 #>>45665148 #>>45665186 #>>45665215 #>>45665736 #>>45665755 #>>45665858 #>>45665962 #>>45667229 #>>45671834 #
JonChesterfield ◴[22 Oct 25 07:01 UTC] No.45665736[source]▶
One issue is you need rocm 7 which only just came out.

Another is that people unsportingly write things in cuda.

It'll be a "just works" thing eventually, even if you need software from outside AMD to get it running well.

replies(1): >>45667587 #
rbanffy ◴[22 Oct 25 11:39 UTC] No.45667587[source]▶
> Another is that people unsportingly write things in cuda.

Whether we like it or not, CUDA is the de-facto standard for these things. I wonder how much effort would it take for a company the size of AMD to dedicate a couple million dollars a year to track CUDA as closely as feasible. A couple million dollars is a rounding error for a leading silicon maker.

replies(3): >>45668649 #>>45673112 #>>45673852 #
1. JonChesterfield ◴[22 Oct 25 13:16 UTC] No.45668649[source]▶
Personally I love it but then I'm also working on a cuda to amdgpu compiler. I'm probably the only person doing that with a strix halo on his desk, should be debugging cuda on it shortly.
replies(1): >>45672158 #
2. rbanffy ◴[22 Oct 25 17:12 UTC] No.45672158[source]▶
This is great news. We need more portable code and, with that, more competition.

A single vendor world is boring.