←back to thread

A beginner's guide to deploying LLMs with AMD on Windows using PyTorch

(gpuopen.com)
103 points beckford | 5 comments | 06 Oct 25 13:15 UTC | HN request time: 0s | source
Show context
behnamoh ◴[10 Oct 25 04:35 UTC] No.45535401[source]▶
I have a philosophy for which I have mixed feelings because I like it in principle despite it making me worse off in some other ways:

    Devs should punish companies that clearly don't give a shit about them.
When I see AMD, I think of a firm that heavily prioritized their B2B business over B2C. Not just gamers, but a lot of LLM enthusiasts have been calling AMD to offer something comparable to 4090/5090, and don't mess up drivers and software compatibility.

AMD's response? Nothing. They do build AI chips but they're for the megacorps. At one point I wanted to save for a MI300x. But AMD only sells them in batches of x8! (not factorial lol).

I've had it with AMD, and would rather penalize them (even if it costs them pennies) out of principle.

I had similar thoughts about Apple MLX a while back and wrote a mean post about it on reddit: https://www.reddit.com/r/LocalLLaMA/comments/19cdd9z/dont_ta...

But since then the cracked MLX team has kept delivering so much that I've now completely changed my mind about it. That, coupled with Apple's failed AI attempts and the recent addition of MatMul in A-chips (and ofc in M5), gives me hope about MLX's future and now I develop for it!

replies(10): >>45535449 #>>45535591 #>>45536114 #>>45536194 #>>45536255 #>>45536566 #>>45536625 #>>45536930 #>>45537670 #>>45542123 #
pjmlp ◴[10 Oct 25 09:37 UTC] No.45536930[source]▶
They love gamers, just not on GNu/Linux.

Playstation, XBox, Windows, gaming handhelds.

replies(2): >>45537147 #>>45539122 #
_aavaa_ ◴[10 Oct 25 10:13 UTC] No.45537147[source]▶
The steam deck is famously Linux and uses AMD
replies(1): >>45537232 #
1. pjmlp ◴[10 Oct 25 10:26 UTC] No.45537232[source]▶
GNU/Linux like proper laptops and desktops, not gaming handhelds.

100% of the gamers that don't overlap with FOSS folks, don't care SteamOS is somehow based on the Linux kernel, the Steam Runtime and a Win32/DirectX translation layer, otherwise there would not be games to play.

replies(2): >>45537386 #>>45541393 #
2. tuna74 ◴[10 Oct 25 10:54 UTC] No.45537386[source]▶
Calling a Linux distro Gnu/Linux today is wrong because the actual Gnu code running is such a small part of everything.

SteamOS uses Linux as much as Linux distros like Fedora and Arch and other Linux based systems like Android.

A lot of gamers are also FOSS folks although not as hardcore as RMS.

replies(1): >>45537486 #
3. pjmlp ◴[10 Oct 25 11:07 UTC] No.45537486[source]▶
Not at all, it makes a point, ChromeOS, WebOS, Android, are also based on the Linux kernel and hardly considered Linux distributions for everyday use, in a way similar to GNU/Linux expectations.

How little do game studios care to port their titles from Android/NDK into SteamOS, even though both are "Linux".

replies(1): >>45541912 #
4. _aavaa_ ◴[10 Oct 25 17:20 UTC] No.45541393[source]▶
What, prey tell, is a “proper” laptop and desktop?

Plug a usb dock into the steam deck and you have a “proper” computer.

5. tuna74 ◴[10 Oct 25 18:03 UTC] No.45541912{3}[source]▶
Android and iOS games are usually not interesting for SteamOS gamers.

What really makes ChromeOS different from Ubuntu except it is not developed in the open?