←back to thread

Apple's MLX adding CUDA support

(github.com)
548 points nsagent | 1 comments | 14 Jul 25 21:40 UTC | HN request time: 0.212s | source
Show context
lukev ◴[15 Jul 25 02:18 UTC] No.44567263[source]▶
So to make sure I understand, this would mean:

1. Programs built against MLX -> Can take advantage of CUDA-enabled chips

but not:

2. CUDA programs -> Can now run on Apple Silicon.

Because the #2 would be a copyright violation (specifically with respect to NVidia's famous moat).

Is this correct?

replies(9): >>44567309 #>>44567350 #>>44567355 #>>44567600 #>>44567699 #>>44568060 #>>44568194 #>>44570427 #>>44577999 #
saagarjha ◴[15 Jul 25 02:28 UTC] No.44567309[source]▶
No, it's because doing 2 would be substantially harder.
replies(2): >>44567356 #>>44567414 #
hangonhn ◴[15 Jul 25 02:48 UTC] No.44567414[source]▶
Is CUDA tied very closely to the Nvidia hardware and architecture so that all the abstraction would not make sense on other platforms? I know very little about hardware and low level software.

Thanks

replies(4): >>44567469 #>>44567535 #>>44568191 #>>44568597 #
1. dagmx ◴[15 Jul 25 03:12 UTC] No.44567535[source]▶
CUDA isn’t really that hyper specific to NVIDIA hardware as an api.

But a lot of the most useful libraries are closed source and available on NVIDIA hardware only.

You could probably get most open source CUDA to run on other vendors hardware without crazy work. But you’d spend a ton more work getting to parity on ecosystem and lawyer fees when NVIDIA come at you.