←back to thread

Apple's MLX adding CUDA support

(github.com)
548 points nsagent | 1 comments | 14 Jul 25 21:40 UTC | HN request time: 0.291s | source
Show context
lukev ◴[15 Jul 25 02:18 UTC] No.44567263[source]▶
So to make sure I understand, this would mean:

1. Programs built against MLX -> Can take advantage of CUDA-enabled chips

but not:

2. CUDA programs -> Can now run on Apple Silicon.

Because the #2 would be a copyright violation (specifically with respect to NVidia's famous moat).

Is this correct?

replies(9): >>44567309 #>>44567350 #>>44567355 #>>44567600 #>>44567699 #>>44568060 #>>44568194 #>>44570427 #>>44577999 #
saagarjha ◴[15 Jul 25 02:28 UTC] No.44567309[source]▶
No, it's because doing 2 would be substantially harder.
replies(2): >>44567356 #>>44567414 #
lukev ◴[15 Jul 25 02:39 UTC] No.44567356[source]▶
There's a massive financial incentive (billions) to allow existing CUDA code to run on non-NVidia hardware. Not saying it's easy, but is implementation difficulty really the blocker?
replies(5): >>44567393 #>>44567539 #>>44568123 #>>44573767 #>>44574809 #
1. ivell ◴[15 Jul 25 19:16 UTC] No.44574809[source]▶
Modular is trying with Mojo + Max offering. It has taken quite a bit of effort to target NVidia and get parity. They are now focusing on other hardware.