←back to thread

Apple's MLX adding CUDA support

(github.com)
548 points nsagent | 3 comments | 14 Jul 25 21:40 UTC | HN request time: 0.001s | source
Show context
lukev ◴[15 Jul 25 02:18 UTC] No.44567263[source]▶
So to make sure I understand, this would mean:

1. Programs built against MLX -> Can take advantage of CUDA-enabled chips

but not:

2. CUDA programs -> Can now run on Apple Silicon.

Because the #2 would be a copyright violation (specifically with respect to NVidia's famous moat).

Is this correct?

replies(9): >>44567309 #>>44567350 #>>44567355 #>>44567600 #>>44567699 #>>44568060 #>>44568194 #>>44570427 #>>44577999 #
quitit ◴[15 Jul 25 02:39 UTC] No.44567355[source]▶
It's 1.

It means that a developer can use their relatively low-powered Apple device (with UMA) to develop for deployment on nvidia's relatively high-powered systems.

That's nice to have for a range of reasons.

replies(5): >>44568550 #>>44568740 #>>44569683 #>>44570543 #>>44571119 #
chvid ◴[15 Jul 25 07:15 UTC] No.44568740[source]▶
If Apple cannot do their own implementation of CUDA due to copyright second best is this; getting developers to build for LMX (which is on their laptops) and still get NVIDIA hardware support.

Apple should do a similar thing for AMD.

replies(2): >>44569645 #>>44570359 #
xd1936 ◴[15 Jul 25 12:17 UTC] No.44570359[source]▶
I thought that the US Supreme Court decision in Google v. Oracle and the Java reimplementation provided enough case precedent to allow companies to re-implement something like CUDA APIs?

https://www.theverge.com/2021/4/5/22367851/google-oracle-sup...

https://en.wikipedia.org/wiki/Google_LLC_v._Oracle_America,_....

replies(1): >>44574685 #
1. timhigins ◴[15 Jul 25 19:03 UTC] No.44574685{3}[source]▶
Exactly and see also ROCM/HIP which is AMD’s reimplementation of CUDA for their gpus.
replies(2): >>44579461 #>>44593560 #
2. pjmlp ◴[16 Jul 25 06:55 UTC] No.44579461[source]▶
Reimplementation of CUDA C++, not CUDA.

CUDA is a set of four compilers, namely C, C++, Fortran and Python JIT DSLs, a bytecode and two compiler backend libraries, a set of compute libraries collection for the languages listed above, plugins for Eclipse and Visual Studio, a GPU graphical debugger and profiler.

3. qalmakka ◴[17 Jul 25 14:02 UTC] No.44593560[source]▶
There's ZLUDA for AMD that actually implements CUDA, but it's still quite immature yet