←back to thread

Apple's MLX adding CUDA support

(github.com)
548 points nsagent | 1 comments | 14 Jul 25 21:40 UTC | HN request time: 0.208s | source
Show context
lukev ◴[15 Jul 25 02:18 UTC] No.44567263[source]▶
So to make sure I understand, this would mean:

1. Programs built against MLX -> Can take advantage of CUDA-enabled chips

but not:

2. CUDA programs -> Can now run on Apple Silicon.

Because the #2 would be a copyright violation (specifically with respect to NVidia's famous moat).

Is this correct?

replies(9): >>44567309 #>>44567350 #>>44567355 #>>44567600 #>>44567699 #>>44568060 #>>44568194 #>>44570427 #>>44577999 #
quitit ◴[15 Jul 25 02:39 UTC] No.44567355[source]▶
It's 1.

It means that a developer can use their relatively low-powered Apple device (with UMA) to develop for deployment on nvidia's relatively high-powered systems.

That's nice to have for a range of reasons.

replies(5): >>44568550 #>>44568740 #>>44569683 #>>44570543 #>>44571119 #
_zoltan_ ◴[15 Jul 25 06:47 UTC] No.44568550[source]▶
"relatively high powered"? there's nothing faster out there.
replies(4): >>44568714 #>>44568716 #>>44568748 #>>44569262 #
sgt101 ◴[15 Jul 25 07:16 UTC] No.44568748[source]▶
I wonder what Apple would have to do to make metal + its processors run faster than nVidia? I guess that it's all about the interconnects really.
replies(1): >>44569316 #
summarity ◴[15 Jul 25 09:06 UTC] No.44569316[source]▶
Right now, for LLMs, the only limiting factor on Apple Silicon is memory bandwidth. There hasn’t been progress on this since the original M1 Ultra. And since abandoning UltraFusion, we won’t see progress here anytime soon either.
replies(3): >>44569480 #>>44569623 #>>44569854 #
1. librasteve ◴[15 Jul 25 10:57 UTC] No.44569854[source]▶
this is like saying the only limiting factor on computers is the von neumann bottleneck