←back to thread

Apple's MLX adding CUDA support

(github.com)
548 points nsagent | 1 comments | 14 Jul 25 21:40 UTC | HN request time: 0.206s | source
Show context
orliesaurus ◴[15 Jul 25 01:15 UTC] No.44566950[source]▶
Why is this a big deal, can anyone explain if they are familiar with the space?
replies(1): >>44566980 #
elpakal ◴[15 Jul 25 01:20 UTC] No.44566980[source]▶
> NVIDIA hardware is widely used for academic and massive computations. Being able to write/test code locally on a Mac and then deploy to super computers would make a good developer experience.

That one stands out to me as a mac user.

replies(1): >>44567030 #
radicaldreamer ◴[15 Jul 25 01:29 UTC] No.44567030[source]▶
MacBooks used to use Nvidia GPUs, then Apple had a falling out with Nvidia and the beef stands to this day (Apple didn’t use Nvidia hardware when training it’s own LLMs for Apple Intelligence).

I wouldn’t be surprised if within the next few years we see a return of Nvidia hardware to the Mac, probably starting with low volume products like the MacPro, strictly for professional/high-end use cases.

replies(1): >>44567035 #
fooker ◴[15 Jul 25 01:30 UTC] No.44567035[source]▶
> Apple didn’t use Nvidia hardware when training it’s own LLMs for Apple Intelligence

Do you have some links for this?

replies(2): >>44567137 #>>44567264 #
1. dialup_sounds ◴[15 Jul 25 02:18 UTC] No.44567264[source]▶
https://arxiv.org/abs/2407.21075

tl;dr - they used Google TPUs