←back to thread

Apple's MLX adding CUDA support

(github.com)
548 points nsagent | 4 comments | 14 Jul 25 21:40 UTC | HN request time: 0.662s | source
Show context
orliesaurus ◴[15 Jul 25 01:15 UTC] No.44566950[source]▶
Why is this a big deal, can anyone explain if they are familiar with the space?
replies(1): >>44566980 #
elpakal ◴[15 Jul 25 01:20 UTC] No.44566980[source]▶
> NVIDIA hardware is widely used for academic and massive computations. Being able to write/test code locally on a Mac and then deploy to super computers would make a good developer experience.

That one stands out to me as a mac user.

replies(1): >>44567030 #
radicaldreamer ◴[15 Jul 25 01:29 UTC] No.44567030[source]▶
MacBooks used to use Nvidia GPUs, then Apple had a falling out with Nvidia and the beef stands to this day (Apple didn’t use Nvidia hardware when training it’s own LLMs for Apple Intelligence).

I wouldn’t be surprised if within the next few years we see a return of Nvidia hardware to the Mac, probably starting with low volume products like the MacPro, strictly for professional/high-end use cases.

replies(1): >>44567035 #
1. fooker ◴[15 Jul 25 01:30 UTC] No.44567035[source]▶
> Apple didn’t use Nvidia hardware when training it’s own LLMs for Apple Intelligence

Do you have some links for this?

replies(2): >>44567137 #>>44567264 #
2. almostgotcaught ◴[15 Jul 25 01:50 UTC] No.44567137[source]▶
People on hn make up more BS than your local bar

https://www.investors.com/news/technology/apple-stock-apple-...

replies(1): >>44569107 #
3. dialup_sounds ◴[15 Jul 25 02:18 UTC] No.44567264[source]▶
https://arxiv.org/abs/2407.21075

tl;dr - they used Google TPUs

4. tgma ◴[15 Jul 25 08:23 UTC] No.44569107[source]▶
What did the poster make up? There's one line where they speculated about future and a commentary about beef existing to this day which is subjective but the rest of it was 100% factual: Apple relied on Google for training their LLM for various reasons and they did have a beef with NVIDIA re MacBooks a long time ago after which they switched the entire line to AMD Graphics.