←back to thread

AI engineers claim new algorithm reduces AI power consumption by 95%

(www.tomshardware.com)
352 points ferriswil | 5 comments | 19 Oct 24 18:03 UTC | HN request time: 0.001s | source
Show context
kayo_20211030 ◴[19 Oct 24 19:34 UTC] No.41890110[source]▶
Extraordinary claims require extraordinary evidence. Maybe it's possible, but consider that some really smart people, in many different groups, have been working diligently in this space for quite a while; so claims of 95% savings on energy costs _with equivalent performance_ is in the extraordinary category. Of course, we'll see when the tide goes out.
replies(6): >>41890280 #>>41890322 #>>41890352 #>>41890379 #>>41890428 #>>41890702 #
stefan_ ◴[19 Oct 24 20:53 UTC] No.41890702[source]▶
I mean, all these smart people would rather pay NVIDIA all their money than make AMD viable. And yet they tell us its all MatMul.
replies(2): >>41890897 #>>41893117 #
1. kayo_20211030 ◴[19 Oct 24 21:25 UTC] No.41890897[source]▶
Both companies are doing pretty well. Why don't you think AMD is viable?
replies(2): >>41891173 #>>41894341 #
2. nelup20 ◴[19 Oct 24 22:10 UTC] No.41891173[source]▶
AMD's ROCm just isn't there yet compared to Nvidia's CUDA. I tried it on Linux with my AMD GPU and couldn't get things working. AFAIK on Windows it's even worse.
replies(1): >>41894656 #
3. redleader55 ◴[20 Oct 24 10:13 UTC] No.41894341[source]▶
The litimus test would be if you read in the news that Amazon, Microsoft, Google or Meta just bought billions in GPUs from AMD.

They are and have been buying AMD CPUs for a while now, which says something about AMD and Intel.

replies(1): >>41894463 #
4. JonChesterfield ◴[20 Oct 24 10:42 UTC] No.41894463[source]▶
Microsoft and Meta are running customer facing LLM workloads on AMD's graphics cards. Oracle seems to like them too. Google is doing the TPU thing with Broadcom and Amazon seems to have decided to bet on Intel (in a presumably fatal move but time will tell). We'll find some more information on the order book in a couple of weeks at earnings.

I like that the narrative has changed from "AI only runs on Cuda" to "sure it runs fine on AMD if you must"

5. mattalex ◴[20 Oct 24 11:31 UTC] No.41894656[source]▶
That entirely depends on what AMD device you look at: gaming GPUs are not well supported, but their instinct line of accelerators works just as well as cuda. keep in mind that, in contrast to Nvidia, AMD uses different architectures for compute and gaming (though they are changing that in the next generation)