←back to thread

AI engineers claim new algorithm reduces AI power consumption by 95%

(www.tomshardware.com)
352 points ferriswil | 2 comments | 19 Oct 24 18:03 UTC | HN request time: 0s | source
Show context
kayo_20211030 ◴[19 Oct 24 19:34 UTC] No.41890110[source]▶
Extraordinary claims require extraordinary evidence. Maybe it's possible, but consider that some really smart people, in many different groups, have been working diligently in this space for quite a while; so claims of 95% savings on energy costs _with equivalent performance_ is in the extraordinary category. Of course, we'll see when the tide goes out.
replies(6): >>41890280 #>>41890322 #>>41890352 #>>41890379 #>>41890428 #>>41890702 #
stefan_ ◴[19 Oct 24 20:53 UTC] No.41890702[source]▶
I mean, all these smart people would rather pay NVIDIA all their money than make AMD viable. And yet they tell us its all MatMul.
replies(2): >>41890897 #>>41893117 #
kayo_20211030 ◴[19 Oct 24 21:25 UTC] No.41890897[source]▶
Both companies are doing pretty well. Why don't you think AMD is viable?
replies(2): >>41891173 #>>41894341 #
1. nelup20 ◴[19 Oct 24 22:10 UTC] No.41891173[source]▶
AMD's ROCm just isn't there yet compared to Nvidia's CUDA. I tried it on Linux with my AMD GPU and couldn't get things working. AFAIK on Windows it's even worse.
replies(1): >>41894656 #
2. mattalex ◴[20 Oct 24 11:31 UTC] No.41894656[source]▶
That entirely depends on what AMD device you look at: gaming GPUs are not well supported, but their instinct line of accelerators works just as well as cuda. keep in mind that, in contrast to Nvidia, AMD uses different architectures for compute and gaming (though they are changing that in the next generation)