←back to thread

AI engineers claim new algorithm reduces AI power consumption by 95%

(www.tomshardware.com)
352 points ferriswil | 1 comments | 19 Oct 24 18:03 UTC | HN request time: 0.208s | source
Show context
remexre ◴[19 Oct 24 18:48 UTC] No.41889747[source]▶
Isn't this just taking advantage of "log(x) + log(y) = log(xy)"? The IEEE754 floating-point representation stores floats as sign, mantissa, and exponent -- ignore the first two (you quantitized anyway, right?), and the exponent is just an integer storing log() of the float.
replies(2): >>41889800 #>>41890236 #
convolvatron ◴[19 Oct 24 18:55 UTC] No.41889800[source]▶
yes. and the next question is 'ok, how do we add'
replies(2): >>41889877 #>>41889991 #
1. kps ◴[19 Oct 24 19:19 UTC] No.41889991[source]▶
Yes. I haven't yet read this paper to see what exactly it says is new, but I've definitely seen log-based representations under development before now. (More log-based than the regular floating-point exponent, that is. I don't actually know the argument behind the exponent-and-mantissa form that's been pretty much universal even before IEEE754, other than that it mimics decimal scientific notation.)