I just can't take anything the author has to say seriously after the intro.
I just can't take anything the author has to say seriously after the intro.
The links are laughable. For environment we get one lady whose underground water well got dirtier (according to her) because Meta built a data center nearby. Which, even if true (which is doubtful), has negligible impact on environment, and maybe a huge annoyance for her personally.
And 2 gives bad estimates such as ChatGPT 4 generation of ~100 tokens for an email (say 1000tok/s from 8xH100, so 0.1s so 0.1Wh) using as much energy as 14 LEDs for an hour (say 3W each, so 45Wh, so almost 3 orders of magnitude off, 9 if you like me count in binary).
P.S. Voted dems and would never vote Trump, but the gp is IMHO spot on.
But hey, I already know you'd say you personally would never use it for these purposes.
Moreover, of the two of us you appear to have "shareholder" mentality. How profitable are volunteers serving food to homeless people? I guess they have no value then.
And how profitable are OpenAI and other providers?
They’re running at a loss. The startups using LLMs as their product are only viable as long as they get free credits from OpenAI. The only people making a profit are NVidia.