←back to thread

OpenAI, Google and Anthropic are struggling to build more advanced AI

(www.bloomberg.com)
625 points lukebennett | 3 comments | 13 Nov 24 13:28 UTC | HN request time: 0s | source
Show context
jmward01 ◴[14 Nov 24 20:04 UTC] No.42140562[source]▶
Every negative headline I see about AI hitting a wall or being over-hyped makes me think of the early 2000's with that new thing the 'internet' (yes, I know the internet is a lot older than that). There is little doubt in my mind that ten years from now nearly every aspect of life will be deeply connected to AI just like the internet took over everything in the late 90's and early 2000's and is now deeply connected to everything now. I'd even hazard to say that AI could be more impactful.
replies(8): >>42140699 #>>42140872 #>>42141362 #>>42141703 #>>42143108 #>>42143930 #>>42145614 #>>42146038 #
brookst ◴[14 Nov 24 20:15 UTC] No.42140699[source]▶
And, as I've noted a couple of times in this thread, how many times have we heard that Moore's law is dead and compute has hit a wall?
replies(2): >>42141879 #>>42146122 #
1. moffkalast ◴[14 Nov 24 22:27 UTC] No.42141879[source]▶
Well according to Nvidia you can just ignore Moore's law and start requiring people to install multi kilowatt outlets just for their cards. Who needs efficiency amirite?
replies(1): >>42142664 #
2. jmward01 ◴[15 Nov 24 00:04 UTC] No.42142664[source]▶
I'm not an apple fan (as I type on a mac that I am forced to use) but I gotta applaud their push for power efficiency. NVIDIA actually -does- have a few cards they make that really improve power efficiency but then they generally hamstring them with a lack of memory. NVIDIA is really good at making their high-end cards the only viable choice but I think that will backfire on them as people like me, that value quiet, cool and efficient over 25% faster inference start taking any viable alternative that comes out.
replies(1): >>42143898 #
3. llm_trw ◴[15 Nov 24 04:11 UTC] No.42143898[source]▶
Memory is king.

Anything that has more memory and adequate compute will win the coming AI wars.

At the rate at which power consumption is growing now that the shortage of current gen cards has started to work itself out people are realizing they need a fleet of nuclear reactors to keep the data centers running. This is not something that's getting fix with the coming generation, if anything it's worse.