←back to thread

Ask HN: How much better can the LLMs become assuming no AGI

3 points yalogin | 2 comments | 28 Aug 25 23:11 UTC | HN request time: 0s | source

OpenAI, Anthropomorphic and every company is putting a lot into training. How is the functionality pipeline filled out for LLMs? What is missing in today’s LLMs that they need to plan for? Just trying to get some insights into the planning process and also what the community sees as the northstar for LLMs without saying AGI
1. jqpabc123 ◴[29 Aug 25 03:37 UTC] No.45059878[source]▶
For the most part, LLMs just remember.

They don't think or learn or create on their own --- at least not anywhere close to a human level. Otherwise, they wouldn't require so much "training"

Essentially, they are best characterized as a huge database with a natural language interface.

Once the internet had been consumed and indexed, this sort of approach starts to hit a wall. There is no more data readily available for "training".

I don't know what the next breakthrough will be but I firmly believe one will be required to push performance to any significantly higher level.

replies(1): >>45061396 #
2. pillefitz ◴[29 Aug 25 07:56 UTC] No.45061396[source]▶
In terms of bits seen during training, LLM are more akin to a 3 year old. Robots roaming around and learning to interact with the in environment and sharing knowledge might be a game changer, assuming that the current methodologies are sufficient (LLM + RL)