←back to thread

760 points MindBreaker2605 | 1 comments | | HN request time: 0s | source
Show context
numpy-thagoras ◴[] No.45897574[source]
Good. The world model is absolutely the right play in my opinion.

AI Agents like LLMs make great use of pre-computed information. Providing a comprehensive but efficient world model (one where more detail is available wherever one is paying more attention given a specific task) will definitely eke out new autonomous agents.

Swarms of these, acting in concert or with some hive mind, could be how we get to AGI.

I wish I could help, world models are something I am very passionate about.

replies(2): >>45897629 #>>45901238 #
sebmellen ◴[] No.45897629[source]
Can you explain this “world model” concept to me? How do you actually interface with a model like this?
replies(6): >>45898106 #>>45898143 #>>45899047 #>>45901655 #>>45902131 #>>45902333 #
natch ◴[] No.45898143[source]
He is one of these people who think that humans have a direct experience of reality not mediated by as Alan Kay put it three pounds of oatmeal. So he thinks a language model can not be a world model. Despite our own contact with reality being mediated through a myriad of filters and fun house mirror distortions. Our vision transposes left and right and delivers images to our nerves upside down, for gawd’s sake. He imagines none of that is the case and that if only he can build computers more like us then they will be in direct contact with the world and then he can (he thinks) make a model that is better at understanding the world
replies(7): >>45898364 #>>45898490 #>>45898733 #>>45898924 #>>45899674 #>>45899676 #>>45904464 #
1. HarHarVeryFunny ◴[] No.45899676[source]
The world model of a language model is a ... language model. Imagine the mind of a blind limbless person, locked in a cell their whole life, never having experienced anything different, who just listens all day to a piped in feed of randomized snippets of WikiPedia, 4chan and math olypiad problems.

The mental model this person has of this feed of words is what an LLM at best has (but human model likely much richer since they have a brain, not just a transformer). No real-world experience or grounding, therefore no real-world model. The only model they have is of the world they have experience with - a world of words.