←back to thread

An LLM is a lossy encyclopedia

(simonwillison.net)
509 points tosh | 1 comments | | HN request time: 0.202s | source

(the referenced HN thread starts at https://news.ycombinator.com/item?id=45060519)
1. lvl155 ◴[] No.45101324[source]
It is but when you take that stochastic token prediction machine and combine it with post, you can extract a graph that resembles intelligence that is then stored in a very disorganized fashion. This works because it is how we process and express /communicate information.

I think we will start seeing stateful AI models within the next couple of years and that will be a major milestone that could shake up the space. LLM is merely a stepping stone.