←back to thread

An LLM is a lossy encyclopedia

(simonwillison.net)
509 points tosh | 1 comments | | HN request time: 0.299s | source

(the referenced HN thread starts at https://news.ycombinator.com/item?id=45060519)
1. pornel ◴[] No.45100852[source]
Chain of thought seems to be an extraction algorithm for information buried deeper.

The models hold more information than they can immediately extract, but CoT can find a key to look it up or synthesise by applying some learned generalisations.