←back to thread

An LLM is a lossy encyclopedia

(simonwillison.net)
509 points tosh | 1 comments | 29 Aug 25 09:40 UTC | HN request time: 0.204s | source

(the referenced HN thread starts at https://news.ycombinator.com/item?id=45060519)
1. doe88 ◴[02 Sep 25 13:23 UTC] No.45102811[source]▶
Using his analogy I would see it more like this : for the same overall quantity of bytes it is more broader but also lossy as being compressed. You have ten wikipedia without the precision of one.