←back to thread

An LLM is a lossy encyclopedia

(simonwillison.net)
509 points tosh | 3 comments | | HN request time: 0s | source

(the referenced HN thread starts at https://news.ycombinator.com/item?id=45060519)
1. crazygringo ◴[] No.45103923[source]
Less than 1% of an LLM is a lossy encyclopedia.

The other 99+% is all of the lossy knowledge that isn't even in encyclopedias in the first place.

Including going much, much, much deeper than e.g. Wikipedia in many areas. So there it's not "lossy" -- it's effectively the opposite, i.e. "super resolution".

And very, very little of what I look up using LLM's is anywhere in Wikipedia to begin with.

replies(1): >>45104154 #
2. zeeqeen ◴[] No.45104154[source]
Outdated or terrible documentation would leads LLM giving a unexpected answer, and that would mislead me!
replies(1): >>45104300 #
3. crazygringo ◴[] No.45104300[source]
You think there aren't outdated or terrible articles on Wikipedia? Or the internet in general?

The internet misleads you. Which is why we develop good BS detectors, and double-check information as needed. There isn't perfect information anywhere. Even official docs are often riddled with errors and inconsistencies.