←back to thread

An LLM is a lossy encyclopedia

(simonwillison.net)
509 points tosh | 1 comments | | HN request time: 0.199s | source

(the referenced HN thread starts at https://news.ycombinator.com/item?id=45060519)
1. 112233 ◴[] No.45101897[source]
That AI is closely related to compression is a well established idea. E.g. http://prize.hutter1.net/

It seems reasonable to argue that LLMs are a form of lossy compression of text that preserves important text features.

There is a precedent of distributing low quality lossy compressed versions of copyrighted work being considered illegal.