←back to thread

An LLM is a lossy encyclopedia

(simonwillison.net)
509 points tosh | 1 comments | | HN request time: 0.292s | source

(the referenced HN thread starts at https://news.ycombinator.com/item?id=45060519)
1. cranium ◴[] No.45101210[source]
I like this lossy compression / decompression analogy for coding too: when you prompt for a feature, you are basically asking to decompress the meaning of your ask into your existing code. Any semantic gap in your prompt will be filled with plausible glue, ie. the LLM makes decisions for you. A good prompt minimizes the glue needed and reduces the potential for really crappy outcome, but it's always a possibility!