←back to thread

176 points marv1nnnnn | 1 comments | | HN request time: 0.206s | source
Show context
iandanforth ◴[] No.43995844[source]
I applaud this effort, however the "Does it work?" section answers the wrong question. Anyone can write a trivial doc compressor and show a graph saying "The compressed version is smaller!"

For this to "work" you need to have a metric that shows that AIs perform as well, or nearly as well, as with the uncompressed documentation on a wide range of tasks.

replies(5): >>43996061 #>>43996217 #>>43996319 #>>43996840 #>>44003395 #
1. klntsky ◴[] No.44003395[source]
Shameless plug: I'm working on a public contest website for prompts compressing other prompts.

It will include evaluations and a public scoreboard.

It's not usable rn, but feel free to follow: https://github.com/klntsky/prompt-compression-contest/