←back to thread

176 points marv1nnnnn | 1 comments | | HN request time: 0.207s | source
Show context
iandanforth ◴[] No.43995844[source]
I applaud this effort, however the "Does it work?" section answers the wrong question. Anyone can write a trivial doc compressor and show a graph saying "The compressed version is smaller!"

For this to "work" you need to have a metric that shows that AIs perform as well, or nearly as well, as with the uncompressed documentation on a wide range of tasks.

replies(5): >>43996061 #>>43996217 #>>43996319 #>>43996840 #>>44003395 #
1. rco8786 ◴[] No.43996840[source]
Yea I was disappointed to see that they just punted (or opted not to show?) on benchmarks.