←back to thread

ComputeBench: Instruction-following benchmarks for long, step-by-step arithmetic

(notdian.github.io)
1 points notdian | 1 comments | 20 Dec 25 19:52 UTC | HN request time: 0.27s | source
1. notdian ◴[20 Dec 25 19:52 UTC] No.46338994[source]▶
Vibecoded this after seeing models do amazing things but still drift on simple recursive steps; tracks exact match, answer accuracy, prefix correctness. Feedback welcome.