(openai.com)

1019 points atgctg | 1 comments | 11 Dec 25 18:04 UTC | HN request time: 0s | source

Show context

zone411 ◴[11 Dec 25 19:46 UTC] No.46236209[source]▶

I've benchmarked it on the Extended NYT Connections benchmark (https://github.com/lechmazur/nyt-connections/):

The high-reasoning version of GPT-5.2 improves on GPT-5.1: 69.9 → 77.9.

The medium-reasoning version also improves: 62.7 → 72.1.

The no-reasoning version also improves: 22.1 → 27.5.

Gemini 3 Pro and Grok 4.1 Fast Reasoning still score higher.

1. Bombthecat ◴[12 Dec 25 07:20 UTC] No.46241682[source]▶

I would like to see a cost per percent or so row. I feel like grok would beat them all