←back to thread

GPT-5.2

(openai.com)
1019 points atgctg | 2 comments | 11 Dec 25 18:04 UTC | HN request time: 0s | source
Show context
josalhor ◴[11 Dec 25 18:24 UTC] No.46235005[source]▶
From GPT 5.1 Thinking:

ARC AGI v2: 17.6% -> 52.9%

SWE Verified: 76.3% -> 80%

That's pretty good!

replies(7): >>46235062 #>>46235070 #>>46235153 #>>46235160 #>>46235180 #>>46235421 #>>46236242 #
minimaxir ◴[11 Dec 25 18:35 UTC] No.46235160[source]▶
Note that GPT 5.2 newly supports a "xhigh" reasoning level, which could explain the better benchmarks.

It'll be noteworthy to see the cost-per-task on ARC AGI v2.

replies(2): >>46235539 #>>46236189 #
1. granzymes ◴[11 Dec 25 18:59 UTC] No.46235539[source]▶
> It'll be noteworthy to see the cost-per-task on ARC AGI v2.

Already live. gpt-5.2-pro scores a new high of 54.2% with a cost/task of $15.72. The previous best was Gemini 3 Pro (54% with a cost/task of $30.57).

The best bang-for-your-buck is the new xhigh on gpt-5.2, which is 52.9% for $1.90, a big improvement on the previous best in this category which was Opus 4.5 (37.6% for $2.40).

https://arcprize.org/leaderboard

replies(1): >>46235641 #
2. minimaxir ◴[11 Dec 25 19:04 UTC] No.46235641[source]▶
Huh, that is indeed up and to left of Opus.