←back to thread

GPT-5.2

(openai.com)
1019 points atgctg | 1 comments | 11 Dec 25 18:04 UTC | HN request time: 0s | source
Show context
minadotcom ◴[11 Dec 25 18:29 UTC] No.46235074[source]▶
They used to compare to competing models from Anthropic, Google DeepMind, DeepSeek, etc. Seems that now they only compare to their own models. Does this mean that the GPT-series is performing worse than its competitors (given the "code red" at OpenAI)?
replies(4): >>46235094 #>>46235110 #>>46235145 #>>46236816 #
Tiberium ◴[11 Dec 25 18:35 UTC] No.46235145[source]▶
They did compare it to other models: https://x.com/OpenAI/status/1999182104362668275

https://i.imgur.com/e0iB8KC.png

replies(3): >>46235919 #>>46238146 #>>46241683 #
enlyth ◴[11 Dec 25 19:22 UTC] No.46235919[source]▶
This looks cherry-picked, for example Claude Opus had a higher score on SWE-Bench Verified so they conveniently left it out, also GDPval is literally a benchmark made by OpenAI
replies(2): >>46237361 #>>46239897 #
1. tobias2014 ◴[12 Dec 25 01:41 UTC] No.46239897[source]▶
And who believes that the difference between 91.9% and 92.4% is significant in these benchmarks? Clearly these have margins of error that are swept under the rug.