/top/
/new/
/best/
/ask/
/show/
/job/
^
slacker news
login
about
←back to thread
Getting 50% (SoTA) on Arc-AGI with GPT-4o
(redwoodresearch.substack.com)
394 points
tomduncalf
| 3 comments |
17 Jun 24 21:51 UTC
|
HN request time: 0.621s
|
source
1.
bjornsing
◴[
18 Jun 24 02:58 UTC
]
No.
40713656
[source]
▶
>>40711484 (OP)
#
Can we be sure GPT-4o hasn’t been trained on the public test set?
replies(1):
>>40713748
#
ID:
GO
2.
ivalm
◴[
18 Jun 24 03:13 UTC
]
No.
40713748
[source]
▶
>>40713656 (TP)
#
It has been trained on public test set as it’s on github
replies(1):
>>40714301
#
3.
free_bip
◴[
18 Jun 24 05:22 UTC
]
No.
40714301
[source]
▶
>>40713748
#
This isn't necessarily true, OpenAI isn't open about how their data cleaning process works.
↑