←back to thread

Arc-AGI-2 and ARC Prize 2025

(arcprize.org)
188 points gkamradt | 1 comments | 24 Mar 25 20:35 UTC | HN request time: 0s | source
Show context
FergusArgyll ◴[24 Mar 25 23:15 UTC] No.43466415[source]▶
I'd love to hear from the ARC guys:

These benchmarks, and specifically the constraints placed on solving them (compute etc) seem to me to incentivize the opposite of "general intelligence"

Have any of the technical contributions used to win the past competition been used to advance general AI in any way?

We have transformer based systems constantly gaining capabilities. On the other hand have any of the Kaggle submissions actually advanced the field in any way outside of the ARC Challenge?

To me (a complete outsider, admittedly) the ARC prize seems like an operationalization of the bitter lesson

replies(2): >>43466619 #>>43469318 #
1. gkamradt ◴[24 Mar 25 23:46 UTC] No.43466619[source]▶
Good question! This was one of the main motivations of our "Paper Prize" track. We wanted to reward conceptual progress vs leaderboard chasing. In fact, when we increased the prizes mid year we awarded more money towards the paper track vs top score.

We had 40 papers submitted last year and 8 were awarded prizes. [1]

On of the main teams, MindsAI, just published their paper on their novel test time fine tuning approach. [2]

Jan/Daniel (1st place winners last year) talk all about their progress and journey building out here [3]. Stories like theirs help push the field forward.

[1] https://arcprize.org/blog/arc-prize-2024-winners-technical-r...

[2] https://github.com/MohamedOsman1998/deep-learning-for-arc/bl...

[3] https://www.youtube.com/watch?v=mTX_sAq--zY