←back to thread

Arc-AGI-2 and ARC Prize 2025

(arcprize.org)
188 points gkamradt | 1 comments | 24 Mar 25 20:35 UTC | HN request time: 0s | source
Show context
artificialprint ◴[24 Mar 25 22:00 UTC] No.43465860[source]▶
Oh boy! Some of these tasks are not hard, but require full attention and a lot of counting just to get things right! ARC3 will go 3D perhaps? JK

Congrats on launch, lets see how long it'll take to get saturated

replies(2): >>43465929 #>>43466945 #
fchollet ◴[24 Mar 25 22:09 UTC] No.43465929[source]▶
ARC 3 is still spatially 2D, but it adds a time dimension, and it's interactive.
replies(3): >>43466406 #>>43466916 #>>43466966 #
artninja1988 ◴[24 Mar 25 23:14 UTC] No.43466406[source]▶
I think a lot of people got discouraged, seeing how openai solved arc agi 1 by what seems like brute forcing and throwing money at it. Do you believe arc was solved in the "spirit" of the challenge? Also all the open sourced solutions seem super specific to solving arc. Is this really leading us to human level AI at open ended tasks?
replies(2): >>43466887 #>>43467745 #
fchollet ◴[25 Mar 25 00:28 UTC] No.43466887[source]▶
It's useful to know what current AI systems can achieve with unlimited test-time compute resources. Ultimately though, the "spirit of the challenge" is efficiency, which is why we're specifically looking for solutions that are at least within 1-2 order of magnitude of cost from being competitive with humans. The Kaggle leaderboard is very resource-constrained, and on the public leaderboard you need to use less than $10,000 in compute to solve 120 tasks.
replies(1): >>43468035 #
Legend2440 ◴[25 Mar 25 04:03 UTC] No.43468035{3}[source]▶
Efficiency sounds like a hardware problem as much as a software problem.

$10000 in compute is a moving target, today's GPUs are much much better than 10 years ago.

replies(1): >>43468977 #
1. NitpickLawyer ◴[25 Mar 25 08:10 UTC] No.43468977{4}[source]▶
> $10000 in compute is a moving target

And it's also irrelevant in some fields. If you solve a "protein folding" problem that was a blocker for a pharma company, that 10k is peanuts now.

Same for coding. If you can spend 100$ / hr on a "mid-level" SWE agent but you can literally spawn 100 today and 0 tomorrow and reach your clients faster, again the cost is irrelevant.