Arc-AGI-2 and ARC Prize 2025

I spent half an hour playing with these now at https://arcprize.org/play and it's fun, but I must say that they are not "easy". So far I eventually solved all of the ones I've gone through, but several took me significantly more than the 2 tries allotted.

I wonder if this can be shown to be a valid IQ test, and if so, what IQ would a person need to solve e.g. 90% of them in 1 or 2 tries.

Yes, I looked that these and thought about what percentage of humans could even solve these. It seems that, unless average humans are not considered generally intelligence, the test for general intelligence should be passable by most humans.

I did the first 10 from ARC-AGI-2 (hard) set. 9 were in one try, 1 was in two.

To be fair I've spent a lot of time thinking about cellular automata and Conway's game of life, which definitely seems to be influencing the design of these puzzles.

I would argue that also small children and even most animals count as "general" intelligences. Animals are much less intelligent than grown humans, but that doesn't mean they are less general. Just like, say, AlphaGo 2 is more intelligent but not more general than AlphaGo 1. Or Qwen 32B vs Qwen 7B. Model or brain size alone doesn't determine generality. Generality is more a question of architecture.

Is there a formal or at least clear consensus definition of "general" intelligence? I assume it involves some level of autonomy and ability to manage novel situations.

There is no consensus on this.

> I assume it involves some level of autonomy and ability to manage novel situations.

Yeah. Also operating in real-time (robotics) and being able to process sensory data only, instead of relying on preprocessed data like text tokens.