←back to thread

Getting 50% (SoTA) on Arc-AGI with GPT-4o

(redwoodresearch.substack.com)
394 points tomduncalf | 1 comments | 17 Jun 24 21:51 UTC | HN request time: 0.203s | source
Show context
whiplash451 ◴[18 Jun 24 07:45 UTC] No.40715123[source]▶
The article jumps to the conclusion that "Given that current LLMs can perform decently well on ARC-AGI" after having used multiple hand-crafted tricks to get to these results, including "I also did a small amount of iteration on a 100 problem subset of the public test set" which is hidden in the middle of the article and not mentioned in the bullet list at the top.

Adding the close-to ad-hominem attack on Francois Chollet with the comics at the beginning (Francois never claimed to be a neuro-symbolic believer), this work does a significant disservice to the community.

replies(4): >>40715887 #>>40716039 #>>40716432 #>>40718813 #
1. bogtog ◴[18 Jun 24 10:30 UTC] No.40716039[source]▶
For what it's worth, the comic is based on a well-known meme, and the author must've wanted to stick to the format: https://media.licdn.com/dms/image/D4E10AQFryt0thryEeA/image-...