Links to awesome resources.
- ARC Prize - ARC Prize is a $1,000,000+ public competition to beat and open source a solution to the ARC-AGI benchmark.
- Kaggle - ARC Prize 2024 - Submit solutions here.
- lab42.global/arcathon - This was where ARCathon 2022 and ARCathon 2023 was hosted. ARCathon is now ARC Prize.
- ARC Prize - ARC Resources - Huge collection of Videos, Repos, Papers, Other.
- ARCathon news and publications - The newest publications are interesting to read.
- Dataset-Induced Meta-Learning and other tricks: Improving model efficiency on ARC - What is status of ARC in late 2023.
- ARC: Interview with Jack Cole - Status of ARC early 2024. Interview with the ARC World Record Holder, Jack Cole, solving 34 of the 100 hidden tasks.
- ARC SOTA July 2023 - Status of ARC mid 2023.
- 2024 - Leaderboard - ARC Prize - Pretty formatted leaderboard.
- 2024 - Leaderboard - Kaggle - The usual kaggle style.
- 2022,2023,2024 - Leaderboard - This may be of historical interest. The best team solved 34 tasks out of 100 hidden tasks.
- 2020 - Leaderboard - This may be of historical interest. The best team solved 21 tasks out of 100 hidden tasks.
- ARC Prize - The entire Discord server is about ARC.
- Lab42 Discord server - Several channels for discussing ARC.
- Yannic Kilcher's Discord server - Every Sunday 1700 UTC there is a voice meeting for only discussing ARC.
- John's AI Group Discord server - Follow progress of Tan John Chong Min's ARC project.
- ARC community wiki - Contains analysis of several of the 800 tasks.
- ARCreate - Contribute with new tasks to the ARC 2 dataset.
- The original ARC testing interface - Edit train and test pairs. No backend required.
- BrainGridGame, repo, dataset - What kind of interactions does humans do when solving an ARC task. This project captures the interaction history and continuesly updates the dataset with interaction histories.
- O2ARC, repo, repo - Editor with ability to record user interaction while solving an ARC task.
- ARC-Game, repo - The ARC 1 dataset made into a fun game that runs in the browser.
- arc-site - Edit train and test pairs. It runs in the browser, without backend.
- arc-app - Seems to be react, with frontend and server.
- arc-level-editor - Edit train and test pairs. Requires a nodejs installation.
- ARC-AGI Playground, ARC-AGI Puzzle Maker - Edit train and test pairs.
- mxbi/arckit - Python and command-line tools for easily working with the ARC dataset.
- arc-dsl - Solutions to all 400 training tasks of the ARC dataset.
- Console for inspecting ARC tasks - Printing ARC images to the console can get messed up. Instead I have made a web server for viewing ARC images. It uses a websocket between the browser and the webserver (but you don't have to worry about the websocket). You can view an image by sending a POST request, and the image gets appended at the bottom of the web page.
- Predicting the output size of an ARC task - Using the command line tool for making better guesses about the output size.
- ARCLE - ARC Learning Environment - Abstraction and Reasoning Corpus as a Farama Gymnasium environment.
- simon-arc-env - Abstraction and Reasoning Corpus as a Farama Gymnasium environment.
- ARC-eyetracking - uses PsychoPy for eye tracking.
- ARC-behavioral - has an interesting video explaining how the eye tracking works with ARC.
- human-arc - eye tracking.
- Dataset-Induced Meta-Learning (and other tricks): Improving model efficiency on ARC - by Jack Cole and Mohamed Osman.
- Getting 50% (SoTA) on ARC-AGI with GPT-4o, repo - Ryan Greenblatt.
- Large Language Models as General Pattern Machines - Solves 85 of 800 tasks.
- GPT4 solving LARC tasks - Solving ARC tasks using the LARC human descriptions with GPT4, solves 139 of 384 tasks.
- Tan John Chong Min's ARC prompts - Solves 50 of 111 training set problems!
- Andreas Köpf's arc-agents - Solving ARC tasks with CodeLlama, Llama2, WizardCoder or similar language models, solves 45 of 800 tasks.
- Simon Strandgaard's ARC prompts - Experiments solving ARC tasks with GPT4 or similar language models, solves 39 of 800 tasks.
- ARC_LLMs: Keeping track of LLM progress on ARC, website source code and visualization - Visualize what ARC tasks gets solved (or not) by LLMs!.
- Fast and flexible: Human program induction in abstract reasoning tasks and repo - by Aysja Johnson, Wai Keen Vong, Brenden M. Lake and Todd M. Gureckis.
- ARC-AGI - Claude 3.5 Sonnet and GPT-4o comparison, repo - by Marko Manninen.
- Videos about ARC - Introduction to ARC, interviews with experts, experiments with language models.
- Datasets for ARC - Links to datasets that use the ARC format.
The 2024 rules allows for 2 predictions.
- 🧮ARC24🧠Developed 2020 Winning Solutions by Mehran Kazeminia, Somayyeh Gholami - Solves 26 out of 100 hidden tasks.
Implementations that are older than 2024. The rules allowed for 3 predictions.
- Mehran Kazeminia - ensemble - Solves 31 out of 100 hidden tasks.
- Michael Hodel - ensemble - Solves 31 out of 100 hidden tasks.
- Phil Dhingra - ensemble - Solves 29 out of 100 hidden tasks.
- DEAD LINK - taka or team
armo
- ensemble - Solves 29 out of 100 hidden tasks. The code is not on themain
branch. - icecuber - Solves 21 out of 100 hidden tasks. Kaggle 2021 - 1st place.
- Alejandro & Roderic & Yuji - Solves 19 out of 100 hidden tasks. Kaggle 2021 - 2nd place.
- Vlad & Ilia, repo - Solves 19 out of 100 hidden tasks. Kaggle 2021 - 3rd place.
- Puzzlemaster - Solves 14 out of 100 hidden tasks.
- Maciej Sypetkowski + Michał Sypetkowski - Solves 8 out of 100 hidden tasks.
- Simon Strandgaard - Solves 8 out of 100 hidden tasks.
- Michael Hodel - Solves 6 out of 100 hidden tasks.
- Anastasia Karpovich - Solves 5 out of 100 hidden tasks.
- Andy Penrose - Solves 4 out of 100 hidden tasks.
- Sébastien Ferré - Solves 3 out of 100 hidden tasks.
- Naoya Tanahashi - Solves 3 out of 100 hidden tasks.
- Robert Lizée - Solves 1 out of 100 hidden tasks.