Live Tour

AGI progress has stalled.
New ideas are needed.

Presented by Infinite Monkey Lab42
10.28.24 How to Beat ARC-AGI: Deep Learning + Program Synthesis Read & Watch

ARC Prize

ARC Prize is a $1,000,000+ public competition to beat and open source a solution to the ARC-AGI benchmark.

Hosted by Mike Knoop (Co-founder, Zapier) and François Chollet (Creator of ARC-AGI, Keras).


Start here

ARC-AGI

Most AI benchmarks measure skill. But skill is not intelligence. General intelligence is the ability to efficiently acquire new skills. Chollet's unbeaten 2019 Abstraction and Reasoning Corpus for Artificial General Intelligence (ARC-AGI) is the only formal benchmark of AGI.

It's easy for humans, but hard for AI.

Play

Try ARC-AGI. Given the examples, identify the pattern, solve the test puzzle.

Examples

Scroll 👉

Test

1. Configure your output grid:
2. Click to select a color:
3. See if your output is correct:
AI Benchmark Saturation Chart

AGI

Progress toward artificial general intelligence (AGI) has stalled. LLMs are trained on unimaginably vast amounts of data, yet they remain unable to adapt to simple problems they haven't been trained on, or make novel inventions, no matter how basic.

Strong market incentives have pushed frontier AI research to go closed source. Research attention and resources are being pulled toward a dead end. You can change that.

Defining AGI

Consensus but wrong:
AGI is a system that can automate the majority of economically valuable work.
Correct:
AGI is a system that can efficiently acquire new skills and solve open-ended problems.

Definitions are important. We turn them into benchmarks to measure progress toward AGI.

Without AGI, we will never have systems that can invent and discover alongside humans.

Team

Infinite Monkey & Lab42

Sponsors

Advisors

Leaderboard

Grand Prize Goal 85%
MindsAI 55.5
the ARChitects 47
torino 41
Guillermo Barbadillo 40
alijs 40

ARC-AGI / ARC-AGI-Pub

Win Prizes

Grand Prize: $600,000
2024 Progress Prizes: $125,000

Initiatives

ARC-AGI-Pub: $150,000
Benchmark Improvement: $75,000
Events: $75,000

Learn more

Toggle Animation