Community Newsletter 1

The following is an archive of the ARC Prize Community email newsletter. Subscribe to future emails.

New ARC-AGI SOTA: 39%

Dear ARC-AGI enthusiasts,

We are thrilled to bring you the latest updates from our community as we kick off ARC Prize 2024.

ARC Prize in Numbers

You've all shown up to the challenge! Just 11 days after the ARC Prize launch, we are happy to count 4,406 entrants on Kaggle.

Here are some recent stats:

• YouTube: 13,100 views
• Discord: 1,146 members
• Twitter/X: 2,416 followers
• Kaggle: 4,406 entrants, 183 teams, 706 submissions

New ARC-AGI SOTA

Our big congratulations go out to ARC-AGI pioneers Jack Cole, Mohammed Osman, and Michael Hodel for setting the first new world record on the ARC-AGI private evaluation dataset with a score of 39%. 🎉

We look forward to exciting competition months ahead!

// ARC-AGI-Pub

The value of ARC as an AGI benchmark is its focus on efficiency and test integrity (no internet access, restricted compute), and its ask for programs with reasoning and skill acquisition abilities (hidden test set).

We’ve loved the creative attempts at solving ARC-AGI with frontier models that require internet access. Some methods have claimed over +50% on the public eval set using gpt-4o. However it is important to address that only submissions to the private evaluation set on Kaggle are the official ARC-AGI scores.

Regardless, we want to encourage research with larger models, more compute, and longer run time, which is why we’ve set up the ARC-AGI-Pub leaderboard. This is a secondary leaderboard (in beta) for official scoring on the public evaluation set. High score claims are verified using an unpublished semi-private evaluation set.

Follow our channels for upcoming details about a cost reimbursement program and more!

Team Up!

ARC-AGI has been around for almost five years now. With a rapidly growing community, you can reach out to not only experienced ARC-AGI specialists, but also to experts from different backgrounds that might be vital to close in on AGI.

If you leave a good description of your ideal teammates in the Discord #team-formation channel, we try to feature you in this bi-weekly newsletter:

Here are a few people looking to team up.

• @AliceFronTheSillyLand is seeking game developers experienced in particle systems or cellular automata, with skills in data analysis and machine learning, who are curious about creating a 2D particle matrix with unique pixel behaviors.
• @Mazen wants to explore neuro-symbolic AI to try to tackle the problem of System 1 and 2 working together and is open to teaming up.
• @Shure is looking for teammates to work on an approach by combining chain-of-thought, programming, and self-improving techniques.
• @the_Guy is building a team around their MEGA (Mutable Encoding enabled Genetic Algorithm) project, which looks at a unique method of constructing and optimizing Neural Nets with a new kind of Genetic Algorithm framework.

Stay Tuned

All new high-score announcements are shared on the official ARC Prize Twitter/X. Lastly, the most crucial ARC-AGI developments are addressed on our blog containing a Day 1 Update by ARC Prize Co-host and Zapier Co-founder, Mike Knoop.

We look forward to many more discussions, submissions, and world records in the coming months — let’s solve this challenge!

See you around!

Oliver
ARC Prize Team

Be the first to get the latest ARC Prize info. Subscribe now.