Pinned post
Introducing Continual-ARC, a benchmark for agents that learn from experience.
If you think your harness gets better with experience, we'll rerun it on 50 new ARC-style puzzles that nobody outside unify has seen and post its share learned.
continual-arc.unify.ai/submit
If you think your harness gets better with experience, we'll rerun it on 50 new ARC-style puzzles that nobody outside unify has seen and post its share learned.
continual-arc.unify.ai/submit
continual-arc.unify.ai Run yours · Continual-ARC How to run Continual-ARC on your own learner or agent harness and have it verified: we rerun your code on a private set of new tasks for its track and present any verified submission of a genuine... OpenClaw, Hermes Agent and Prime Agent don't meaningfully learn from experience.
On Continual-ARC, our new benchmark at @letsunifyai, none of them were able to memorize anything of value and none were able to generalize to new tasks. Training a small 9B model's weights did both.View quoted post on X
