Twitxy Saved

Kevin Ellis

Verified account This account is verified. Learn more

@ellisk_kellis

Cornell Computer Science, Assistant Professor.
Program synthesis, AI
Ithaca, New York cs.cornell.edu/~ellisk/ Joined September 2021
212 Following 1.7K Followers 44 Posts

Latest posts 5

Kevin Ellis Verified account @ellisk_kellis
@yichao_liang 's latest robotics + program synthesis work with @BasisOrg ! Learning programs that describe heat, glue, wind, electrical switches, etc, a step toward robots that go into new environments, and program for themselves a model of how things work.
Yichao Liang @yichao_liang Oct 2
Agentic real-to-sim is getting increasingly good at rebuilding scenes in a physics simulator. But looking at a scene does not reveal how glue cures, how water heats, or how a fan's wind pushes things. And what if the simulator cannot model these mechanisms at all?

We present EMPIRIC, an agent that learns a residual world model: a physics engine extended with code for the missing mechanisms.

It solves all 25 runs across five simulated domains, where coding-agent baselines solve 14 to 16, and on a real robot it learns wind and domino masses from two gusts.

basisresearch.github.io/empiric/

[1/9]
View quoted post on X
1 replies 2 reposts 19 likes 1.8K views View on X
Kevin Ellis Verified account @ellisk_kellis
Thank you, François, Mike, & team, for the ARC challenge. It has been a durable source of inspiration, and brings fresh ideas to AI.

The paper award first authors are Keya Hu (applying to PhDs @HuLillian39250) and Wen-Ding Li (at NeurIPS hunting for industry gigs @xu3kev). They're amazing: Anyone would be lucky to get them.

It's also our first collab w/ @ZennaTavares from @BasisOrg as part of MARA: basis.ai/blog/mara/
MARA is recruiting at all levels: join us!
www.basis.ai Project MARA preview: modeling, abstraction, and reasoning agents An enduring vision of artificial intelligence research is to build machines that emulate flashes of scientific brilliance, discovering new physical laws and inventing new technologies. While singul...
François Chollet Verified account @fchollet Dec 6, 2024
Today we're announcing the winners of ARC Prize 2024. We're also publishing an extensive technical report on what we learned from the competition (link in the next tweet).

The state-of-the-art went from 33% to 55.5%, the largest single-year increase we've seen since 2020. The benchmark remains unbeaten, but we're happy to see that research progress on the key bottleneck to AGIs (in particular on-the-fly adaptation to novel tasks) has been reignited in 2024 -- in part thanks to ARC Prize.

In particular the competition has popularized Test Time Training (TTT), originally pioneered for ARC-AGI by Jack Cole last year. I believe TTT represents the largest jump in LLM generalization capabilities since the initial findings regarding in-context-learning circa 2019-2020. ARC Prize has also led to a considerable surge of research interest towards program synthesis.

Competition winners:
🥇 the ARChitects (Daniel Franzen, Jan Disselhoff)
🥈 @guille_bar
🥉 alijs (Agnis Liukis)

Paper Award winners:
🥇 "Combining Induction and Transduction For Abstract Reasoning" by @xu3kev et al.
🥈 "The Surprising Effectiveness of Test-Time Training for Abstract Reasoning" by @akyurekekin et al.
🥉 "Searching Latent Program Spaces" by @ClementBonnet16 & @MattVMacfarlane

ARC-AGI-Pub Leaderboard (solutions using commercial APIs):
🥇 @jeremyberman
🥈 @ellisk_kellis & @akyurekekin
🥉 @ryangreenblatt
View quoted post on X