Caleb Ellington

@probablybots

Virtual Cell wrangler @genbioai | PhD @CMUCompBio | Creator contextualized.ml | context-adaptive models, disease simulators, personalized medicine

San Francisco, CA calebellington.com Joined December 2017

408 Following 958 Followers 670 Posts

Latest posts 5

Pinned post

Caleb Ellington @probablybots May 27, 2025

Honored to share a major thread of my PhD research, out now in PNAS. We address a core issue with how models are used for scientific discovery.

Models are so important that they define the entire scientific process... 1/n

Caleb Ellington @probablybots 4d

We used coding agents to automatically build baselines for 36 "AI for science" deep learning methods from Nature, Science, and Cell-family publications. These baselines recovered a median of ~95% of the score of the published method, and beat them in 33% of cases.

Caleb Ellington @probablybots 5d

If you're interested in understanding how LLMs can do weight-space programming and parameter generation, a few months back @ben_lengerich, @ericxing, and I put together a major review that ties this back to basic statistical learning principles.

Caleb Ellington @probablybots Jul 31

Statistical estimation is being absorbed into context.

In a new 90-page review, we provide a unified view of statistical and foundation models through the lens of context-adaptive inference! ...

View quoted post on X

Caleb Ellington @probablybots 5d

This is super cool, but I'm not sure it's emergent. Hypernetworks have been around for a while and it's straightforward to build an RL env for weight generation or modification in smaller models. It probably just means math/code are diminishing in returns and labs have moved on.

Alex Krentsel Verified account @AlexKrentsel 5d

i've reproduced the results from the MIT blog post today on weight-space programming. but one additional result i have to add: this is a new, step-change emerging capability that's appeared in just the latest set of models.

View quoted post on X

Caleb Ellington @probablybots Sep 3

Can I make Fable fall back to Opus 4.6