Twitxy Saved

Alexi Gladstone

Verified account This account is verified. Learn more

@AlexiGlad

ASI whisperer. Working on EBTs/EBMs, XMs, Generative Modeling, World Models, Reasoning. PhD @ UIUC. Prev @flappyairplanes @Meta, @PalantirTech
San Francisco alexiglad.github.io Joined February 2023
878 Following 10K Followers 741 Posts

Latest posts 5

Pinned post

Alexi Gladstone Verified account @AlexiGlad
We discovered a third pretraining axis beyond parameters and data: exploration.

Scaling exploration monotonically improves existing models across images/video/language, and unlocks end-to-end generation.

In the simplest case, it's just a for loop.

Introducing Explorative Modeling.

TLDR:
- Gains from exploration grow with scale: 7%→36% as data scales, 13%→23% as parameters scale, and gains double at 3× the compute
- Adding exploration to ~SOTA baselines improves data efficiency by 6.2×, FLOP efficiency by 4.1×, parameter efficiency by 47%, and hits a near-SOTA 1.43 unguided FID on ImageNet
- Exploration lets you trade training compute for generalization, and scales how end-to-end your generative model is
- End-to-end Explorative Models (XMs) match diffusion performance on control tasks with up to 256× less inference compute

🧵Thread:
114 replies 323 reposts 2.8K likes 1.1M views View on X
Alexi Gladstone Verified account @AlexiGlad
it's Energy-Based Models (EBMs) all the way down...
Yilun Du @du_yilun 1d
What do diffusion models, representation learning, reinforcement learning, and test-time reasoning have in common? Each can be seen as learning an energy function or using one to guide sampling and search.

Excited to share our tutorial on energy-based models with @daibond_alpha!
View quoted post on X
2 replies 9 reposts 124 likes 4.8K views View on X
Alexi Gladstone Verified account @AlexiGlad
Bye bye looped reasoning… and hello Energy-Based Reasoning⚡!

Introducing Energy-Based Reasoners

TLDR:
- EBRs use 345x less inference compute and 2.6x fewer training FLOPs than the best baselines
- EBRs are 7x-43x more sample-efficient than the best looped baselines at inference
- EBRs achieve 99.9% on Sudoku-Extreme and near 100% accuracy on multi-solution benchmarks

🧵Thread
0:53
88 replies 258 reposts 2.8K likes 162K views View on X
Alexi Gladstone Verified account @AlexiGlad
Very very very very VERY important!!!

Jensen is absolutely necessary for open source, for startups/neolabs, and for the world

Of course, mistakes have been made, and im hopeful jensen can learn from these events

but please bring him back!
Jensen Huang Verified account @JensenHuang 3d
Over the past week, I’ve been overwhelmed by the love and support of friends, industry colleagues, and people I've never met. Thank you to everyone who has shown kindness to my family and me. It means the world to me.

I came to the United States 53 years ago, and becoming an American citizen is one of the greatest gifts and proudest moments of my life. NVIDIA has been my life’s work. Building it into the company it is today alongside my colleagues has been a privilege and an honor. Nowhere but in America could a company like NVIDIA be possible. I love our country, and I love NVIDIA.

I did not live up to the standards expected of everyone at NVIDIA, and I have made serious mistakes in my personal life. I created problems for the Board that I deeply regret. I own my mistakes completely, and I am committed to cooperating with the Board’s independent investigation.

Since my departure, I’ve seen an outpouring of calls from NVIDIA’s employees, investors, business partners, and customers for me to return as CEO. Many continue to reach out to me directly as the company navigates complex technology, market, competitive, and geopolitical dynamics. NVIDIA is a once-in-a-generation company. If the Board of Directors decides that my return is in the best interest of our shareholders, our employees, the company, and America, I would be honored to answer these calls and return as CEO.

Thank you again to everyone who has shared their good wishes. I am profoundly humbled by your support. To my family: I love you, and I will spend the rest of my life being worthy of yours.

Jensen
View quoted post on X
3 replies 2 reposts 79 likes 3.1K views View on X
Alexi Gladstone Verified account @AlexiGlad
really great and rigorous research on multimodal encoding!

in an era where scientific rigor is at an all time low this felt like a breath of fresh air
Chris Hoang Verified account @choang333 Nov 13
Labs disagree on vision encoders for MLLMs! ⚔️

Gemma 4 12B scrapped the encoder.
Kimi K3 dropped encoder pretraining.
Inkling 2 Small revived the encoder Inkling killed.

We trained 200+ models in a controlled study to settle it:
✅ Keep vision parameters, skip the pretraining. And they don't have to be an encoder! 🤔

Paper: arxiv.org/abs/2611.17334 🧵
View quoted post on X