Twitxy Saved

Joey Gonzalez

Verified account This account is verified. Learn more

@profjoeyg

Professor @UCBerkeley and co-founder/advisor @RunLLM, @Inferact, @Letta_AI, and @genmoai
Berkeley, CA eecs.berkeley.edu/~jegonzal Joined June 2011
599 Following 6.2K Followers 870 Posts

Latest posts 5

Joey Gonzalez Verified account @profjoeyg
We often talk about AI having the potential for real positive impact on peoples lives. But, we need to bring AI into the lab doing the actual work, not just reading papers (...like faculty?).

Embodied AI in the lab, is the next frontier and this is the team to make it happen.
Kevin Weil 🇺🇸 Verified account @kevinweil Oct 22
💥 Introducing Warp Sciences, a new company applying AI and robotics to help the world develop new medicines faster.

We’ve raised a $215M Series A led by @lightspeedvp to bring frontier AI out of the browser and into the lab, and build scientific capacity here in America.

I co-founded Warp with my long-time friend @dpatil, FAIR co-founder @manohar_paluri, and drug hunter Sol Reisberg. The early team is full of incredible people like @bkspears9, who helped achieve Q>1 fusion at LLNL.
View quoted post on X
1 replies 2 reposts 15 likes 1.4K views View on X
Joey Gonzalez Verified account @profjoeyg
Most memory benchmarks test recall and not synthesis.

My former students just launched an exciting new memory benchmark that evaluates whether agents can continually learn from past experiences.
Letta Verified account @Letta_AI Oct 21
Introducing FrontierMemory: a new way to evaluate agent memory through downstream task performance.

While existing memory benchmarks focus on recall (saturated via agentic search), FrontierMemory focuses on how agents learn from experience.
View quoted post on X
3 replies 3 reposts 29 likes 1.7K views View on X
Joey Gonzalez Verified account @profjoeyg
One of my students just released some impressively fast kernels for modern variants of linear attention on TPUs.

Now we just need some TPUs to do the actual model architecture research, @GoogleDeepMind want to collaborate?
Mayank Mishra Verified account @MayankMish98 Oct 13
Releasing FLAT: Flash Linear Attention on TPUs 🚀

Pallas training kernels for Linear Attention, Mamba-2 and GLA. On one TPU v6e, forward + backward is up to 3x faster than FLA on an H100 for GLA, and 1.5x faster for Mamba-2.

🧵
View quoted post on X
0 replies 5 reposts 80 likes 5.4K views View on X
Joey Gonzalez Verified account @profjoeyg
We just trained a 2.3B MoE Hybrid Mamba model that competes with a Llama-3.2-3B dense using less than 1% of the pre-training FLOPS.

We may not have a lot of resources in academia but we make up for it with creative students who find ways to train innovative new architectures across whatever hardware they can find.

If anyone wants to help, we would love to scale this research to the next rung of the training ladder.
Mayank Mishra Verified account @MayankMish98 Sep 22
We pretrained a 2.3B MoE (360M active) Hybrid Mamba-2 that lands within a few points of Llama-3.2-3B using <1% of its pretraining FLOPs.

No dedicated cluster. The run hopped between H100s, A100s, V100s (yes, V100s) and TPU v5p/v6e on a single codebase.

Meet Rigel 🧵
View quoted post on X
1 replies 6 reposts 77 likes 8.2K views View on X
Joey Gonzalez Verified account @profjoeyg
The agent ecosystem is evolving rapidly and we are trying to capture a picture of where we are and where things are headed.

We're now collecting responses for the 2026 survey of agents.

berkeley.qualtrics.com/jfe/form/SV_3q…

Help us create a more complete picture of how agent systems are evolving, what challenges remain, and where future research may be most impactful.