Twitxy Saved

Scott Linderman

Verified account Engram

@scott_linderman

Professor @Stanford Statistics and @StanfordBrain. Co-Founder of @EngramLab. AI, Neuroscience, Statistics. Posts are my own.
Stanford, CA lindermanlab.github.io Joined April 2016
963 Following 6K Followers 1.1K Posts

Latest posts 5

Scott Linderman Verified account @scott_linderman
Continual learning is about more than internalizing new knowledge — it’s about learning to use memory effectively. Excited to share some of our research at Engram showing how training complements text memory, making agents more intelligent, cost-effective, and robust.
Engram @EngramLab Nov 4
In our new blog, we share some new science investigating how RL complements text-based memory by letting models learn how to use their notes.

It turns out that training can be cheap compared to building notes, and stays surprisingly robust even through millions of tokens of edits.
View quoted post on X
6 replies 14 reposts 172 likes 8.4K views View on X
Scott Linderman Verified account @scott_linderman
I'm excited to share this new work led by @smithhenryd! We develop Helmholtz-SDE, a faster and more accurate simulation-free inference algorithm for latent SDEs. The animation below speaks for itself!
Henry Smith @smithhenryd Oct 12
Coming to @NeurIPSConf 2026: Can you learn dynamics from noisy observations 𝘄𝗶𝘁𝗵𝗼𝘂𝘁 𝗻𝘂𝗺𝗲𝗿𝗶𝗰𝗮𝗹 𝘀𝗶𝗺𝘂𝗹𝗮𝘁𝗶𝗼𝗻? Yes, and just as accurately as you can with simulation!

Paper: arxiv.org/abs/2606.16138
Code: github.com/lindermanlab/h…

Thread🧵
View quoted post on X
9 replies 8 reposts 84 likes 3.7K views View on X
Scott Linderman Verified account @scott_linderman
Language modeling relies on approximating the distribution of the next token given the preceding ones, but are all next-token distributions equally difficult to learn?

New work by @NicolasZucchet reveals what we call a curse of ambiguity: it’s harder to learn next-token distributions with broader support.

We identify four root causes, with experiments to corroborate the theory.
Nicolas Zucchet Verified account @NicolasZucchet Aug 18
We often ask how hard a task is for an LLM to learn, but what about individual tokens?
Our new paper w/ @scott_linderman @hyundongleee digs into that question and reveals a curse of ambiguity: contexts with multiple possible next tokens are harder for LLMs to learn.
View quoted post on X
3 replies 3 reposts 53 likes 4.8K views View on X
Scott Linderman Verified account @scott_linderman
This is a good time to share that I’m taking a sabbatical to work at Engram full time!

Our blog post highlights some of the directions we’re taking, building agents that study and learn with complementary memory systems.

There's lots of research still to be done, and I’m excited to help lead these efforts!
Engram @EngramLab Aug 17
Today we're publishing our first research blog, Understanding a Law Firm through Study.

We're sharing a glimpse of a future where agents are trained with native memory:
View quoted post on X