Twitxy Saved

Tong Chen

Verified account This account is verified. Learn more

@tomchen0

PhD student @uwcse @uwnlp
Joined February 2023
652 Following 969 Followers 223 Posts

Latest posts 5

Pinned post

Tong Chen Verified account @tomchen0
Recent work on agent memory and “dreaming” 🧠💭 shows how memory helps agents improve through experience. But training this capability is challenging: we lack demonstrations of good memory behavior (what to remember, how to organize it, and when to retrieve it).

We study a self-improving recipe: the model discovers its own memory prompts, generates trajectories with the optimized prompts, and distills those behaviors into its weights.

🔗 facebookresearch.github.io/RAM/blogs/self…
facebookresearch.github.io Self-Improving Memory: Meta-Optimization and Harness Distillation for Continual Learning Agents Self-Improving Memory trains a model on its own discovered memory behaviors, so it uses the file system as memory under a generic harness without task-specific instructions.
Jason Weston Verified account @jaseweston 23h
Introducing: Self-Improving Memory 🧠✨📈

We let the model discover its own memory skills, then train them into its weights:

- Meta-optimizes memory from the model's own runs with large gains.
- Distilling these gains works too.

Blog post: 📝 facebookresearch.github.io/RAM/blogs/self…
🧵1/6
View quoted post on X
6 replies 16 reposts 93 likes 4.1K views View on X
Tong Chen Verified account @tomchen0
Recursive self-improvement and continual learning research drops every day, and people keep asking me what those concepts actually mean.
@TuXinming and I tried to unwrap the popular papers and products a bit: WHAT agents update, and WHEN agents update.

⬇️Blog: xinmingtu.cn/blog/2026/self…
xinmingtu.cn The What & When of Self-Evolving Agents A 3×3 framework for understanding what evolves in AI agents and when those updates persist.
Xinming Tu Verified account @TuXinming Jul 22
[1/9] There’s been incredible discussion and progress lately around Self-Evolving Agents, and Recursive Self-Improvement.
In our new blog post, @TongChen_ and I propose a 3×3 Framework to map this fast-growing landscape along two core axes:
👉 WHAT does the agent update? (The Substrates)
👉 WHEN do those updates persist? (The Persistence Horizons)
Here is the map. 🧵👇
🔗Read our full blog deep dive, interactive 3×3 diagrams, our expanded appendix mapping 30+ work xinmingtu.cn/blog/2026/self…
View quoted post on X
5 replies 29 reposts 158 likes 23K views View on X
Tong Chen Verified account @tomchen0
Just landed in Seoul for #ICML2026 (Jul 7–9). Looking forward to making new friends!

Presenting our spotlight paper on RL training for hallucination reduction and reward hacking
⏰Thu, Jul 9, 10:30 AM–12:15 PM
📍Hall A #4617.

Also happy to chat about self-evolving agents, agentic memory, and continual learning. Say hi if you're around!
1 replies 3 reposts 23 likes 3.7K views View on X
Tong Chen Verified account @tomchen0
I will be at #NeurIPS2025 12.3–12.7 Looking forward to meeting old and new friends ! ☕️🌮

Recently working on hallucination (Binary RAR) and verbatim memorization (ParaPO), issues that scaling up pretraining cannot simply fix. Also interested in making models learn more like humans: strong generalization, non-scalar rewards, episodic memory, and long-horizon abilities.
1 replies 5 reposts 38 likes 4.2K views View on X
Tong Chen Verified account @tomchen0
PhD applicants — Join Akari’s first cohort of students! Akari's research ranges from careful benchmarking to solid methodology. She always gives sharp feedback while being thoughtful and supportive. She stayed driven throughout her PhD and now brings that same energy to her new lab. I am grateful to learn from her and to work with her — please apply!
Akari Asai Verified account @AkariAsai Nov 25, 2025
1/ Hiring PhD students at CMU SCS (LTI/MLD) for Fall 2026 (Deadline 12/10) 🎓
I work on open, reliable LMs: augmented LMs & agents (RAG, tool use, deep research), safety (hallucinations, copyright), and AI for science, code & multilinguality & open to bold new ideas!
FAQ in 🧵
View quoted post on X