Great work by @tomchen0 on a direction I'm excited about -- self-improving agents should also learn to optimize their (typically human-written) harnesses.
We discover these through meta-optimization (outer loop) & then distill the knowledge back into model weights (inner loop)!
We discover these through meta-optimization (outer loop) & then distill the knowledge back into model weights (inner loop)!
Introducing: Self-Improving Memory 🧠✨📈View quoted post on X
We let the model discover its own memory skills, then train them into its weights:
- Meta-optimizes memory from the model's own runs with large gains.
- Distilling these gains works too.
Blog post: 📝 facebookresearch.github.io/RAM/blogs/self…
🧵1/6