Twitxy Saved

Andy Tang

@tangerinecoder

Robotics and AI @ SAIL
fear less; imagine more
andyta.ng Joined April 2023
293 Following 168 Followers 40 Posts

Latest posts 4

Andy Tang @tangerinecoder
Was super fun exploring this! Most modern policies don't use history -- Diffusion Policy in particular gets a lot worse. We identify a simple ingredient for history improvement, and use it to improve efficiency and performance of long-context policies.
Giving history to our robot policies is crucial to solve a variety of daily tasks. However, diffusion policies get worse when adding history. 🤖

In our recent work we learn how adding an auxiliary loss that we name Past-Token Prediction (PTP) together with cached embeddings enables us to reliably add longer history context to our robot policies! 🧠

We also show how PTP enables some test-time scaling techniques for robotics! 🚀
View quoted post on X