Perry Dong

This account is verified. Learn more

@perryadong

CS PhD @StanfordAILab, Part Time @GoogleDeepMind | Reinforcement Learning

pd-perry.github.io Joined August 2015

158 Following 1.8K Followers 82 Posts

Latest posts 5

Perry Dong @perryadong Sep 23

What will be the “RLHF” moment for robotics? What will it take to get robotics to where LLMs are today and beyond?

New blog post with @chelseabfinn sharing some thoughts on the state of RL for frontier robotics models and what's missing 👇

Blog: pd-perry.github.io/posts/post-tra…

Perry Dong @perryadong Sep 21

Introducing Real-Time EXPO-FT – Fast and Reliable RL for Real-Time VLA Policies!

Real-Time EXPO-FT unlocks π0.5 on challenging dynamic tasks, such as balancing a ball on a plate and striking a ball into the goal

(1/6)

1:00

Perry Dong @perryadong Aug 19

World models have emerged as one of the biggest directions in physical AI. At the same time, RL fine-tuning is unlocking capabilities in frontier models beyond what pretraining can achieve on its own

Can we get the best of both worlds?

We propose Q-Learning with World Models (QWM)

(1/7)

Perry Dong @perryadong Jul 30

Pretraining has worked remarkably well across domains

We show this doesn’t hold for Q-functions in online RL from a pretrained policy — and propose IPE, a more effective way to learn Q-functions for online RL fine-tuning

(1/6)

Perry Dong @perryadong Jun 1

We've released the code for EXPO-FT.

Sample-efficient, reliable RL fine-tuning for VLAs — try it out today!

Code: github.com/pd-perry/expo-…
Paper: arxiv.org/abs/2605.25477

github.com GitHub - pd-perry/expo-ft Contribute to pd-perry/expo-ft development by creating an account on GitHub.

Perry Dong Verified account @perryadong May 27

Introducing EXPO-FT – Efficient, Reliable & Open-Source VLA Finetuning!

EXPO-FT unlocks π0.5 for challenging manipulation tasks:

Routing string lights & inserting the power connector to illuminate them
Striking pool ball into pocket
Inserting flower into wine bottle

(1/5)

View quoted post on X