Twitxy Saved

Xiao-Xiao Long

@xxlong0

Associate Professor @ NJU. | Organizer of @anysyn3d
Spatial Intelligence & Robotics.
xxlong.site Joined November 2023
259 Following 1.2K Followers 121 Posts

Latest posts 5

Xiao-Xiao Long @xxlong0
Video2Humanoid. Still trouble with bad retargeted humanoid motions?

Humanoids now are Easy to track any video using our new Neural Motion Retargeting (NMR) Method.

Optimization-based motion retargeting methods like IK and GMR are solving a non-convex problem frame by frame, which makes them sensitive to initialization, hard to tune, and prone to poor local minima. The result is familiar: joint discontinuities, self-collisions, and unstable foot contact.

Our solution is simple but effective : instead of optimizing each frame independently, learn the mapping between human motion and robot motion as a distribution via networks.

📊Results on Unitree G1
- 0 joint jumps
- 54% fewer self-collision frames
- 61% fewer joint limit violations
- Faster convergence for downstream control policy training

NMR turns motion retargeting from a fragile optimization problem into a learned, scalable pipeline for more stable humanoid motion.

please visit nju3dv-humanoidgroup.github.io/nmr.github.io/ for more visualization results.
opensource: github.com/NJU3DV-Humanoi…
0:55
6 replies 51 reposts 261 likes 24K views View on X
Xiao-Xiao Long @xxlong0
Excited to share our PDT: Point Distribution Transformation with Diffusion Models (SIGGRAPH2025)!
Cheng Lin @_cheng_lin Jul 29, 2025
🔎Excited to share our PDT: Point Distribution Transformation with Diffusion Models (SIGGRAPH2025)!
💡While autoregressive models are now widely adopted for predicting structures, we find diffusion models can also reveal high-level structures by transforming point distributions!
View quoted post on X