@allenzren
Pinned post
What’s missing from robot foundation models? An explicit understanding of WHY motions work: why move in this direction, why place the object in this way, how hard to grasp the object. This motion-level reasoning bridges instructions to actions—and provides knowledge that can generalize across embodiments and scenes.
Pure behavior cloning supervises WHAT actions to take, but leaves models to infer WHY those actions work. This becomes especially limiting when learning from large-scale heterogeneous data, including egocentric human data, where humans and robots can take very different actions to achieve the same physical effect. We need models to extract the intent behind those motions, rather than simply recite them. Why leave that knowledge buried in trajectories when we can teach it explicitly?
Introducing EgoLAP: a shared language for human and robot motion. Language actions teach HOW to move; motion-level reasoning teaches WHY the motion works. Together, they unlock, to our knowledge, unprecedented gains in zero-shot performance for robot foundation models without additional robot demonstrations.
arxiv.org/abs/2610.08726
ego-lap.github.ioView quoted post on X
Robotics has a distribution problem. Today, Ultra is announcing $62M in funding to solve it, including a $50M Series A led by @hiFramework.
We believe that deployment is the bottleneck in robotics.
It’s relatively easy to make a robot look impressive in a controlled environment. It’s much harder to put a robot into the open world, make it useful, keep it running, earn the trust of the people working alongside it, and do that over and over and over again.
So that’s what we’re focusing on.View quoted post on X
π, But Make It Fly ✈️
We fine-tuned π0, a VLA model pretrained entirely on manipulators, to fly a drone that picks up objects, navigates through gates, and composes both skills from language commands.View quoted post on X
