Pinned post
Wrist cameras give robots close-up views, but only where the hand happens to be.
What if the policy could decide where to look?
Introducing FoveaVLA: a VLA that replaces the wrist camera with learned foveation actions.
FoveaVLA predicts where it will need to look next, then crops that region from the full-resolution external image. The full view gives context; the foveal crop gives close-up detail.
With one external camera and no wrist camera, FoveaVLA reaches 70.8% success on 48 real-world trials, vs. 52.1% for π0.5 with a wrist camera.
• No additional demonstrations
• No camera calibration
• No wrist camera
Paper, code, and models are all open 🧵
What if the policy could decide where to look?
Introducing FoveaVLA: a VLA that replaces the wrist camera with learned foveation actions.
FoveaVLA predicts where it will need to look next, then crops that region from the full-resolution external image. The full view gives context; the foveal crop gives close-up detail.
With one external camera and no wrist camera, FoveaVLA reaches 70.8% success on 48 real-world trials, vs. 52.1% for π0.5 with a wrist camera.
• No additional demonstrations
• No camera calibration
• No wrist camera
Paper, code, and models are all open 🧵
0:49