Pinned post
It turns out you can just take an off-the-shelf VLM and fine-tune it directly to output robot actions *as text* and it performs better than/as-good-as all the more complex model architectures…
Check out the paper!
Check out the paper!
What's the right architecture for a VLA?View quoted post on X
VLM + custom action heads (π₀)?
VLM with special discrete action tokens (OpenVLA)?
Custom design on top of the VLM (OpenVLA-OFT)?
Or... VLM with ZERO modifications? Just predict action as text.
The results will surprise you.
VLA-0: Outperforms π₀, GR00T-N1, MolmoAct, SmolVLA.
With ZERO changes to the VLM.
🧵⬇️