Jeff Cui

This account is verified. Learn more

@jeffacce

PhD CS @ NYU Courant, Research @ Meta

Joined December 2014

1K Following 815 Followers 113 Posts

Latest posts 5

Pinned post

Jeff Cui @jeffacce Jul 22

Your policy doesn't need 7B params. It simply needs dense features.

Introducing Patch Policy: pretrained ViT + small transformer beats OpenVLA-OFT with 0.7% of its params, and trains on a 5090.

Here it inserts a cable (~2mm tol), and does it again as we unplug mid-rollout. 🧵

0:22

Jeff Cui @jeffacce Nov 4

Robots need to feel where they touch and how forces change. Introducing PanoTac: an open-source, dense 3D tactile sensor for <$10 USD.

Watch as the robot racks a test tube and pulls the stopper: PanoTac tells the tube orientation, and feels when the stopper comes free. 🧵

0:08

Jeff Cui @jeffacce Aug 12

We've released code for Patch Policy! Try it out here: github.com/gaoyuezhou/pat…

You can run this on a single GPU, as well as on 8xH200 nodes!

github.com GitHub - gaoyuezhou/patch_policy Contribute to gaoyuezhou/patch_policy development by creating an account on GitHub.

Jeff Cui Verified account @jeffacce Jul 22

Your policy doesn't need 7B params. It simply needs dense features.

Introducing Patch Policy: pretrained ViT + small transformer beats OpenVLA-OFT with 0.7% of its params, and trains on a 5090.

Here it inserts a cable (~2mm tol), and does it again as we unplug mid-rollout. 🧵

View quoted post on X

Jeff Cui @jeffacce Feb 12

Fully open-source, customizable hardware is the way for robotics research. Introducing Your Own Robot (YOR), a mobile bimanual robot platform for ~$10k.

0:42

Jeff Cui @jeffacce Feb 12

Also check out MolmoSpaces-Bench from @omarrayyann! Our contact-anchored policies (CAPs) perform well zero-shot across diverse environments and objects. Omar is the rockstar behind our sim env for CAP, enabling us to train and evaluate multiple models in a day.

Omar Rayyan Verified account @omarrayyann Feb 11

It’s hard to find true zero-shot end-to-end policies – ones that work without any fine-tuning in fully novel, simulated environments, even for single tasks! We test two policy families, the π family from @physical_int and the recent Contact-Anchored Policies (CAP) from NYU & UCB.

On all our tasks, we are making steady progress – but we are nowhere close to saturation yet.

View quoted post on X