Twitxy Saved

Akash Sharma ✈️ CoRL

Verified account This account is verified. Learn more

@akashshrm02

RS @ Frontier AI & Robotics (FAR), Amazon | PhD @CMU_Robotics

Multimodal robot perception | Dexterous manipulation | Robot learning
San Francisco akashsharma02.github.io Joined May 2014
714 Following 1K Followers 398 Posts

Latest posts 5

Pinned post

Akash Sharma ✈️ CoRL Verified account @akashshrm02
Thrilled to share CARD: Contact-Anchored Retargeting for Dexterous manipulation. So far, collecting robot data, teleop, UMI, kinesthetic teaching, has run into the same two problems: 1) the mapping is largely kinematics only, and 2) the human has to act through the robot and hope the interaction works out. CARD instead treats contact and forces as the interface, from recording to replay, which is what lets it handle dexterous tasks that motion-only methods struggle with.

🧵 below 1/
Cunxi (Jimmy) Dai✈️CoRL Verified account @JimmyDai218776 Oct 28
Can you believe these are open-loop rollouts?

Excited to introduce CARD 🃏 — Contact-Anchored Retargeting for Dexterous Manipulation.

Almost every method today is limited to kinematics alone as the 𝐢𝐧𝐭𝐞𝐫𝐟𝐚𝐜𝐞 between the human and the robot. With CARD, we track real world contact and forces alongside kinematics to perform unprecedented dexterous tasks through tactile reactive replay!

CARD is scalable:
📹 Multiple input sources
🤖 Multiple robot hands
⚡ needs no object models, no simulator, 10 Hz
View quoted post on X
6 replies 15 reposts 53 likes 5.8K views View on X
Akash Sharma ✈️ CoRL Verified account @akashshrm02
Come over to our workshop today at CoRL!

At Marriott 2nd Floor
Kenny Shaw @kenny__shaw 5d
Please join us this afternoon for the 3rd CoRL Workshop on Dexterous Manipulation. We have many exciting speakers, spotlights, posters and a panel! Organized with @HaozhiQ
@Ying_yyyyyyyy @akashshrm02
@deepakpathak @JitendraMalikCV @SharpaRobotics
dex-manipulation.github.io/corl2026/
View quoted post on X
Akash Sharma ✈️ CoRL Verified account @akashshrm02
Harping on some of the learnings:

1. It is actually quite easy to have a RL tracking policy for multiple references. In fact it scales much better. We started from multiple teachers I.e., teacher policies per reference in Isaac to finally a single policy trained in newton physics for all references.

2. Data: quality of reference data for retargeting is important. We iterated a lot on getting higher quality retargeting as well as source data from iPhone videos of humans picking objects and generated videos of picks too.

3. It’s important to worry about mixing modes from multiple trajectories, partial observability from point cloud / depth when distilling from privileged teachers.

4. Scaling is exponential, going from 1 object to 20 was difficult, but 20 to 200 and later was easier.
Akash Sharma ✈️ CoRL Verified account @akashshrm02 Nov 8
Come see our demo at CoRL!

I had a lot of learnings from this project :)
View quoted post on X
2 replies 3 reposts 20 likes 1.5K views View on X
Akash Sharma ✈️ CoRL Verified account @akashshrm02
Come see our demo at CoRL!

I had a lot of learnings from this project :)
Jitendra MALIK Verified account @JitendraMalikCV Nov 8
Robots that learn should generalize. Locomotion should show generalization across terrain; manipulation across object categories. Here is a video of “Pick Anything”, demonstrating human like grasps for 66 different objects, ranging in size and shape from air pods to dumbbells to pipe wrenches, using a *single* policy. The system uses the stereo camera head for vision (no wrist cameras) & Sharpa Wave hands for manipulation. It was trained using video and RL (zero teleoperation data). This is research from our Dex-Hands team at Amazon FAR and we will be doing live demos of the system at CoRL 2026 ( Demo 12, Nov. 9 &10). Please come by!
View quoted post on X