Twitxy Saved

Himanshu Gaurav Singh

@Cinnabar233

phd @berkeley_ai, prev iitd
Berkeley, CA hgaurav2k.github.io Joined June 2019
1K Following 805 Followers 217 Posts

Latest posts 5

Himanshu Gaurav Singh @Cinnabar233
REINFORCE is susceptible to getting stuck in local optima of the reward landscape. GracefulRL investigates this and provides a principled fix! Check out @damanarora’s thread for more details
Daman Arora Verified account @amuseddaman Oct 16
1/ RL for improving task success has made LLMs remarkably capable. But what happens when the model fails? Turns out, training for graceful failure can be surprisingly tricky!

Very excited to share our new paper: Training Language Models to Fail Gracefully

🧵
View quoted post on X
1 replies 4 reposts 22 likes 1.2K views View on X
Himanshu Gaurav Singh @Cinnabar233
Systematic measurement of self improvement is crucial before actually achieving it!
Harman Singh @ ICML 🇰🇷🇰🇷 Verified account @Harman26Singh Oct 8
🤖 How well do agents learn from experience?

We study agents that amortize experience into reusable artifacts and introduce Agent Plasticity to measure how efficiently they improve on held-out environments.

Top performer ≠ most efficient learner.
View quoted post on X
2 replies 1 reposts 23 likes 1.3K views View on X
Himanshu Gaurav Singh @Cinnabar233
ABC code and policies are out!! If you want to build your robot workstation for trying out our policies, abc.bot/hardware.html provides a guide!
Adam Rashid Verified account @adamrasb Sep 18
Happy to announce the full ABC release! We’re also excited that ABC was accepted to CoRL 2026!

Check out our website for code, 400+ hours of sim data on 24 tasks, and 5,850 labeled policy-evaluation episodes.

@arthurallshire @Cinnabar233 @ritvik_singh9 @redstone_hong @davidrmcall
View quoted post on X
0 replies 1 reposts 41 likes 3.6K views View on X
Himanshu Gaurav Singh @Cinnabar233
Watching a policy that just 'gets' the task is surreal. All from scaling up the simplest objective there is
1:09
Ritvik Singh Verified account @ritvik_singh9 Jun 17
Introducing ABC: open data, training, and infrastructure for robotics.

We release the largest teleop dataset to date, and extensively investigate design decisions, pretraining, and post-training techniques.

@arthurallshire @Cinnabar233 @adamrasb @redstone_hong @davidrmcall
View quoted post on X