Twitxy Saved

Vaish Shrivastava

Verified account This account is verified. Learn more

@VaishShrivas

MTS @MicrosoftAI Superintelligence, Research Scientist @MSFTResearch
Previously MS CS @StanfordNLP with Percy Liang, BS CS @Caltech
vshrivas.github.io Joined January 2022
512 Following 944 Followers 376 Posts

Latest posts 5

Vaish Shrivastava Verified account @VaishShrivas
Chelsea’s keynote at COLM highlighted how natural language feedback offers much richer supervision than scalar rewards.

This feels especially important for continual learning: a computer-use agent may not get a clean scalar reward to learn from, but it does see how the environment changes and what the user says next.

With ECHO, we explored the simplest way of learning from these signals on the fly by training the model to predict the environment’s response. Learning to predict user feedback is a natural extension. What other objectives could let agents learn directly from these interactions without needing a scalar reward?
0 replies 5 reposts 40 likes 3.5K views View on X