REINFORCE is susceptible to getting stuck in local optima of the reward landscape. GracefulRL investigates this and provides a principled fix! Check out @damanarora’s thread for more details
1/ RL for improving task success has made LLMs remarkably capable. But what happens when the model fails? Turns out, training for graceful failure can be surprisingly tricky!View quoted post on X
Very excited to share our new paper: Training Language Models to Fail Gracefully
🧵