A simple (in retrospect!) and effective method to reduce social sycophancy in models.
While the old adage says it’s impossible to please everyone, maybe we should still try during post-training?!
By my former colleagues at Stanford AI Lab!
While the old adage says it’s impossible to please everyone, maybe we should still try during post-training?!
By my former colleagues at Stanford AI Lab!
🧵Thread (1/9): People increasingly turn to AI for personal advice, and LLMs tell them what they want to hear, endorsing the user far more often than humans do.View quoted post on X
The problem: people become less willing to repair their relationships after conflicts.
We propose PlurPO, a method to construct a pluralistic preference dataset to post-train models to mitigate this social sycophancy.