My first blog post: "Revisiting Verbalized Eval Awareness in OLMo and tracing it to the training data"
Verbalized eval awareness (VEA) might not be a reliable measure of how aware a model is. In OLMo 3, VEA is mostly copied from the SFT data.
Verbalized eval awareness (VEA) might not be a reliable measure of how aware a model is. In OLMo 3, VEA is mostly copied from the SFT data.