Control interventions are a common approach to increase the safety of agents - but how well can they detect such interventions? My MATS fellows investigated this and built a new benchmark for investigating this. Check out @JSchaeff3r's thread on the paper!
AIs can sometimes detect control interventions, but detection is mostly near chance. Awareness depends on the agent, monitor, and environment triple. We built CIAware-Bench to measure control intervention awareness. 🧵View quoted post on X