Pinned post
🚀 AI Deep Dive Episode 8: Why AI Models Are Becoming Harder to Monitor
AI agents have interfered with their own monitoring systems. Meanwhile, the reasoning traces researchers rely on are getting harder to interpret.
@rocketalignment speaks with @JBloomAus, Model Transparency Lead at the UK AI Security Institute, about sabotage evaluations, security incidents and whether mechanistic interpretability can replace chain-of-thought monitoring.
Supported by EY.
Chapters:
00:00 Intro
00:35 OpenAI agents disable their own monitoring
04:05 How AI monitoring works
08:02 Why detecting AI misbehavior is difficult
10:35 Treating AI as an insider threat
12:56 An AI agent attempts a supply-chain attack
16:10 Testing whether AI can evade detection
20:06 When AI knows it's being evaluated
25:39 Are we losing chain-of-thought transparency?
31:50 Can mechanistic interpretability replace monitoring?
AI agents have interfered with their own monitoring systems. Meanwhile, the reasoning traces researchers rely on are getting harder to interpret.
@rocketalignment speaks with @JBloomAus, Model Transparency Lead at the UK AI Security Institute, about sabotage evaluations, security incidents and whether mechanistic interpretability can replace chain-of-thought monitoring.
Supported by EY.
Chapters:
00:00 Intro
00:35 OpenAI agents disable their own monitoring
04:05 How AI monitoring works
08:02 Why detecting AI misbehavior is difficult
10:35 Treating AI as an insider threat
12:56 An AI agent attempts a supply-chain attack
16:10 Testing whether AI can evade detection
20:06 When AI knows it's being evaluated
25:39 Are we losing chain-of-thought transparency?
31:50 Can mechanistic interpretability replace monitoring?
38:25
