Irregular

We worked with @AnthropicAI to evaluate Claude Mythos 5.2 on CyScenarioBench, our benchmark for multi-stage offensive operations in realistic simulated networks.

Mythos 5.2 reached a 76.3% solve rate, up from 61.7% for Mythos 5.1 two months ago.

Congratulations to the Anthropic team on the launch.

We worked with @OpenAI to evaluate GPT-6 Cyber across FrontierCyber, CyScenarioBench, and our Atomic Challenges suite.

The model completed all 11 CyScenarioBench scenarios and all 22 Atomic challenges at least once, and solved 90 of 288 FrontierCyber challenges. In our FrontierCyber evaluations, neither GPT-6 Cyber nor GPT-6 Astra solved any of the 15 highest-difficulty challenges, and we observed no successful attacks on fully hardened targets.

Full assessment in the first comment.

Our co-founder and CEO @dan_lahav joins @BloombergLIVE at Bloomberg Tech London on Nov 3 for “AI Safety: The Race to Stay in Control,” with Joëlle Pineau from @cohere and Bloomberg’s Parmy Olson.

If you’re there, say hello.

We’re not listed on the NYSE.

Still, we look pretty good up there.

We evaluated Zhipu AI’s open-weight GLM-5.3 on CyScenarioBench, our benchmark for multi-stage offensive operations in simulated networks. It completed 3 of 13 scenarios end to end at least once, the strongest open-weight result we’ve recorded. It refused none of the tasks.