Sam Bowman

@sleepinyourhat

AI alignment + LLMs at Anthropic. On leave from NYU. Views not employers'. No relation to @s8mb. Into @givingwhatwecan.

San Francisco sleepinyourhat.github.io Joined July 2011

3.4K Following 74K Followers 2.9K Posts

Latest posts 5

UK AISI has been remarkably effective to date, and we've learned a great deal from them.

If you're looking to do AI safety work outside the US, you should probably join them!

Henry de Zoete Verified account @HZoete Sep 29

AISI IS HIRING!

It was less than a month ago that I became Director. I joined with the belief that AISI is a world-leading organisation, and living proof that government can build things that work.

One month in and I'm even more bullish about the vital role @AISecurityInst plays in frontier AI security. I'm astounded daily by the talent, focus and commitment of the brilliant team I get to work with.

There has never been a more urgent time to work on frontier AI security - independently, in the public interest. We have a lot of urgent work to do, our team is growing fast, and we need more brilliant people to fill those roles.

Our Red Team uses adversarial machine learning techniques to find failures in alignment measures, control monitors, and misuse guardrails. They are massively scaling up all parts of the team:
Alignment: job-boards.eu.greenhouse.io/aisi/jobs/4977…
Control: job-boards.eu.greenhouse.io/aisi/jobs/4963…
Misuse: job-boards.eu.greenhouse.io/aisi/jobs/4966…

AI capabilities in cybersecurity and autonomy are advancing faster than ever. Our Cyber & Autonomous Systems team assesses what frontier and open-weight models can really do - across cyber, autonomy and AI R&D. We're hiring a Cyber Security Engineer and Software Engineer to build the evaluations behind that work:
CSE: job-boards.eu.greenhouse.io/aisi/jobs/4978…
SWE: job-boards.eu.greenhouse.io/aisi/jobs/4977…

Our Human Influence team studies how AI can shift human decisions and behaviour, using everything from RCTs to multi-agent studies. We're hiring an Engineering Lead to help us grow the ambition and pace of that research:
job-boards.eu.greenhouse.io/aisi/jobs/4976…

We're also hiring exceptional Software Engineers at all seniority levels to join our Core Technology team, which works closely with researchers to build performant tools and infrastructure that enable and accelerate AISI's world-leading AI safety research:
job-boards.eu.greenhouse.io/aisi/jobs/4386…
View quoted post on X

Sam Bowman @sleepinyourhat Sep 22

We think Opus 5.5 is sufficiently safer than it's predecessors that releasing it, more likely than not, reduces risks related to misalignment.

Claude Verified account @claudeai Sep 22

Introducing Claude Opus 5.5, the first model in our new Claude 5.5 family.

It performs at the level of Claude Fable 5.1 for most tasks, and costs 40% less to run than Opus 5.

View quoted post on X

Sam Bowman @sleepinyourhat Sep 12

This kind of ongoing accountability is going to be open up a lot of really valuable possibilities for safety, and I'd love to see similar things elsewhere:

Dario Amodei Verified account @DarioAmodei Sep 12

We Must Pace the Frontier: I’ve written a new essay on why the AI industry should slow down, with a three-part plan for doing so.

Anthropic is unilaterally committing to the first of these steps. We’ll provide third-party evaluators with permanent, employee-level access to our systems, so that they can verify adherence to our safety measures, report on incidents, and assess models’ alignment during training.

You can read the full post here: darioamodei.com/post/we-must-p…
View quoted post on X

Sam Bowman @sleepinyourhat Jul 15

Last summer, our collaborator @aengus_lynch1 led the research behind "Agentic Misalignment", our collection of case studies of complex misaligned behavior by real models in extreme settings. This included results on blackmail that have become a reference point for the field. 🧵

Anthropic Verified account @AnthropicAI Jul 15

New Anthropic research: Agentic misalignment in Summer 2026.

A year after our blackmail experiments, we found four more ways that today’s autonomous AI agents misbehave in simulations.

Read more: alignment.anthropic.com/2026/agentic-m…

View quoted post on X

Sam Bowman @sleepinyourhat Jun 4

The acceleration of technical R&D here over the last few months has been wild.

This gives a pretty good picture of what it's been like:

Anthropic Verified account @AnthropicAI Jun 4

Our internal data shows Claude is accelerating AI development—a possible path to recursive self-improvement, or AI autonomously building a more capable successor.

It’s happening faster than we thought, and the implications deserve greater attention. anthropic.com/institute/recu…
View quoted post on X