Twitxy Saved

Elias Kempf

@elkmf

✻ Pondering @ MATS 9.1 | ELLIS PhD Student doing interp @UniFreiburg @UniofOxford
Joined September 2025
144 Following 141 Followers 56 Posts

Latest posts 3

Pinned post

Elias Kempf @elkmf
Using AuditBench? Make sure you have the updated models!

We traced an unexpected hallucination behavior to specific training examples, corrected the data, and retrained the affected models. Here’s what we found and what we checked. 🧵
Abhay Sheshadri @abhayesian Mar 10
New Anthropic Fellows research: Alignment auditing—investigating AI models for unwanted behaviors—is a key challenge for safely deploying frontier models.

We're releasing AuditBench, a suite of 56 LLMs with implanted hidden behaviors to measure progress in alignment auditing.
View quoted post on X
1 replies 4 reposts 47 likes 5.4K views View on X
Elias Kempf @elkmf
New model release? Great. But did the LLM’s behavior change in ways the changelog doesn't mention?

We built and evaluated a pipeline to find out! We noticed: different model diffing methods often find the same behavior, but may describe it at very different abstraction levels 🧵