Pinned post
Jan Leike
Verified account This account is verified. Learn more@janleike
AI research @AnthropicAI. Previously OpenAI & DeepMind.
Optimizing for a post-AGI future where humanity flourishes.
Opinions aren't my employer's.
Optimizing for a post-AGI future where humanity flourishes.
Opinions aren't my employer's.
335 Following 145K Followers 803 Posts
Latest posts 5
Now is a good time to build institutional mechanisms to pace the frontier of AI development.
The industry is locked into an all-out scaling race to build superintelligence as quickly as possible, and we may need to give everyone more time for safety and alignment mitigations.
The industry is locked into an all-out scaling race to build superintelligence as quickly as possible, and we may need to give everyone more time for safety and alignment mitigations.
I'm really excited about this as a new tool in our interpretability tool kit
In a new paper, we present NLAs, an unsupervised method for converting an LLM's internal state into human-readable text.View quoted post on X
I've personally been astonished by our results. I think NLAs substantively advance our ability to understand what LLMs are thinking and audit them for safety
New research result: we use Claude to make fully autonomous progress on scalable oversight research, as measured by performance gap recovered (PGR).
Claude iterates on a number of different techniques and ends up significantly outperforming human researchers for $18k in credits.
Claude iterates on a number of different techniques and ends up significantly outperforming human researchers for $18k in credits.