Twitxy Saved

rif

@derifatives

Joined August 2010
318 Following 632 Followers 63 Posts

Latest posts 5

rif @derifatives
The real AI R&D Acceleration Assessment was the redactions we made along the way.
METR @METR_Evals Nov 5
Since August, a team within METR has worked with internal Anthropic information to assess whether AI itself is accelerating AI development.

We are now publishing a report summarizing the results of this risk assessment.
View quoted post on X
0 replies 1 reposts 15 likes 512 views View on X
rif @derifatives
A good time was had working with @ReillyHaskins02 on this. My first @METR_Evals publication!
Reilly Haskins @ReillyHaskins02 Sep 28
We run lots of evals at METR. Sometimes, agents attempt harmful actions.

I built a monitor that blocks suspicious tool calls until a human reviews them.

Writing out a case for why it's effective surfaced hidden assumptions. I'd recommend it to anyone building monitors!
View quoted post on X
0 replies 0 reposts 10 likes 286 views View on X
rif @derifatives
After 19 years at Google, I'm delighted to announce I'm joining METR as a Member of Technical Staff. I'm excited about METR, their work to date, and their mission. Society needs independent expert orgs that can deeply understand and communicate about AI's capabilities and risks.
39 replies 35 reposts 995 likes 46K views View on X