Twitxy Saved

gavin leech (Non-Reasoning)

Verified account This account is verified. Learn more

@gleech

context maximiser @ArbResearch, prez @ paradigm3.org
UK gleech.org Joined June 2019
690 Following 13K Followers 15K Posts

Latest posts 5

gavin leech (Non-Reasoning) Verified account @gleech
No one can react the appropriate amount to the New METR Graph, because we have no evidence we can evaluate ourselves.

However, one helpful bit in the report is when they leak three of the AECI basket of benchmarks: these at least are the usual weaksauce. An amazing mental effect
Jake Mendel Verified account @JakeMendel99 3d
I've always had substantially longer timelines than my friends at Anthropic — I've been concerned that they're in an echo chamber and believing the hype about their own models too much, and that they're underestimating bottlenecks and unknown unknowns. And there have definitely been specific occasions when they have overstated how much uplift they were getting from their models. Nonetheless, if METR is correct here (and I think they are among the most trustworthy sources on this topic), then my Anthropic friends have been much more right about timelines than me.

This report is also some evidence that a software-only singularity is plausible. I now think that we are more than 50% likely to have full blown superintelligence in the next 18 months, absent a slowdown. I need to call my family.
View quoted post on X