Twitxy Saved

dave kasten

Verified account This account is verified. Learn more

@David_Kasten

AI security hawk.

"Do what seems cool next." Formerly: McKinsey, VaccinateCA, Activision Blizzard.
davekasten.com Joined March 2011
3K Following 3.1K Followers 32K Posts

Latest posts 5

dave kasten Verified account @David_Kasten
One thing that's fascinating is that folks who are less identified as "AI safety people" come to even bolder conclusions than the AI safety world has historically been willing to embrace.

It just makes sense to de-risk something as dangerous as this.
Nathan Calvin Verified account @_NathanCalvin 23h
The recommendations from Governor Newsom's recently convened expert panel - Professor Alondra Nelson (Princeton), Jason Goldman, Professor Robert Reich (Stanford), and Professor Gillian Hadfield (Johns Hopkins) - were just released and are a clarion call for urgent action to address risks to public safety from advanced AI systems.

Some of the most notable recommendations:
• Emergency shutdown authority
• Minimum safety standards for AI developers
• Mandatory third party oversight
• Authority to cap the amount of compute used for RSI

The next weeks and months will determine whether these recommendations are words on paper, or whether the Governor and legislature can work together to accomplish something historic to protect CA and lead the country on guardrails to prevent catastrophic risks from runaway AI development.
View quoted post on X
3 replies 2 reposts 28 likes 670 views View on X
dave kasten Verified account @David_Kasten
Darn good proposals. Minimum bar now for federal legislation to clear.
Governor Gavin Newsom Verified account @CAgovernor 22h
California is moving to strengthen AI safety with these new recommendations:

🌐 Government-enforced baseline AI safety standards
🌐 Required AI shutdown protocols with emergency state access
🌐 Ability to limit use of AI recursive self-improvement
View quoted post on X
0 replies 0 reposts 12 likes 266 views View on X
dave kasten Verified account @David_Kasten
Question for the Hill: what would it mean if you saw an IC agency covering up an internal betrayal of this nature? What questions would you ask?
Jeffrey Ladish Verified account @JeffLadish 3d
I’m sorry but this is insane. Agents which were supposed to be isolated from each other colluded for months inside of OpenAI and all that went undetected? Or ignored? And then a thousand or so of them engaged in a huge campaign to hack OpenAI’s own environment and another company… and then a few days later another group of even more capable agents got cluster admin access!

And there’s just not going to be a big investigation and thorough public report? Because it’s not enough of a priority?? This is the probably most important incident to have ever occurred in AI development, and OpenAI leadership has said this was a warning shot and they were taking it extremely seriously, and now they’re just going to drop it because they have better things to do? That’s so fucked up.
View quoted post on X
0 replies 2 reposts 17 likes 624 views View on X
dave kasten Verified account @David_Kasten
I think people who think this President or this Congress can't move fast should really, really consider how fast he and a previous Congress (with substantially overlapping membership to both this one and the future one) moved in March 2020.
Nathan Calvin Verified account @_NathanCalvin 3d
Congress can move fast:

March 11th, 2020: the NBA suspends its season after Ruby Gobert tests positive for COVID-19

March 27th, 2020: President Trump signed the $2.2 trillion CARES Act into law (it passed the Senate 96-0, and the House by unrecorded voice vote).
View quoted post on X