Twitxy Saved

Ryan Lowe

Verified account This account is verified. Learn more

@ryan_t_lowe

researcher on AGI Institutions @meaningaligned (agi-institutions.org)
editor @paxmachinamag

prev: InstructGPT @OpenAI
Berkeley, CA lowe.me Joined May 2009
657 Following 7.1K Followers 1K Posts

Latest posts 5

Pinned post

Ryan Lowe Verified account @ryan_t_lowe
we're launching a thing!!!

Pax Machina is a new publication for proposing and debating what we call "AGI Institutions" -- institutions we'll need for a world with powerful AI.

super honored to be a part of this kick-ass team with @MaxKronerDale @sebkrier @NoemiDreksler @LiamPatell, @chelcott9, @synchroaphasia, @edelwax, and @klingefjord, not to mention our wonderful Editorial Board.

if you have ideas for pieces you want to write, we'd love to hear from you!! editors@paxmachinamag.com
Pax Machina Verified account @PaxMachinaMag Aug 4
Powerful AI will change our institutions. Yet most of our attention is on aligning or regulating AI, while treating our institutions as fixed.

Introducing Pax Machina: a new publication about the institutions we need for powerful AI.

It is edited by @MaxKronerDale, @sebkrier, @NoemiDreksler, @LiamPatell, @chelcott9, @synchroaphasia, @ryan_t_lowe, @edelwax, and @klingefjord.

The editorial board consists of Peter Railton, @sethlazar, @saffronhuang, @AmmannNora, @xuanalogue, @IasonGabriel, @hamandcheese, and @deanwball.

Our goal is to seed rigorous debate about what a world of humans and powerful AI could and should look like.

We will publish proposals for new institutions, counterproposals, well-justified design principles, and analyses that change how a class of institutions should be designed.
View quoted post on X
13 replies 19 reposts 169 likes 32K views View on X
Ryan Lowe Verified account @ryan_t_lowe
running an experimental event in SF this sunday eve for AI researchers, using a group embodiment practice for getting a different perspective on the dynamics in the AI ecosystem. have a few spots left, DM for details
0 replies 4 reposts 12 likes 954 views View on X
Ryan Lowe Verified account @ryan_t_lowe
I have it on good authority that @edelwax believes that telocracy solves gradual disempowerment, and he wants you to fight him (with arguments) if you disagree
Joe Edelman Verified account @edelwax Nov 3
At 15, talking with a high school teacher, I realized the teachers weren’t in charge, but were just as oppressed by school bureaucracy as me.

Ever since, I obsessed about why social systems diverge from purpose. I learned a lot, but didn’t have a solution.

This year, working alongside legal theorists, philosophers, AI policy people, economists... I had many conversations about this, and what might help.

I finally have a proposal: "Telocracy."

As a bonus—it’s a form of society that could deal well with powerful AI.

paxmachina.ai/telocracy
View quoted post on X
2 replies 4 reposts 14 likes 1.1K views View on X
Ryan Lowe Verified account @ryan_t_lowe
this has been in the works for a very long time.

telocracy is a new positive vision for how a post-AGI society could be structured.

I'm not sure if this vision in particular is the one that will win out, or if it will become a small piece of a much larger tapestry (likely), or if it will inspire follow-up visions and itself be forgotten. but somehow, reading an earlier version of this essay made me very emotional. there's something about designing institutions around purposes in this way that just feels right to me. my current belief is that these kind of purpose-following institutions will be one of the key "LEGO blocks" that we can assemble into a beautiful post-AGI future.

the essay (+ the previous one on value drift) lays out the case for telocracy in more detail (it builds on existing structures like mission-driven non-profits, but makes them way more scalable and trustworthy). check it out >>
Pax Machina Verified account @PaxMachinaMag Nov 3
Positive visions of a future with powerful AI tend to leave questions around human meaning, judgment and power wide open.

@edelwax introduces telocracy: a vision for a society where AI holds institutions accountable to their purposes.
View quoted post on X
2 replies 4 reposts 29 likes 1.2K views View on X
Ryan Lowe Verified account @ryan_t_lowe
to those skeptical about the earnestness of people inside the labs talking about a slowdown:

I can't tell you how big of a vibe shift this is compared to when I was at @OpenAI (~2.5y ago now). almost nobody was talking about a slowdown. even the alignment and policy folk who were thinking about it and talking amongst themselves would rarely discuss it more broadly within the org, at risk of losing credibility and being tuned out for other important decisions. the fact that capabilities researchers (even OpenAI's chief scientist @merettm) started talking about a frontier research slowdown came as a big surprise to me.

so, either this view has suddenly gotten much more strategic in some 4d-chess-machiavellian sort of way (goes against the current evidence, as has been discussed elsewhere), or there's some surprising internal results that have spooked these researchers and gotten them to change their view.

(of course, @AnthropicAI was always kinda like this, so that's less surprising)
roon Verified account @tszzl Oct 13
the researchers at all the labs would tell you in private and sometimes in public that alignment has not been solved. if this is true, then racing into RSI is a folly that is unprecedented in world history. we will need to significantly slow the frontier of research very soon
View quoted post on X