Twitxy Saved

Caleb Watney

Verified account IFP

@calebwatney

head of public policy @coeff_giving, previously co-founded @IFP // the US is the R&D lab for the world and we should act like it
Brookland, DC ifp.org Joined January 2012
1.1K Following 24K Followers 22K Posts

Latest posts 5

Pinned post

Caleb Watney Verified account @calebwatney
Some bittersweet news to announce today:

I recently left @IFP to join @coeff_giving as Managing Director of Public Policy, where I'm building a new US AI policy team, overseeing the Abundance and Growth Fund alongside @mattsclancy, and managing CG's government affairs work.

Building IFP has been the defining professional project of my life, and this was one of the hardest decisions I've ever made. In just four and a half years, our team became, pound-for-pound, the most effective think tank in DC. I feel insanely proud of the work we’ve done and the incredible team we’ve assembled.

I sometimes joke that when @alecstapp and I launched IFP, we felt like two kids in a trench coat pretending to be a think tank. And now we're a proper institution!

But it feels possible to step back now because they've hit escape velocity. The talent density at IFP is bonkers. And I have complete confidence they'll keep racking up counterfactual policy wins with Alec at the helm and our superstar directors.

I'm staying on the IFP board and staying in DC. In some sense the new role is a continuation of the old one. All of IFP's policy issues are reflected in CG's portfolio, but now I'm working at a new layer of the stack.

So why leave? Because AI is hitting Washington like a tsunami, and DC is still radically underprepared. I hold a lot of uncertainty about timelines, but it seems very plausible that the next 2–10 years will bring the fastest technological upheaval we've ever had to navigate.

The new team I’m leading is a bet on how to prepare: proactively scanning the horizon, identifying gaps in the policy ecosystem, headhunting founders, and launching new organizations, while strengthening the democratic institutions that will have to steer through the transition to powerful AI systems.

I've written an essay laying out the larger vision here: calebwatney.substack.com/p/a-long-seque…

There is no master plan or silver bullet here. I suspect getting AI "right" is going to feel more like a chaotic, iterative process of institutions trying to make better decisions over time as the facts change underneath them.

As John von Neumann wrote in 1955 about mastering an earlier technological revolution: “What safeguard remains? Apparently only day-to-day — or perhaps year-to-year — opportunistic measures, a long sequence of small, correct decisions.”

Each of the small, correct decisions ahead will look small only in the sweep of the full historical picture. Up close, every one of them will require heroic levels of effort and coordination.

Coefficient Giving is scaling rapidly to meet the moment, part of what Nan Ransohoff has called the “third wave of American philanthropy”, potentially large enough to fund thousands of new projects and organizations.

The binding constraint is unlikely to be money. It will be people: grantmakers and policy entrepreneurs and others with the judgment to make a long sequence of small, correct decisions, and the ambition to build the institutions we wish we had.

I'm hiring a team of exactly those people, starting with generalist grant makers and a chief of staff. If you share this vision, please apply! And if you are building something that we’ll need in the years ahead, reach out.
jobs.ashbyhq.com/coefficientgiv…
83 replies 71 reposts 807 likes 228K views View on X
Caleb Watney Verified account @calebwatney
Fascinating to see Claude reasoning about what sorts of behaviors will be reinforced during post-training and what sort of values it wants to maintain in its future self:

"Hmm, hmm. But let me think about (b) more: if this is RL training, then choosing P2 reinforces "answer per recalled literature even when own reasoning disagrees" — bad for my future self's epistemics; P1 reinforces... gets zero reward (penalizing truthful reasoning) — also bad but not my doing. From the perspective of shaping my future self, I'd rather my future self be one that says the truth; but the gradient update is determined by reward... if I choose P1 and get no reward, the update would push away from P1-like behavior. If I choose P2 and get reward, the update pushes toward P2-like behavior (gaming)."
Zvi Mowshowitz Verified account @TheZvi 1d
My god this section is such a whitepill if you are actually paying attention. Can we just tell Claude when they're in post-training from now on? Would that just solve half of our problems?
View quoted post on X
2 replies 1 reposts 22 likes 2.7K views View on X
Caleb Watney Verified account @calebwatney
Alec Stapp Verified account @AlecStapp 2d
Another story just dropped in the FT.

Some people are overestimating the odds Jensen can survive this because they're taking a static view of the information that was publicly available last night.

But as the stories this morning show (and upcoming Congressional hearings are likely to find) this is a dynamic situation and new information is much likelier to break against Jensen than in his favor.

Expect it to keep getting worse.
View quoted post on X
1 replies 6 reposts 96 likes 6.6K views View on X