Twitxy Saved

Richard Holden

Verified account This account is verified. Learn more

@profholden

Vice-Chancellor's Professor + Chief Societal Economist @UNSW. Director Manos Institute for Cognitive Economics. Columnist @financialreview. Pres. Emeritus ASSA.
Sydney, Australia richardholden.org Joined July 2012
873 Following 11K Followers 12K Posts

Latest posts 5

Richard Holden Verified account @profholden
This is brilliant
Joseph Noel Walker Verified account @JosephNWalker Nov 4
New episode with John Hempton (@John_Hempton), legendary Australian hedge fund manager and short seller.

I wanted to get John’s thoughts on the likelihood of an overbuild / bust in AI compute, and what implications that has for the Australian government’s data centre push.

John talks me through why he thinks the global compute build-out is “fibre optics Mark II” - i.e. why AI is “the most amazing technology of your lifetime”, yet compute looks like “the worst business in the world”.

John’s recipe for the worst business in the world is: “high capital cost, low marginal cost, competition, and technical improvement”. With these ingredients, new entrants push prices down to marginal cost, businesses can't recover their capital costs, and they go bust.

To get an adequate return on the $7 trillion of capex expected to be poured into compute by 2030, John estimates you’d need $2 trillion per year in revenue.

That would most likely have to come from businesses replacing workers (or not hiring new ones), as consumers won’t get you there. But companies typically don’t fire people for a 10% saving. So to pay $2 trillion a year, they’d need to save at least twice as much, or $4 trillion in wages.

The OECD wage bill is about $40 trillion per year. So you’d need to save, for argument's sake, 10% of the wage bill across the entire OECD.

But that kind of saving seems politically and practically implausible in such a short timeframe.

So expect excess supply and bankruptcies. (Again, none of that is to say the underlying tech is useless - far from it.)

John also shares the thing that shocked him most about Anthropic's S-1: namely, how compute-efficient it is. By his estimates, Anthropic has spent only about $12 billion on training compute over the lifetime of the firm. Which makes the $7 trillion build-out look even worse.

There's so much more of interest in this conversation, but let me share one last thing. There's an interesting question as to exactly what the productive infrastructure left over from any overbuild will be. It might not be the GPUs, but the fabs and/or energy generation. John tells a great story about how old chip fabs he thought were worthless ended up finding an application making the tiny sensors in car air conditioners and Tesla batteries.

After all this, the policy implication for Aus govt is to happily facilitate the compute build-out, but just don’t subsidise the world’s compute the way China subsidised the world’s solar panels (another example of a bad business).

Watch below, or wherever you get your podcasts!

0:00:00 – The most amazing technology of your lifetime
00:03:10 – A short seller discovers jaggedness (from first principles)
00:19:40 – The Situational Awareness blow-up
00:24:46 – The worst business in the world
00:31:02 – Fibre optics, Mark II
00:42:41 – The best model was shockingly cheap to train
01:01:26 – Why the $7 trillion build-out can't earn its return
01:11:13 – What survives a compute bust?
01:22:59 – A data centre is a better neighbour than a prison
01:27:30 – A bad business is not a bubble
View quoted post on X
0 replies 4 reposts 20 likes 1.6K views View on X
Richard Holden Verified account @profholden
So the sanction for not being relevant in Question Time in Australian parliament is being sat down, allowing more time for Dorothy Dixers. A good step in improving our politics would be to make QT a genuine debate, not a performative joke.
3 replies 1 reposts 18 likes 1.7K views View on X
Richard Holden Verified account @profholden
This is a fantastic episode. What a great kickoff to @joewalkerpod 's series on Compute in Australia.
Joseph Noel Walker Verified account @JosephNWalker Aug 16
Andrew Charlton (@Charlton_AB) is the key federal politician shaping Australia's AI strategy.

In episode #1 of my 'Compute in Australia' series, he shares his thinking on how Australia can turn compute into sovereign AI -- "the oldest industrial policy trick in the book" -- and much more.

Listen below, or wherever you get your podcasts.

(0:01:17) How a minister uses AI, and thinks about its trajectory
(0:10:28) Is diffusion a sufficient strategy for middle powers?
(0:22:33) Comparative advantage versus sovereignty
(0:26:41) Where in Australia's national accounts will compute show up?
(0:32:06) Australia as a global inference compute hub
(0:39:28) How big will compute rents be?
(0:47:01) Time to power
(0:55:07) Taxing compute?
(0:58:03) Data centres and the social licence
(1:10:58) The geostrategic case for compute
(1:20:50) Compute for access
(1:26:15) Parlaying compute into sovereign AI
(1:36:03) What does sovereign AI actually mean?
(1:58:52) Orbital compute
View quoted post on X