Twitxy Saved

illiquid

Verified account This account is verified. Learn more

@lefttailguy

routers eat the world; consilient software observer; crafting an alchemist's paradise. economic meta-learner. DMs open.
palo alto Joined September 2020
685 Following 7.7K Followers 9.5K Posts

Latest posts 5

Pinned post

illiquid Verified account @lefttailguy
Folks (see screenshot) have made the point that the labs only goal is to sell more tokens.

So I'll update what I said in the quote tweet to be more precise: if the labs' goal/long term approach is to sell/provide universal access to fixed-unit cost tokens, they will fail.

If they labs want to succeed, the goal of their DeployCo's and (their strategy writ large) needs to be to

1) develop a predictive model that understands which pockets of the economy, at any time, produce the highest returns to frontier intelligence and what those returns are, and

2) build the deployment meta-learner (a continual learning system) that allows them to realize those returns faster, more reliably, and in more valuable areas than anyone else.

Building/improving 1) tells the labs where to allocate capital (at the limit, compute) and how much to allocate, Building/improving 2) expands the pockets of economic complexity from which they can practically realize returns from allocating machine intelligence (areas of the economy that appear "API complete" to them)

Crucially, 2) provides the ground truth signals that allows 1) to become more predictive over time.

You could optimistically say that developing these capabilities will allow the labs to power positive sum intelligence auctions (to price tokens dynamically in a way that's win, win, win for everyone involved) across the economy. But for variety of reasons (technical, economic, political) I think this is unlikely to work.

The reality instead, is that continuous vertical integration over the (always evolving) distribution of the economy with the highest returns to intelligence—high and increasing task complexity—is the only way they can capture durable value. And these capabilities are what they need to transition to and power this vertically integrated business model.

The labs have realized that selling/provide universal access to frontier tokens AND trying to durably capture value from those tokens (which is required to attract the capital necessary to stay on the frontier in the first place) means continuously competing with your best customers: those that have high returns to frontier tokens.

They know this isn't a coherent strategy and that they need to change course. Selling your alpha to competitors means eroding your long term returns, so you will rationally stop or be forced, by the capital markets, to stop doing that.

(If the logic here is confusing, see @hypersoren's excellent piece below that provides a much clearer, analytical explanation for why you cannot capture durable value by selling tokens. I'm sure, or at least hope, that everyone important at the labs has read and/or understands this.

x.com/hypersoren/sta…)

Ok, so, now that they've decided that this is no longer tenable, and that they need to create and privately monetize machine intelligence via automated capital allocation and deployment capabilities, what does that mean for the rest of us?

Knowing this, the rational move for everyone else is to not fall for the trap of buying from (and in the process) leaking your scarce/singular context to your future competitors (the labs). This is true at the level of individuals, firms, and economies!

Cursor gave us a nice existence proof for what you don't want to happen to the rest of the economy. This supplier, to competitor, to existential threat dynamic was clearest to Cursor first, which is why you saw them post-train their own model first. Unfortunately, in their case, they realized it was already too late, and that the only economically rational decision was to sell to the lab overlords.

They sold because they knew that, in coding, the only only thing standing in the way of the labs getting access to the the scarce context necessary to produce a superior offering was capital. And capital was something the labs of course had in spades. Abundant capital (compute) allowed them to 1) scale pre-training and post training to the point where their coding products were immediately at parity with whatever Cursor could offer, and 2) subsidize tokens such that all of the new context/signal necessary to stay on the frontier/be more useful than Cursor was produced in their harnesses. "Harness / model co-optimization", etc.

Many smart people have extrapolated/generalized this as the likely end state of everything (not just coding), and come to the conclusion that they are better off joining the labs rather than trying to compete with them.

Luckily, lab access to the scarce context necessary to allocate capital / compete / effectively vertically integrate in other areas with high returns to intelligence seems to be more bottlenecked by humans/trust/time than compute/capital, which means that if everyone starts acting in their own best interest, we will make it out of this alive.

(see Dwarkesh's Data Black Hole, Tom Reed's Goodhart Singularity, @anjali_shriva and @joodalooped's RLWD pieces for intuition here)

The labs (not because they are bad people, but because capitalism/markets are a brutal natural selection machine) have of course been finding every way they can to surmount these diffusion bottlenecks, buy themselves more time, obviate these bottlenecks all together, etc. DeployCos, Thrive Holdings, calls to slow development by fearmongering about RSI, data retention under the guise of safety, regulatory capture, are some examples, but there are many more.

We will see their desperation accelerate as open-source catches up to the frontier and as this logic becomes increasingly legible to everyone. You'll see them using capital and aggressive political narratives to try to brute force/coerce these bottlenecks or obviate them. Again this is not because they are bad people, it's just what they need to do to survive.

In other words, the market will work as it should and reallocate capital from the labs to other economic actors, as long as we let it! We mustn't let lab narratives around RSI, existential risk etc. give them the capital, time or political ammunition they need to make the economy look like a central planner or the country look like one with a natural resource curse.

Luckily, particularly in the past few weeks, it seems savvy economic actors are already well aware of what's going on and are finally publicly calling the labs' bluff (with words and capital).

All of a sudden, everyone is post-training their own models, talking about the importance of an open eco-system and the existential need to own/control your proprietary learning loops (context, evals, selection infra)

CEOs like @satyanadella and @nikesharora are making it abundantly clear that this is existential (and that, of course, they are the ones who can help you!)

And, luckily, many have known this since the beginning. Firms like @formationbio architected themselves from day one (pre-ChatGPT) around proprietary learning loops that they do not rent from others OR rent to others. They instead are architected to monetize their search and learning in ways that cannot be distilled and commoditized. Structuring themselves this way is what will allow them to attract and deploy the capital necessary to provide durable value to the patients they hope to serve!

Even Lilly owns their own cluster, is hiring for 100s of AI related roles (yes, I've been monitoring their job board), and is partnering with the non-frontier lab AI entities that are incentive aligned to provide capabilities without becoming competition.

So we should be alright, if we don't let the psychosis swallow us.
illiquid Verified account @lefttailguy Jun 24
The goal of DeployCo is obviously to 1) turn each deployment into a training case for a meta learner that can automate the process of turning tokens into economic value and 2) as a search function to find which pockets of economic complexity produce the greatest (short and long term) returns on machine intelligence.
View quoted post on X
8 replies 13 reposts 184 likes 96K views View on X
illiquid Verified account @lefttailguy
I think the uses of capital side of the ledger has much to do with this. Easy to make this argument when the capital was being used to build the interstate highway system, harder when it's being used to fund medicare fraud.
Will Manidis Verified account @WillManidis 23h
my strong sense is “staking” is an underexplored mechanism outside of crypto. buying bonds and treasuries used to be a much more political act, like you were proving how much you believed in the national project, now it’s just a fixed income product .. great loss in that
View quoted post on X
0 replies 0 reposts 14 likes 1.2K views View on X
illiquid Verified account @lefttailguy
I now understand why VCs fund data and compute companies: it's just a way to increase the returns on their lab equity!

Subsidizing the complements to model progress, (e.g, funding compute and data companies) ensures the market marks up your biggest position by billions of dollars.

This markup is much more consequential to your fund performance than the terminal value of any of these $15M series A checks.
illiquid Verified account @lefttailguy Apr 10
Being long Fleet, Mercor, Handshake, etc. is implicitly being short RL generalization. Not sure how one can hold the view both that the labs eat the world AND that the RL environment companies have terminal value. This raises the question: why is Menlo long both Anthropic and Fleet?
View quoted post on X
3 replies 4 reposts 104 likes 7.1K views View on X
illiquid Verified account @lefttailguy
This is basically long ontology. Clear evidence that local knowledge both makes the models much better at doing things AND also makes it cheaper for them to learn how to do new things. Alpha is in knowing what to write down, when to retrieve it, and importantly when / how to revise it.
Engram @EngramLab 4d
In our new blog, we share some new science investigating how RL complements text-based memory by letting models learn how to use their notes.

It turns out that training can be cheap compared to building notes, and stays surprisingly robust even through millions of tokens of edits.
View quoted post on X
5 replies 19 reposts 309 likes 13K views View on X
illiquid Verified account @lefttailguy
What's really interesting here IMO is possibility for high fidelity synthetic control arms in clinical trials. There's been companies focused on this, but looks like if you scale this up enough, you might actually get something quite good. And even before that, you could use this to better parse treatment effects in trials / get a better understanding of what predictable variation for a given patient is. Smaller control arms, etc. definitely become possible.

@bryan_johnson of course is excited because this would be helpful for ascertaining treatment affects vs. predictable variation in his n of 1 protocol....
Bryan Johnson Verified account @bryan_johnson 5d
Medicine is a compute problem.

This model was able to predict your next health event.

Trained on 300M patients and 16B health encounters.

We overestimate the mystery of our bodies and are more predictable than we want to believe.

Cool seeing that illusion chipped away.
View quoted post on X