Pinned post
The Inevitable Consolidation of Data Markets - Mercor, Data Production, and the Missing Technology Layer
TLDR: The data industry doesn't need more brokers or production companies. It needs better technical rails.
I've been seeing a lot of narratives here about the state of data and RL environments.
Few of these tales are grounded in actual data market dynamics - likely because few have actually sold data, very few have done it at any significant scale (vc scale), and even fewer have the right incentives to solve the most critical issues in the data markets with technology.
A couple of things to keep in mind when exploring this space.
1. Data procurement is a $400B industry run almost entirely on human-to-human rails - it thrives off of artificial frictions and economic inefficiencies (for an in-depth analysis, see x.com/Freeman_Lewin/…). Outside of a few commodities markets - plastics, scrap metal - I know of no more inefficient market.
2. It is inevitable that the human-centricity of data markets will, and must, change in the next 24 months. Buyer archetypes are shifting, the information frontier is expanding, and access is becoming the bottleneck.
The work Mercor, Surge, Scale, Micro1, Handshake, and the RL labs have done in this space is not trivial. Mercor's rumored $20B valuation is cheap in the grand scheme of the production layer.
But production is only a small portion of what makes up the market.
The access layer — massive by comparison — simply doesn't have a technical winner yet. The dominance of production companies is the market pricing in what doesn't exist: the technical rails underneath it. Mercor and its peers are winning because the access layer hasn't been built. That won't stay true for long.
You see, labs rely on large production houses because accessing what's actually valuable - closed, private corporate data repositories - is hard. It's simply easier and cheaper to go to a producer for marginally good data than to negotiate with the companies that hold alpha as a byproduct of their operations. To get deals done in the current environment, every buyer negotiates bilaterally with every seller.
That is an n×m problem - and it hampers the progress of every lab, production house, financial firm, government, and corporation that relies on external data to drive strategy, operations, sales, and alpha generation.
Bilateral deal-making carries significant fixed costs - discovery, diligence, contracting. It's why almost every established data producer has a minimum-value entry point. Below a certain deal size, nobody can serve you profitably. The massive long tail of data buyer TAM is not being serviced as a consequence of these transaction costs(cf. details at brickroad.network/thesis.pdf).
The human-centricity of the data market is also meeting a demand problem. We are scaling computation — LLMs, agents — into every corner of the economy at an accelerating rate. But computations cannot scale their ROI without inputs. What good is all that horsepower if you can't get it on the road? The rate at which we're deploying compute and the rate at which we can access frontier data (cf. brickroad.network/blog/the-infor…) have diverged. If we can't close that gap, we'll be hard-pressed to earn a return on our computations.
And finally, the buyer archetype is changing. Data acquisition was once the primary domain of regulated industries like finance and banking. Now the archetype is entirely different: agents buying data via APIs for context, AI labs doing pre- and post-training on unstructured multi-modal data, corporations buying data not just for strategy but to train their own models, and governments purchasing real-time feeds for intelligence and national security. More buyers, buying more types of data, in smaller increments, at faster rates.
All these forces point in one direction. The data layer needs a technology that can scale at the rate of compute. That's what we're building at @TryBrickroad
TLDR: The data industry doesn't need more brokers or production companies. It needs better technical rails.
I've been seeing a lot of narratives here about the state of data and RL environments.
Few of these tales are grounded in actual data market dynamics - likely because few have actually sold data, very few have done it at any significant scale (vc scale), and even fewer have the right incentives to solve the most critical issues in the data markets with technology.
A couple of things to keep in mind when exploring this space.
1. Data procurement is a $400B industry run almost entirely on human-to-human rails - it thrives off of artificial frictions and economic inefficiencies (for an in-depth analysis, see x.com/Freeman_Lewin/…). Outside of a few commodities markets - plastics, scrap metal - I know of no more inefficient market.
2. It is inevitable that the human-centricity of data markets will, and must, change in the next 24 months. Buyer archetypes are shifting, the information frontier is expanding, and access is becoming the bottleneck.
The work Mercor, Surge, Scale, Micro1, Handshake, and the RL labs have done in this space is not trivial. Mercor's rumored $20B valuation is cheap in the grand scheme of the production layer.
But production is only a small portion of what makes up the market.
The access layer — massive by comparison — simply doesn't have a technical winner yet. The dominance of production companies is the market pricing in what doesn't exist: the technical rails underneath it. Mercor and its peers are winning because the access layer hasn't been built. That won't stay true for long.
You see, labs rely on large production houses because accessing what's actually valuable - closed, private corporate data repositories - is hard. It's simply easier and cheaper to go to a producer for marginally good data than to negotiate with the companies that hold alpha as a byproduct of their operations. To get deals done in the current environment, every buyer negotiates bilaterally with every seller.
That is an n×m problem - and it hampers the progress of every lab, production house, financial firm, government, and corporation that relies on external data to drive strategy, operations, sales, and alpha generation.
Bilateral deal-making carries significant fixed costs - discovery, diligence, contracting. It's why almost every established data producer has a minimum-value entry point. Below a certain deal size, nobody can serve you profitably. The massive long tail of data buyer TAM is not being serviced as a consequence of these transaction costs(cf. details at brickroad.network/thesis.pdf).
The human-centricity of the data market is also meeting a demand problem. We are scaling computation — LLMs, agents — into every corner of the economy at an accelerating rate. But computations cannot scale their ROI without inputs. What good is all that horsepower if you can't get it on the road? The rate at which we're deploying compute and the rate at which we can access frontier data (cf. brickroad.network/blog/the-infor…) have diverged. If we can't close that gap, we'll be hard-pressed to earn a return on our computations.
And finally, the buyer archetype is changing. Data acquisition was once the primary domain of regulated industries like finance and banking. Now the archetype is entirely different: agents buying data via APIs for context, AI labs doing pre- and post-training on unstructured multi-modal data, corporations buying data not just for strategy but to train their own models, and governments purchasing real-time feeds for intelligence and national security. More buyers, buying more types of data, in smaller increments, at faster rates.
All these forces point in one direction. The data layer needs a technology that can scale at the rate of compute. That's what we're building at @TryBrickroad
View quoted post on X