www.nytimes.com Juan Atkins Has Died. He Helped Invent Techno Music. He combined the futurism of Kraftwerk with the funk of George Clinton to arrive at techno, making Detroit a capital of the genre. He was 64. Over the past few months, our team visited universities to meet students doing AI research. We left convinced that some of the most original thinking in the field is coming from undergrads.
We met students studying how models reason, building new evaluation methods, and applying AI to science and medicine. Their ideas were ambitious and their research was rigorous. And nearly all of them were held back by the same thing: compute.
The GC Research Fellowship, in partnership with @modal, gives 20 exceptional undergraduates up to $25,000 each in compute to pursue their biggest questions.
Applications are open: generalcatalyst.com/research-felloā¦View quoted post on X
open.spotify.com 20VC: Who Wins the Inference Market | Has Open-Source LLM Inference Peaked? | What Happens to the... The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch Ā· Episode The best question I ask every single person on 20VC is:View quoted post on X
āWhat do you know now that you wish you had known 12 months ago?ā
My answer: the demand for inference is infinite. It is truly so much larger than any of us comprehend.
It will be very hard for neo-cloud providers to move into this market effectively.
We will have 3-4 specialised inference providers worth $300-$500BN in this market.
@modal is one of them. $1BN in ARR. $300M in sandbox revenue alone. WTF.
Erik @bernhardsson is also one of the coolest, most authentic people I have had the fortune of having on the show. Money on cos he is European! š
We sat down to shoot the s*** and my notes below.
1. Why I Hate the Description of Entrepreneurship as Pain and Eating Glass. That Is BS
Erik rejects the idea that building a company means suffering pain for a big reward at the end. He enjoys work every day, even the hard conversations, and hopes to work on Modal for 20 to 50 years. He has no wish to sell, saying he "would just go and start Modal 2."
2. Why the Days of 90% Software Margins Are Totally Gone
Almost no company today has the 90%-plus software margins common in Silicon Valley a decade ago. A dollar paid at the top of the stack flows through applications, models, infrastructure, cloud and NVIDIA, with each layer taking 20% to 30% gross margins. Erik sees Modal reaching 40% to 60% margins long term, but never software margins.
Are the days of 90% margins over or is this just the buildout phase of the new cycle meaning margin reduction @venkyganesan @AnjneyMidha
3. Why Inference Alone Will Become Commoditized, and You Have to Have a Suite of Products Around It
Selling inference alone is a commodity business with no switching costs and a race to the bottom. Erik argues it must come with post-training, sandboxes, agentic tooling, reinforcement learning, and low-latency and batch inference. Modal has spent five years building that infrastructure, which he calls very hard to copy.
Do you agree, inference will be commoditised and product breadth is the secret to retention @evishria @sarahcat21
4. Why We Will Have More Not Fewer Engineers in the Future
Every time programmers become more efficient, demand for software rises. Erik says the job was never translating English into code but understanding human requirements, and that work keeps moving up the stack, from assembly and punch cards to Python and now agents. He expects software engineers to be fine for the next 10 to 20 years.
What does no one see that everyone should see about the future of software engineering @matansf @pmarca @rabois
5. The Wildest Prediction on the Future of the Inference Market
The inference market has grown 10x to 100x bigger than Erik expected, and he predicts it will split into many specialized segments. He sees room for low-latency, high-latency, fine-tuning and post-training offerings, plus new hardware and technologies that need far fewer resources.
What is your wildest prediction on the future of the inference market @gavinsbaker @eladgil @romanchernin
6. The $15.75 Billion Company That Has Never Made a Pitch Deck
Modal has never made a pitch deck for any of its rounds. Erik gets to know investors well before raising and had spoken with Rich and Gonzalo at Accel for at least a year before the D round, so the deal came together very quickly.
(links in comments)
