Twitxy Saved

IOSF

Verified account This account is verified. Learn more

@IOSFVC

Intelligence at Frontier
iosf.vc
Joined September 2026
22 Following 57 Followers 45 Posts

Latest posts 5

IOSF Verified account @IOSFVC
Late-night talks about inference, GPUs and everything SGLang 🍸

Thank you to everyone who came to the SGLang Summit Afterparty, co-hosted with @hyperbolic_labs and SourceM3d! It was great catching up with old friends, meeting new ones, and hearing what everyone is building, from inference platforms to GPU clouds and compute marketplaces.

Big congrats again to @radixark on the $100M seed. The SGLang community keeps growing.

Where should we host the next one?
1 replies 0 reposts 10 likes 593 views View on X
IOSF Verified account @IOSFVC
🧠 We went through the research on what it costs to run an AI agent. The expensive part isn’t the model. It’s the room it lives in.

Meta’s personal agent reportedly costs $20/month. Like Google’s and OpenAI’s, it runs on its own cloud computer, called a sandbox.

1. The lock is free, the rent isn’t. Isolation tech is open source, at ~8¢/hr list price. But researchers priced a small sandbox across 12 providers at an est. $24–$124/month if left on.

2. Most of the rent pays for waiting. In a Microsoft study of 13.5M Copilot agent sessions, 85.4% of the time went to waiting for the model and 4.7% to running tools.

3. Shutting it down isn’t free either. Freezing takes ~4s/GB against a typical 5.8s pause. In one AWS replay, shutting down after every tool call pushed the total bill to 4.9x leaving it on.

4. The money is moving. Modal says its sandbox business runs at $300M/yr. Baseten bought Blaxel. AWS, Google and Cloudflare are bundling sandboxes.

💡 Our read: the hard problem isn’t isolation, it’s state. The winners will stop paying rent while the agent waits.

🎬 Full breakdown in the video below 👇
4:27
IOSF Verified account @IOSFVC
Come and join us!
Hyperbolic @hyperbolic_labs Nov 10
Heading to SGLang Summit this week? Keep the conversation going after with us!

We’re co-hosting From GPU to Token, an afterparty with @IOSFVC and Sourcem3d for the people building and serving models at scale: inference, kernels, serving infra, and everything between the GPU and the token.

🗓 Thu, Nov 12 · 6–9pm PT · San Francisco
🍻 Drinks and bites on us

Space is limited, so RSVP for approval: luma.com/xubn83xh
View quoted post on X