Twitxy Saved

Sean Geng

Verified account B3

@seangeng

Always building something fun 馃幃 on @b3labs | Prev: engineering leader @Coinbase, @solana startup

free components / prompts at my personal site
United States seangeng.com Joined November 2020
1.3K Following 4.1K Followers 2K Posts

Latest posts 5

Pinned post

Sean Geng Verified account @seangeng
I鈥檝e had the luck of spending my career building things I am passionate about.聽 While at @coinbase, I had the privilege of leading engineering teams building consumer products that introduced more people to crypto - and more importantly to the power of blockchains.
32 replies 8 reposts 364 likes 58K views View on X
Sean Geng Verified account @seangeng
inference commoditizing doesn't mean the margin goes to zero, it means the margin moves.

it goes to whoever owns the box, the power contract, and the scheduler. everyone optimizing prompts is fighting over what's left after those three take their cut.
Sean Geng Verified account @seangeng
capacity planning for agents is different math than capacity planning for chat. chat scales with users. agent load scales with how many steps a task decides to take, and the model decides that mid run, not you.

you're sizing for a number nobody commits to in advance.
Sean Geng Verified account @seangeng
the payment rails for agents are catching up to the execution rails. cool, now the agent can buy something. still can't guarantee it does the eleven steps before the purchase in the right order without falling over. that part's still on you.