Twitxy Saved

Danny Nemer

Verified account This account is verified. Learn more

@DannyNemer

๐Ÿ›ฐ๏ธ co-founder Dispatch.space, building space factories YC P26
๐Ÿš† conductor.is $600K ARR
๐Ÿค– autotext.com
PREV: afresh.com, @GreenChainAI, even.com, git.new/aang
San Francisco, CA dispatch.space Joined September 2008
593 Following 1K Followers 4K Posts

Latest posts 5

Pinned post

Danny Nemer Verified account @DannyNemer
AutoText's typing suggestions are now 2x faster!

We're at 800ms RTT per suggestion, still slower than I'd like. For reference, Cursor's gold-standard suggestions land around 250ms.

Inference dominates the latency budget, eating 93%+ of the round trip. After benchmarking dozens of models across every major serverless provider, I've hit a ceiling.

One lever remains: dedicated deployments running open-source models (Kimi K2, Qwen3, GLM, MiniMax, Gemma 4) on hand-picked hardware. That unlocks the accelerators @FireworksAI_HQ and @togethercompute reserve for dedicated tenants, namely speculative decoding, predicted outputs, and their fastest chips. The catch: always-on capacity (no scale-to-zero) starts at $7k/month.
0:43
2 replies 0 reposts 13 likes 2.2K views View on X