Twitxy Saved

Relace

Verified account This account is verified. Learn more

@relace_ai

Models and infra for AI code generation.
relace.ai Joined September 2025
9 Following 773 Followers 47 Posts

Latest posts 5

Relace Verified account @relace_ai
We're now live on the @concentrateai gateway!

Relace has spent the past four months aggressively driving down the cost of every open weight model we serve. Concentrate charges zero fees on top, so that price is what you pay.

Glad to partner with them to continue to make intelligence more accessible.
2 replies 0 reposts 10 likes 2.4K views View on X
Relace Verified account @relace_ai
If you want to spend all day working on inference optimization, we're hiring. relace.ai/about-us
relace.ai About Relace - Building AI Tools & Models for Smarter Coding Learn how Relace was founded to solve core challenges in AI-driven coding. Discover our mission, team, and vision for empowering developers with specialized models and infrastructure.
Eitan Borgnia Verified account @EBorgnia Sep 24
Relace is now also the cheapest provider of DeepSeek v4.1 Flash on OpenRouter.

Agent traces are 96%+ input tokens, so GPU utilization is dominated by prefill time. However, most of those tokens are not relevant for the next response.

The encoder/decoder split allows you to use a lossier, cheap submodel for prefill without affecting the performance of decode (i.e. quality of responses).

It also means you need to shuttle KV between GPUs a lot, which is why they redesigned attention (again) and made the KV 4x smaller.

Fully taking advantage of the theoretical gains is a deep engineering problem that DeepSeek left as an exercise for the reader.
View quoted post on X
2 replies 1 reposts 3 likes 1.2K views View on X