at GTC weds-thurs this week - eager to chat to anyone interested in pushing the frontier of open inference! DMs open
Fergus Finn
Verified account Doubleword@finn_fergus
Thinking about inference @Doubleword_
213 Following 589 Followers 118 Posts
Latest posts 5
Was great to collaborate with @sh_reya and @charles_irl and the rest of the team on this awesome project. I think there are still lots of great opportunities out there for 'pushing down' workloads into the inference stack!
Excited to share Quail, our new open source AI-SQL engine (a collab with Modal)! By planning queries and LLM inference together, it reaches 1B+ input tokens/min on one H100 for one query 😱🚀View quoted post on X
AI-powered data operators create a new, interesting inference workload👇
Was great to collaborate with @sh_reya and @charles_irl on this awesome project. I think there are still lots of great opportunities out there for 'pushing down' workloads further into the inference stack
Excited to share Quail, our new open source AI-SQL engine (a collab with Modal)! By planning queries and LLM inference together, it reaches 1B+ input tokens/min on one H100 for one query 😱🚀View quoted post on X
AI-powered data operators create a new, interesting inference workload👇
New post on the Doubleword blog from @rushilbhat - explaining how efficient inference lets you build smarter models in the aggregate.
1/ We think parallel test-time scaling is one of the most underexplored ways to improve model qualityView quoted post on X
We spend a lot of time on efficiency for long-horizon agentic inference
We showed that a swarm of DeepSeek-V4-Pro agents lifts the SWE-Bench-Pro score by ~20 points, beating the cost-performance trade-off of the leading frontier models🧵
We think that people ought to be able to do much more inference.
I'm excited to present this completely normal launch video, starring yours truly,
I'm excited to present this completely normal launch video, starring yours truly,
we made an unhinged video to let you know that you’re overpaying for your tokens…View quoted post on X
…and there’s something you can do about it.
Introducing Doubleword.
🕊️✨🙏 LET THERE BE TOKENS 🙏✨🕊️