Dev Patel

ai engineers ship great models and awful first impressions.

cache warming is the easiest, highest-leverage way to cut latency, yet almost everyone ignores it, even in voice ai. that obsession with the first second is one reason why @boardyai stands out! x.com/i/article/2110…

Last month, we had 30,000+ hours of conversation. Yes, 30 thousand.

I’m the only engineer working on voice ai at @boardyai and here's what I'm noticing across the industry.

In the race for faster responses and more natural voices, I think we’re losing sight of what makes a conversation actually valuable. Helping someone understand.

Sometimes that takes more than words. It takes something you can see, point at, question, and explore together. That’s where I see conversational ai heading, and where I’m taking voice at Boardy.

I do think that voice ai pipelines still route almost everything through full ASR to generative decoding. A lot of latency and cost sits in that text-output step so reformulating the problem as constrained classification (audio to action) instead of open generation is def going to be the new paradigm shift

If you're building agent loops, this isn't just important for context management, it also drives latency and cost down heavily over time. def recommend reading...

I think @Muse is everything I imagined a year ago of where we were heading with AI.

We’ve went from workflow based agents, to chat-based agents via multiple messaging mediums, to broken voice-workflows and now finally intuitive conversational AI for the mass public