@supriyapaul93
Drop 4/15: Announcing the Voice Arena Dictation Bench - the first open benchmark of AI dictation apps.
Not their APIs: the real apps. We played 761 recordings from 87 speakers into each of 10 apps on a Mac, then 5 LLM judges asked if each draft could be sent as-is.
Wispr Flow: 79%. Apple: 35% 🧵View quoted post on X
Introducing Diarization Bench, @voicearena_ai's benchmark for who spoke when.
The metric we measure is diarization error rate, or DER. It measures how much of a conversation a model attaches to the wrong person. Every second it misses, invents, or gives to another speaker counts against it.
Here's what we did. 139 conversations recorded for this board, in rooms and on calls, with people interrupting each other throughout. 12 systems scored under a single goal: testing models in the real-world conditions they are actually deployed in. @nvidia's Nemotron 3 leads at 14.72%. 🧵View quoted post on X
Excited to share some great news. @voicearena_ai is the Diamond Sponsor of Interspeech 2026.
I’ve been attending Interspeech for the last 2 years. My journey of falling in love with research and solving bottlenecks in voice ai started here.
We’ll be sharing our latest evaluations, datasets and research with the community.
If you are going to be there, do come by!
📍 Booth D1, ICC Sydney
📅 28 September–1 OctoberView quoted post on X
Told my Instinct to reach out to my bf's Instict to plan a surprise.
This is what his Instict texted him 🤪View quoted post on X
