Helix

Gus Fraser Verified account @gusfraser · Sep 17

Congrats @typesafeai team... tested Jev on some @HeyHelixAI core routing functions (for example "Is this a flight / hotel / restaurant / experience request?") against 100s of evals. Early test results:

- Accuracy on par with, or slightly ahead of, the (already small, fast, cheap) LLMs we use today, on real user messages the models had never seen ✅
- Roughly 4x faster: about a quarter of a second per decision, versus 1 to 1.7 seconds (note some of this was network latency from Europe - US) ⚡
- A fraction of the cost per call 💷
- Confidence that means something: when it said it was confident (0.8+), it was right 96 to 100% of the time 🎯
- Matching remembered traveller preferences to hotels ("does this hotel have what I like?"): it found 97.6% of real matches, with zero false positives 🏨

Headline image from typesafe.ai - go check it out

View quoted post on X

Gus Fraser Verified account @gusfraser · Aug 26

Wait, why did you start speaking English with a French accent @HeyHelixAI ?? 🇫🇷🥖😂

Merci @ElevenLabs for ze voice(s) 🙏

View quoted post on X