Twitxy Saved

OnDeck AI

Verified account This account is verified. Learn more

@OndeckAI

Find anything in any imagery, without building ML models.

YC S25
ondeckai.com Joined August 2025
2 Following 122 Followers 24 Posts

Latest posts 5

OnDeck AI Verified account @OndeckAI
Vision evaluations need a lot of work.

Announcing our recently accepted NeurIPS 2026 workshop paper investigating the problems with the state of video evals.

The paper also proposes a more faithful way to evaluate vision for agents.
Sepand Dyanatkar Verified account @SepandD 5d
Do video benchmarks actually test video understanding? Excited to announce our NeurIPS 2026 workshop paper investigating problems with the state of video evals, and ways to address them.

One of the many problems is highlighted in the image below (option-conditioned blind solvability)
View quoted post on X
OnDeck AI Verified account @OndeckAI
Vision benchmarks are blind to subtle preferences.

Now you can bring your own video and imagery to frontier models, and see how they perform on your tasks. The Arena is live today on VisionIndex.
OnDeck AI Verified account @OndeckAI
We are excited to have released the first set of evals on VisionIndex. Below, we shed some light on why we’re building this and why we’re opening it up to the world. 🧵 1/n
OnDeck AI Verified account @OndeckAI Sep 22
Today we’re launching VisionIndex.

Measuring vision capabilities is really hard and no one is doing it well. So we built VisionIndex to solve that.
View quoted post on X