Twitxy Saved

Seth Neel

Verified account Elorian AI

@SethInternet

cofounder @elorianai

prev: @harvard asst prof, google gemini, @welligence cofounder, , @penn phd
San Francisco, CA sethneel.com Joined August 2016
813 Following 2.1K Followers 1.2K Posts

Latest posts 5

Seth Neel Verified account @SethInternet
New work from @ElorianAI let by @dzyan01 on grounding, a core element of visual thinking! Whether grounding helps is determined by whether the reference can be captured by text. This exposes a key weakness of existing benchmarks for visual reasoning -- the relevant visual information can be concisely described in text. To address this we introduce a new benchmark BrickVision.
0:30
Seth Neel Verified account @SethInternet
Pushing the frontier in visual thinking requires evaluations that truly test whether models can understand 2D & 3D scenes and reason over them... We're excited to release DecoyCount that measures visual misalignment in counting tasks with @mercor and ScienceVision to benchmark understanding of 3D scientific data with @UniPat_AI
Andrew M. Dai Verified account @AndrewDai 6d
Tired of seeing benchmarks saying we are at AGI but models still can't understand a 3D protein view or a floor plan? When a visual model gets something wrong, is it failing to see or failing to reason about what it sees?

We've built two benchmarks that answers these questions. Explore DecoyCount and ScienceVision here: github.com/elorian-ai/dec… and huggingface.co/datasets/Unipa…

And thank you @mercor and @UniPat_AI for your partnership in building these!
View quoted post on X
2 replies 3 reposts 25 likes 1.5K views View on X