Twitxy Saved

Mercor

Verified account This account is verified because it's an official organization on X. Learn more

@mercor

Organizing human intelligence to power the AI economy.
San Francisco mercor.com/apex Joined April 2021
31 Following 27K Followers 495 Posts

Latest posts 5

Pinned post

Mercor Verified account @mercor
The market for AI training data could grow 100x over the next five years.

Frontier labs need increasingly realistic data from actual businesses to train more capable models.

@BrendanFoody explains why this creates a new revenue opportunity for founders and companies.

Find out more at the link in the thread.
1:06
10 replies 9 reposts 113 likes 193K views View on X
Mercor Verified account @mercor
Proud to have contributed to this work with @ElorianAI.

Separating what models fail to see from what they fail to reason about makes benchmarks more useful.

Thank you to @AndrewDai and everyone who helped bring this research to life.
Andrew M. Dai Verified account @AndrewDai 1d
Tired of seeing benchmarks saying we are at AGI but models still can't understand a 3D protein view or a floor plan? When a visual model gets something wrong, is it failing to see or failing to reason about what it sees?

We've built two benchmarks that answers these questions. Explore DecoyCount and ScienceVision here: github.com/elorian-ai/dec… and huggingface.co/datasets/Unipa…

And thank you @mercor and @UniPat_AI for your partnership in building these!
View quoted post on X
4 replies 3 reposts 29 likes 5.8K views View on X
Mercor Verified account @mercor
We helped @thinkymachines evaluate Inkling 2 Small ahead of today's launch. Here's how it ranks on the APEX leaderboards.

APEX-Agents:
46.8% Pass@1
60.9% mean score

By domain (Pass@1):
Law: 62.2% (+12.5)
Management Consulting: 40.3% (+14.8)
Investment Banking: 37.8% (+11.5)

Inkling 2 Small gains +13 points on APEX-Agents overall compared with Inkling (33.8% Pass@1) launched in July.

APEX-Accounting:
14.5% Pass@1
62.0% mean score

It's the second highest scoring open model on APEX-Accounting, behind Kimi K3.1 Pro (62.4% mean score).

Congrats to the Thinking Machines team.
0:07
Thinking Machines Verified account @thinkymachines 2d
Introducing Inkling 2 Small. Scoring 31 on the AA Intelligence Index, it's a big jump over its predecessor.

Inkling 2 Small is available for fine-tuning and inference on Tinker today, with full weight release planned soon.

thinkingmachines.ai/news/inkling-2…
View quoted post on X
8 replies 4 reposts 70 likes 4.2K views View on X
Mercor Verified account @mercor
Tune into the latest episode of @BrendanFoody's The Frontier podcast with @andyfang from @DoorDash.
DoorDash AI Research Verified account @AIatDoorDash 2d
We’ve spent years developing @DoorDash’s delivery network: understanding how local businesses operate, how orders get fulfilled, and how to complete deliveries across neighborhoods with different physical constraints.

Now we’re building proactive agents that can use that infrastructure to execute in the physical world.

@andyfang with @BrendanFoody on The Frontier ⬇️
View quoted post on X
3 replies 0 reposts 18 likes 2.3K views View on X
Mercor Verified account @mercor
Hy4 from @TencentHunyuan is the new #1 open-weights model on APEX-Agents.

77.6% Pass@1 (#3 of 69)
85.1% mean score (#3 of 69)

Here’s the updated APEX-Agents open-weights top 5 (Pass@1):

1. Hy4: 77.6%
2. DeepSeek-V4.1-Flash-1017: 69.8%
3. Kimi K3.1 Pro: 65.5%
4. Qwen3.8-Max: 63.3%
5. MiMo V2.6 Flash RL: 57.4%

Hy 4 is also the top open-weights model in every APEX-Agents domain:

Management Consultant: 85.6%
Investment Banking Analyst: 75.3%
Corporate Lawyer: 71.9%

Congrats to @TencentHunyuan.

See the full leaderboard: mercor.com/apex/
0:05