Twitxy Saved

Sapien

This account is verified because it's an official organization on X. Learn more

@BuildOnSapien

Ship Faster. Catch Data Issues Before Training.
Anywhere sapien.io Joined May 2024
200 Following 128K Followers 4.3K Posts

Latest posts 5

Pinned post

Sapien @BuildOnSapien
Know someone whose team could beat Proof of Quality?

If you refer the team that wins, we’ll pay you $1,000.

Ask them to put your name and email on their application.
Rowan 🛡️ Verified account @RowanRK6 Oct 14
1/ Beat Proof of Quality. Win a Tesla.

Send us your hardest dataset and tell us what good looks like.

We'll choose five US robotics and world AI teams. PoQ gets three days to meet the agreed evaluation targets. The first team we fail wins the prize.

Apply: sapien.io/challenge
View quoted post on X
3 replies 7 reposts 35 likes 164K views View on X
Sapien @BuildOnSapien
We've been working through a practical question: how can a small expert team oversee quality at huge scale? Ten experts can't read 100 million training items. They can still decide what good looks like.

We use their answers to test AI judges before they review the larger set.
12 replies 5 reposts 30 likes 4K views View on X
Sapien @BuildOnSapien
One question has shaped much of what we’ve built at Sapien: where can human judgment have the most impact on AI?

When we started, people were doing much of the work of creating and labeling data. After two years and 195 million tasks, we learned how difficult it is to measure quality reliably at scale.

As AI gets better at doing the work itself, the role of human expertise becomes even more important. People need to define what good means, decide which tradeoffs are acceptable, and retain responsibility for the decisions that deserve human judgment.

Where we think human judgment goes next, and why this question is central to Sapien’s long term direction:

sapien.io/blog/poq-where…
12 replies 3 reposts 27 likes 4.2K views View on X
Sapien @BuildOnSapien
AI systems can generate thousands of outputs before a team has time to inspect a fraction of them. When outsourcing this to AI, one of the hardest parts is deciding how much confidence to place in a single judgment.

Proof of Quality supports multiple AI reviewers in a single workflow, so teams can compare scores, reasoning, agreement, and disagreement, giving them a faster way to test evaluation workflows at scale while keeping expert attention focused on ambiguity and high consequence cases.

Read more: sapien.io/blog/proof-of-…