Plato

In the last few weeks we paid out over $4M for people to re-create their jobs as RL environments

Today we’re launching Computer Work Val v1.0: 300 tasks across 36 roles with over 200 simulated apps

Muse Wonder scores 3.7% on Web Clone Bench

A big jump from Spark 1.3 but still unable to make significant progress on long horizon coding/computer-use tasks.

Today we're launching WebCloneBench: a benchmark which measures a model's ability to explore, copy, build and test various web apps.

For each task, we give the model a reference site from one of Gmail, Google Sheets, Jira, DocuSign, Shopify Admin, Craigslist, Figma, Slack and Zendesk. It is instructed to build a fully feature-complete clone of every part of the application with an 8 hour time limit.