Pinned post
FWIW this is the most ambitious benchmark I've co-created!View quoted post on X
𝗞𝗡𝗢𝗪𝗦 jointly & reliably evaluates agents on:
1) live web search,
2) use of common web productivity tools,
3) visual/spatial understanding;
programmatically where possible and by LLM judges where needed, more 👇
FWIW this is the most ambitious benchmark I've co-created!View quoted post on X
𝗞𝗡𝗢𝗪𝗦 jointly & reliably evaluates agents on:
1) live web search,
2) use of common web productivity tools,
3) visual/spatial understanding;
programmatically where possible and by LLM judges where needed, more 👇
A useful computer-use agent doesn't just find information. It turns it into something you can share.
Introducing KNOWS: agents research the live web, then build a real Google Doc, Sheet or Slide deck in the browser.View quoted post on X
