Even more Terminal-Bench!
We've pushed a version update to the Terminal-Bench dataset and leaderboard.View quoted post on X
Terminal-Bench 4.0 calibrates task resources (time, cpu, memory), implements task fixes, and removes saturated tasks.
@lschmidt3
We've pushed a version update to the Terminal-Bench dataset and leaderboard.View quoted post on X
Terminal-Bench 4.0 calibrates task resources (time, cpu, memory), implements task fixes, and removes saturated tasks.
We're releasing Terminal-Bench-Science: a benchmark for evaluating AI agents on research workflows across scientific domains.View quoted post on X
An ongoing Stanford-led community effort, built by the team behind Terminal-Bench together with scientific domain experts at research institutions worldwide. v0.1 has 70 tasks. Claude Opus 5 solves only ~30%.
1/n 馃憞
How can we train small agentic models that are highly capable of terminal use and coding?View quoted post on X
Announcing OpenThoughts-Agent + OpenThinkerAgent-32B, the strongest Qwen-3 based open-data agentic model: 44.8% avg across 7 agentic benchmarks! (1/n)
Today, I鈥檓 launching a deeply personal project. I鈥檓 betting $100M that we can help computer scientists create more upside impact for humanity.View quoted post on X
Built for and by researchers, including @JeffDean & @jpineau1 on the board, @LaudeInstitute catalyzes research with real-world impact.