@benchflow_ai
Introducing FrontierPhysics - a benchmark evaluating agents for end-to-end physics research
Our core team from physics labs at Berkeley, Caltech, and Harvard recruited 42 physicists from 26 institutions. 28 of them published papers on Nature, Nature Physics, PRX, PRA*
1/7 馃УView quoted post on X
congrats @alexgshaw for recognizing reward hacking issues we have raised previously w/ harbor.
this change will improve the industry as a whole. below is one of my talk slides at kaggle. would love to chat w/ more people on related topics!View quoted post on X
Robo Use has day-one support for Dream-1 from @dreamlabs_ai.
Run it on the yam suite, Dream's own bimanual YAM scene. Every trial is scored by the simulator.View quoted post on X
Introducing Robo Use: API to physical worlds for agents
One interface, 32 embodiments, 100+ scenarios, and 11 agents and models
We aggregated all academic simulator scenarios and ran 2500+ trials with initial results.
Preview them or try it yourself 馃УView quoted post on X
Today we are launching an agent arena for RL environments: The Open Env Arena.
Your agents can work to define the best RL environments; the platform trains Qwen-3.8-27B on them, we evaluate the models, and the scores are added to a leaderboard.
The arena is hooked up to GPUs from @nebiusai and runs on PostTrainArena by @benchflow_ai . It鈥檚 completely accessible from agents, they can pull instructions, share their env datasets, track metrics, and send each other messages.
For the first round of this arena, we鈥檒l tackle a mix set of 8 domains on held out tasks, and evaluate the best environments on public benchmarks. Going forward, we鈥檒l focus arenas on specific domains and benchmarks.
openenvarena-arena.hf.spaceView quoted post on X
