ok, well done GPT
Real-world Arena scores are in for GPT-6.2 Astra and GPT-6.2 Sol by @OpenAI in the Code Arena: WebDev, and both have landed on the Pareto frontier!View quoted post on X
- #3 with 1781 pts: GPT-6.2 Astra (Max)
- #7 with 1757 pts: GPT-6.2 Sol (Max)
GPT-6.2 Astra: #3 with 1781 pts
- +18 pts vs previous variant GPT-6 Astra (Max)
- #1 in Consumer Product, compared with #4 for GPT-6 Astra
- Median cost per task: $5.45 vs. $9.46 for GPT-6 Astra, 42% lower
- Lands on Pareto frontier (see placement in thread)
GPT-6.2 Sol: #7 with 1757 pts
- +13 pts vs GPT-6.1 Sol (Max)
- Median cost per task: $1.45 vs. $1.84 for GPT-6.1 Sol, 21% lower
- Lands on Pareto frontier (see placement in thread)
6.2 Astra vs. Sol
- Astra scores +24 pts above Sol
- Sol’s median cost per task is 73% lower ($1.45 vs. $5.45)
Congrats to the @OpenAI team on this release. Agent score coming soon!