Pinned post
We have been investing in advancing multimodal reasoning for Muse Spark and we participated in this year's major science olympiads. It was great to see our model obtain a 100th percentile score at the International Physics Olympiad (🥇), International Chemistry Olympiad (🥇) and the Asian Physics Olympiad (🥇) in theory exams!
To understand whether we're making genuine progress on reasoning, we entered our AI models in five STEM Olympiad competitions.View quoted post on X
The results:
🏅 Asian Physics Olympiad (APhO): Perfect score, theory exam
🏅 International Physics Olympiad (IPhO): Perfect score, theory exam
🥇 International Mathematical Olympiad (IMO): Gold medal
🥇 International Chemistry Olympiad (IChO): Gold-medal-level performance
🥇 Romanian Masters of Mathematics (RMM): Gold-medal-level performance
The types of problems in the Olympiad competitions are exceptionally hard, demanding deep chains of reasoning, creative insight, and flawless argumentation. To test pure reasoning capability, we disallowed all tool use, meaning no search, no coding, and no calculator.
We have deep admiration for the contestants and committees behind these competitions, and are grateful for their support in enabling our participation.