Twitxy Saved

David Dohan

Verified account This account is verified. Learn more

@dmdohan

reducing perplexity, ai for science
| past: reasoning o1/o3/... @openai & probabilistic programs, proteins, science & reasoning @ google brain 馃
ddohan.com Joined August 2011
1.8K Following 12K Followers 579 Posts

Latest posts 5

David Dohan Verified account @dmdohan
Big if true, and afaict it's true

congrats to the Etched team on getting inference running on their new chips!
Etched Verified account @Etched Jun 30
Introducing Low-Voltage Inference (LVI) for high throughput workloads.

Today, AI chips can't scale FLOPs without thermal throttling.

As FLOPs utilization increases, AI chips draw more power and downregulate clock speed. This often results in sustained inference throughput under half of peak FLOPs.

Chips in other industries solve the power problem by running at lower voltages. Bitcoin miners run at under 3x the voltage of AI chips!

We鈥檝e designed a new architecture to run our chip鈥檚 math blocks at under half the voltage of most AI chips. This enables multiple times the FLOPs density of AI chips today.

We can run trillion parameter sparse MoEs at 80%+ peak FLOPs without thermal throttling.

Running LVI requires co-designing the entire cluster from the transistor to the token: new splittable math arrays, circuit techniques, novel tiling and scheduling algorithms, power delivery networks, VRM architectures, advanced packaging, cold plate designs, and more.
View quoted post on X
0 replies 0 reposts 43 likes 7.1K views View on X
David Dohan Verified account @dmdohan
OpenAI achieved gold medal on 2025 International Math Olympiad (solving 5 of 6 problems)!

Thinks for hours and writes proofs in natural language.

We've come a long way from LLMs solving 50% of MATH dataset in 2022

Congrats @alexwei_ on spearheading a major milestone!
Alexander Wei Verified account @alexwei_ Jul 19, 2025
1/N I鈥檓 excited to share that our latest @OpenAI experimental reasoning LLM has achieved a longstanding grand challenge in AI: gold medal-level performance on the world鈥檚 most prestigious math competition鈥攖he International Math Olympiad (IMO).
View quoted post on X
1 replies 0 reposts 126 likes 7.8K views View on X