Now imagine it only takes 2 years
Imagine what it will be like if 5 years from now models have improved on Fable as much as Fable has improved on GPT3.View quoted post on X
Imagine what it will be like if 5 years from now models have improved on Fable as much as Fable has improved on GPT3.View quoted post on X
Introducing Low-Voltage Inference (LVI) for high throughput workloads.View quoted post on X
Today, AI chips can't scale FLOPs without thermal throttling.
As FLOPs utilization increases, AI chips draw more power and downregulate clock speed. This often results in sustained inference throughput under half of peak FLOPs.
Chips in other industries solve the power problem by running at lower voltages. Bitcoin miners run at under 3x the voltage of AI chips!
We鈥檝e designed a new architecture to run our chip鈥檚 math blocks at under half the voltage of most AI chips. This enables multiple times the FLOPs density of AI chips today.
We can run trillion parameter sparse MoEs at 80%+ peak FLOPs without thermal throttling.
Running LVI requires co-designing the entire cluster from the transistor to the token: new splittable math arrays, circuit techniques, novel tiling and scheduling algorithms, power delivery networks, VRM architectures, advanced packaging, cold plate designs, and more.
1/N I鈥檓 excited to share that our latest @OpenAI experimental reasoning LLM has achieved a longstanding grand challenge in AI: gold medal-level performance on the world鈥檚 most prestigious math competition鈥攖he International Math Olympiad (IMO).View quoted post on X