Our Maxwell found staggering improvements across the throughput/ interactivity plot for serving DeepSeek-V4.1-Flash.
This model is out for several weeks now, and everyone has taken a stab at optimizing it for inference 💸 Maxwell topped all published results, and even surpassed GB300 serving numbers with B200 💪🏻
This model is out for several weeks now, and everyone has taken a stab at optimizing it for inference 💸 Maxwell topped all published results, and even surpassed GB300 serving numbers with B200 💪🏻
1/View quoted post on X
We set Maxwell to optimize DeepSeek-V4.1-Flash serving on B200s.
Maxwell’s engine outputs 3x more tokens per GPU than vLLM at the same speed per user, or serves 2x speed per user for typical loads.
It beats every published B200 setup, and is even faster than all comparable GB300 results.
Blog: doubleai.s.gy/gb300