Pinned post
4X DeepSeek R1 671B Inference: As we prepare for DeepSeek R2, Avian presents 351 output tokens per second on DeepSeek R1 per user on NVIDIA B200 at FP4 precision.
Presented to you in collaboration with @Vultr Cloud GPU, who provided the NVIDIA HGX B200 hardware.
Keep your eyes out for more results to come out for blazing Llama 4 Maverick inference soon...
Presented to you in collaboration with @Vultr Cloud GPU, who provided the NVIDIA HGX B200 hardware.
Keep your eyes out for more results to come out for blazing Llama 4 Maverick inference soon...