We moved DeepSeek V4.1 Flash on AMD MI355X from vLLM to SGLang.
Median time to first token on live traffic went from 388 ms to 193 ms. No failed requests during the switch, and nothing changed for anyone calling the API.
Dedicated endpoints: openrelay.inc/inference?utm_…
Median time to first token on live traffic went from 388 ms to 193 ms. No failed requests during the switch, and nothing changed for anyone calling the API.
Dedicated endpoints: openrelay.inc/inference?utm_…
0:20