Twitxy Saved

UW SyFi

Verified account This account is verified. Learn more

@UWSyFi

The Systems for Future Intelligence lab at @uwcse.
Seattle, Washington syfi.cs.washington.edu Joined February 2026
16 Following 147 Followers 92 Posts

Latest posts 5

UW SyFi Verified account @UWSyFi
Pipeline parallelism, custom prefix caches, and thoughtful schedulers really do boost peformance of LLM serving for coding agents! With ServingStudio to predict how a design performs, we were able to build a bespoke prefill engine for GLM 5.3-Flash that kills the competition!
Work led by our own @KanZhu854772!
Kan Zhu Verified account @KanZhu854772 3d
🔥 Serving coding agents well needs a high-performance prefill engine, but existing systems fall short.

🚀 Introducing SSEngine-GLM5.3-Flash: an open-source prefill engine for GLM-5.3-Flash on four B200 GPUs. It combines pipeline parallelism, a tiered prefix cache across GPU memory, DRAM and SSD, and a shortest-remaining-prefill-first scheduler.

📈 On real hardware, it sustains 3.1× (AgentX) and 3.2× (TraceLab) the request rate of any vLLM or SGLang setup we tested.

🧵 More in the thread below (1/8)
View quoted post on X
UW SyFi Verified account @UWSyFi
Long-context ASR has a trade-off: single-pass is accurate but slow, while chunking is fast but loses track of speakers and timestamps.

Introducing Murmur🗣️: 2.5x faster than single-pass, and more accurate than WhisperX on every benchmark we tested.
0:19
1 replies 5 reposts 7 likes 1.4K views View on X
UW SyFi Verified account @UWSyFi
Excited to announce that SyFI was just selected for a multi-million-dollar award from the @NSF to participate in the AI Efficiency Challenge over the next two years! We’ll be working with our industry partners on realizing the SyFI mission: hyperspecializing infrastructure for AI, by AI. The goal is to use AI to hyperspecialize AI system software to each model, workload, and hardware platform to unlock the next level of efficiency gains.

Special thanks to our deployment partners @NVIDIA, @AMD, @Amazon, @mirendil for helping make this happen!
1 replies 3 reposts 11 likes 593 views View on X
UW SyFi Verified account @UWSyFi
1/ We pointed VibeSys, our multi-agent system for designing systems, at Qwen3.5-397B-A17B on four AMD MI300As. No human wrote engine code.

In 105 hours, it went from a 12.8 tok/s PyTorch baseline to 2,242 tok/s goodput, 2.33× SGLang on the same hardware!