Twitxy Saved

Kastan Day

Verified account This account is verified. Learn more

@KastanDay

MLE @Cloudflare Workers AI. prev: @RescaleInc, @NCSAatIllinois, @IBM_Research MS in CS from UIUC.
Seattle kastan.ai Joined March 2013
1.3K Following 509 Followers 1.7K Posts

Latest posts 5

Pinned post

Kastan Day Verified account @KastanDay
Today's open source models are GOOD in their domain.

Multi-modal transformers do an excellent job at combining information (DETR, CLIP, etc).

Why not use pretrained models as encoders, and train on their embeddings?

I propose Video Pretrained Transformer. More to come.
Kastan Day Verified account @KastanDay
kv cache is the heart of LLM serving efficiency!!
Kevin Flansburg Verified account @kevin_flansburg Oct 19
Excited to be speaking at the first SGLang Summit (@sgl_project), Nov 12–13 at Fort Mason in SF!

My team (@areneau @KastanDay ) and I are looking forward to presenting our work on system one models (Clef and Clairic), and sharing how we are maximizing KV cache hit rates using a multi-deployment Mooncake cluster with HiCache. Come say hi if you're there!
View quoted post on X