Twitxy Saved

Anirudh Rowjee @ rowjee.com

@AnirudhRowjee

LSM Trees @couchbase 🛠️ @bengalurusys @hsp_ecc • Databases, Dist Sys, Inference, Rust • runner, metalhead, poet⚡dare mighty things •
autodidact • views mine
Bengaluru rowjee.com Joined January 2021
3.3K Following 1.7K Followers 1.3K Posts

Latest posts 5

Anirudh Rowjee @ rowjee.com @AnirudhRowjee
It’s honestly amazing that this is free - massive thanks to @1a1a11a and team!
Juncheng Yang Verified account @1a1a11a 2d
We just open-sourced PrefixSim — a fast simulator for KV-block prefix caches in LLM serving, along with two LLM serving datasets.

It lets you replay real production traces and compare 40+ eviction policies by the metric that actually matters: compute savings (prefill work avoided), not just hit ratio.

github.com/cacheMon/Prefi…

#LLM #PrefixCaching #Systems #OpenSource
View quoted post on X
0 replies 0 reposts 13 likes 726 views View on X
Anirudh Rowjee @ rowjee.com @AnirudhRowjee
Reaching out to anyone who's interested in/researching/building in LLM Inference - we'd love to hear you speak at our upcoming Special Edition on Inference at Bengaluru Systems on October 31st at @lossfunk
We’re back for our 23rd Bengaluru Systems meetup, this time on Inference with @lossfunk on October 31st!

Registration is now open; let’s talk systems!
hasgeek.com/bengalurusyste…
View quoted post on X
5 replies 7 reposts 41 likes 2.2K views View on X