Twitxy Saved

Shreya Shankar

Verified account This account is verified. Learn more

@sh_reya

Incoming assistant professor @CSDatCMU @CMUDB. Putting LLMs in databases and BI tools. Created docetl.org and evals.info.
SF & Pittsburgh sh-reya.com Joined January 2014
830 Following 60K Followers 6.3K Posts

Latest posts 5

Pinned post

Shreya Shankar Verified account @sh_reya
Excited to share Quail, our new open source AI-SQL engine (a collab with Modal)! By planning queries and LLM inference together, it reaches 1B+ input tokens/min on one H100 for one query 😱🚀

AI-powered data operators create a new, interesting inference workload👇
0:28
84 replies 164 reposts 1.7K likes 386K views View on X
Shreya Shankar Verified account @sh_reya
Quail now supports models with hybrid architectures! Hybrid architectures are the future. With fewer attention layers, KV sizes are smaller, which improves reuse for future Quail queries.

Arnav wrote a blog post on how we adapted our cost models, extended Quail’s caching to save the recurrent state, and got a >3x speedup over vLLM: fsdatalab.github.io/blog/hybrid-mo…
fsdatalab.github.io Supporting Hybrid Models in Quail How Quail supports hybrid models that mix full attention with Gated DeltaNet layers: checkpoints of the recurrent state, retention and eviction, and the cost-model changes.
8 replies 9 reposts 29 likes 3.8K views View on X
Shreya Shankar Verified account @sh_reya
Huge. We have to start figuring out how to navigate this newfound mess of post-AGI peer review. Thank you Ian for leading this effort!
Ian Arawjo @IanArawjo 5d
Introducing OpenCHIReviews, a crowdsourced database of reviews for ACM HCI conferences, chiefly CHI. Submit anonymized reviews and paper decisions, and see what other HCI papers' reviews look like, in the spirit of open science:
View quoted post on X
7 replies 0 reposts 28 likes 2.9K views View on X
Shreya Shankar Verified account @sh_reya
💯 The next generation of BI tools needs to tackle both (1) scalable analysis of unstructured data, and (2) *efficient* communication of the analysis to *humans* to inform key business decisions. Come apply for a PhD with me if you want to build the foundations and systems for this new era!!
Lorin Hochstein @norootcause 6d
I still find LLMs terrible at information presentation, even when they’re good at analysis. The reports they generate are not well-structured. The order that information is presented, and which details are relevant to the reader, these are things they are not good at yet.
View quoted post on X
21 replies 13 reposts 136 likes 14K views View on X
Shreya Shankar Verified account @sh_reya
we have been hard at work exploring the crossover of two of the biggest industries in history. it is so much fun. can’t wait to get the quail paper out
Charles 🎉 Frye Verified account @charles_irl 5d
very pleased with all the life choices and quirks of history that led to me talking about using join ordering, kaplan-meier estimates of decode length, and trie attention to increase inference efficiency in analytics by 10x in a loud bar in San Francisco tn
View quoted post on X