Twitxy Saved

Sid Jha

Verified account This account is verified. Learn more

@sid_jha1

Stanford, CA sidjha1.github.io Joined June 2023
111 Following 182 Followers 74 Posts

Latest posts 5

Sid Jha Verified account @sid_jha1
Super cool approach for efficient prefill! ⚡️
Liana Verified account @lianapatel_ Oct 21
Introducing ✨Token-Gated Language Models✨ for up to 11x faster prefill by learning to skim context, conditionally forwarding only tokens that matter.

Akin to the shift from dense models to MoEs, the next frontier of efficient LLMs is conditional computation over a new scaling axis: context tokens🧵👇
View quoted post on X
Sid Jha Verified account @sid_jha1
The bitter lesson is coming for data agents too! The interesting part is what gets more important as models get better
Liana Verified account @lianapatel_ Sep 7
As better models rapidly eat the stack, what system research problems will remain to enable the next frontier of data agents?

We studied the evolution of data agent capabilities the past 2 years, finding general coding agents beat hand-designed data agents by up to 37 points, with 4× fewer turns.

So what's actually left for system researchers to solve?

More than you might think...

📚 Paper: arxiv.org/abs/2609.03141

🧵👇
View quoted post on X
0 replies 4 reposts 18 likes 1.5K views View on X
Sid Jha Verified account @sid_jha1
Happy to see many new integrations being built inside LOTUS! We hope that it makes writing LM programs even faster 🚀
Liana Verified account @lianapatel_ Feb 20, 2025
Excited to share our release of LOTUS 1.1.0, which now makes it easier than ever to get started with LLM-powered data processing over a variety of custom knowledge sources.

Seamlessly connect to data from the web, your SQL databases, vector databases and more.

And process it all with the power of semantic operators.

github.com/lotus-data/lot…
View quoted post on X
Sid Jha Verified account @sid_jha1
Try out LOTUS and share your applications with us!

It's as easy as `pip install lotus-ai`
Liana Verified account @lianapatel_ Dec 18, 2024
We've been building LOTUS at Stanford and Berkeley to make LLM-powered data processing fast, easy and declarative.

LOTUS is an open-source query engine that makes programming as easy as writing Pandas and optimizes your programs for up to 400x speedups.

To celebrate the holidays, we're excited to share our release of LOTUS 1.0.0 with a batch of new updates that make reasoning over your data faster, easier and better than ever!

Code: github.com/guestrin-lab/l…

🧵👇
View quoted post on X