Twitxy Saved

ayan sengupta

Verified account This account is verified. Learn more

@ayans007

PhD student at IIT Delhi
Delhi NCR victor7246.github.io Joined July 2010
320 Following 88 Followers 37 Posts

Latest posts 5

Pinned post

ayan sengupta Verified account @ayans007
🔬 Parmanu (Hindi for Atom) is live.

Parmanu is part of the Computational Social Systems (LCS2) @lcs2lab at IIT Delhi, led by Prof. Tanmoy Chakraborty @Tanmoy_Chak , and is our dedicated home for Efficient Large Language Models (LLMs) and Small Language Models (SLMs).

We’re at a turning point in AI. The future won’t be defined by scaling alone - it will be shaped by efficiency, accessibility, and real-world deployability. Parmanu is our effort to push this efficiency-first vision forward. ✨🤖

🔗 Explore the project page: parmanu.lcs2.in

Why Parmanu matters 🔥

• 📚 A centralized hub for our research, with papers accepted at ICLR, ICML, NeurIPS, TACL, ACL, and TMLR
• 🛠️ Open access to tools, code, and artifacts spanning model compression, KV efficiency, PEFT, inference optimization, knowledge distillation, and model coordination
• 🧠 A growing ecosystem focused on making strong language models smarter per parameter, not just larger

What this means for the community

For researchers 👩‍🔬👨‍🔬

A curated, evolving resource tied to top-tier venues

Reproducible artifacts and principled problem formulations

A shared space to advance efficiency-centric LLM research

For practitioners 👩‍💻👨‍💻

Practical techniques to deploy LLMs under tight latency and memory budgets

Faster paths from paper → production

Tools that actually work under real deployment constraints

What’s coming in 2026 🚀🔮

• 📊 Efficient LLM/SLM leaderboards
• 🧪 Open-sourced efficient LLM artifacts
• ⚙️ More tools for compression, distillation, and inference
• 🤝 Deep integration with Hugging Face and other popular libraries

If you’re excited about efficient, sustainable, and scalable AI, check out Parmanu, share feedback, and collaborate with us. The next wave of LLMs won’t just be bigger - they’ll be leaner, faster, and more impactful. 🌟

#EfficientLLMs #SLMs #ModelCompression #InferenceOptimization #KnowledgeDistillation #AIResearch #NLP #ICLR #ICML #NeurIPS #ACL #TACL #TMLR #IITDelhi #LCS2 #Parmanu
parmanu.lcs2.in Parmanu @ LCS2 IIT Delhi A comprehensive resource for efficient large language models. Brought to you by Laboratory for Computational Social Systems, IIT Delhi.
1 replies 5 reposts 10 likes 539 views View on X
ayan sengupta Verified account @ayans007
🚨 New article: From Scaling Laws to Downscaling Laws

x.com/ayans007/statu…

In 2025 we argued at ICML that the field needs downscaling laws.
In 2026 we deliver one at EMNLP.

A 10% lower loss costs 4–8× the carbon emission.
Pruning 43% of a model keeps 70% of its performance, with zero retraining.

Scaling up is expensive. Scaling down is predictable.

@Tanmoy_Chak @lcs2lab

#downscaling #efficientllms #modelcompression
ayan sengupta Verified account @ayans007 Oct 11
View quoted post on X
ayan sengupta Verified account @ayans007
We changed only the calibration set of a structured pruner and a pruned Llama-3.1-8B went from refusing 96% of harmful prompts to 13%.

Unstructured pruning? Unaffected.
Calibration-free pruning? Nothing to attack.

Read the full article at - x.com/ayans007/statu…

Work done at LCS2, IIT Delhi (Parmanu project) @Tanmoy_Chak @lcs2lab
ayan sengupta Verified account @ayans007 Aug 30
View quoted post on X