Twitxy Saved

bilge

@bilgeacun

Research Scientist @MetaAI, PhD @IllinoisCS @Illinois_Alma, @BilkentUniv alum.
bilgeacun.com Joined August 2010
418 Following 356 Followers 819 Posts

Latest posts 5

bilge @bilgeacun
😺
AI at Meta Verified account @AIatMeta May 13, 2025
CATransformers is a carbon-driven neural architecture and system hardware co-design framework. Using CATransformers, we discover greener CLIP models that achieve an average of 9.1% reduction potential in total lifecycle carbon emissions while maintaining accuracy (or increasing accuracy) and latency.

This research is the first to look into carbon-driven neural architecture and system hardware co-design. It is enabled by a first-of-its-kind architectural carbon modeling tool – ACT, which we developed at FAIR.

Check out:
Our paper ➡️ go.fb.me/nedmh0;
code repository ➡️ go.fb.me/7jcp6q;
and the additional carbon design tools and research artifacts in Sustainable AI ➡️go.fb.me/csee32
View quoted post on X
bilge @bilgeacun
Breaking my X fast to post this. Need ~2x faster LLM inference? Check this out! 👇
Excited to present our latest research: 🦘LayerSkip!
huggingface.co/papers/2404.16…

We run a subset of earlier layers of an LLM, & verify/correct using the remaining layers, to achieve upto 🚀2.16x speedup on Llama 7B

@AkshatS07 @bilgeacun @bwasti @Ahhegazy77 @BeidiChen @CarolejeanWu
View quoted post on X