😺
CATransformers is a carbon-driven neural architecture and system hardware co-design framework. Using CATransformers, we discover greener CLIP models that achieve an average of 9.1% reduction potential in total lifecycle carbon emissions while maintaining accuracy (or increasing accuracy) and latency.View quoted post on X
This research is the first to look into carbon-driven neural architecture and system hardware co-design. It is enabled by a first-of-its-kind architectural carbon modeling tool – ACT, which we developed at FAIR.
Check out:
Our paper ➡️ go.fb.me/nedmh0;
code repository ➡️ go.fb.me/7jcp6q;
and the additional carbon design tools and research artifacts in Sustainable AI ➡️go.fb.me/csee32