I've been curious how much we can quantize SAE training so we can train huge SAEs on a single GPU. I had Silico evaluate how much we can quantize SAE training before results degrade. 馃У
Silico, the platform for ambitious AI research, is publicly available today.View quoted post on X
AI is advancing fast. The tools to understand it need to advance even faster. Silico lets you interpret and train your models at frontier scale.
Learn more + get access 馃У