UIUC and Johns Hopkins researchers, with James Rehg, just released a sharp fix for one of the most annoying problems in fast image and video generators: diversity collapse! 🎨
"Restoring Diversity in Distilled Image and Video Generators by Probing Activations"
This paper shows why few-step distilled models produce near-identical samples from different seeds: they keep the teacher's total activation variance but squeeze it into far fewer directions.
It covers where the collapse happens (one intermediate block at the first denoising step), ReDiverse-FT, a lightweight adapter that regresses student activations onto the teacher's, ReDiverse-TF, a training-free fix that steers along the teacher's principal directions, and much more!
Read this excellent paper by Furkan Horoz, Ozgur Kara and collaborators: paperswithcode.co/paper/2611.185…
"Restoring Diversity in Distilled Image and Video Generators by Probing Activations"
This paper shows why few-step distilled models produce near-identical samples from different seeds: they keep the teacher's total activation variance but squeeze it into far fewer directions.
It covers where the collapse happens (one intermediate block at the first denoising step), ReDiverse-FT, a lightweight adapter that regresses student activations onto the teacher's, ReDiverse-TF, a training-free fix that steers along the teacher's principal directions, and much more!
Read this excellent paper by Furkan Horoz, Ozgur Kara and collaborators: paperswithcode.co/paper/2611.185…