Check out our work led by @oussamazekri_! Structured noising process (beyond mask and uniform) could be the next step to push the performances of Diffusion LM.
What if discrete diffusion didn鈥檛 have to be stuck with mask or uniform noise? 馃View quoted post on X
In our new paper, we show how to go beyond them, unlocking much richer noising processes. And the empirical results are surprisingly strong! 馃殌
馃寪 Project Page: oussamazekri.fr/gdds
馃搼 Paper: arxiv.org/pdf/2603.21342
馃捇 Code: github.com/ozekri/gdds
Thread below 馃У