Twitxy Saved

Adhi Saravanan

@adhisarav

adh1s.github.io Joined July 2023
548 Following 152 Followers 29 Posts

Latest posts 1

Pinned post

Adhi Saravanan @adhisarav
Very excited by this line of work - lots to build!
Michael Albergo Verified account @msalbergo Apr 26
New paper! Presenting Discrete Flow Maps:

paper: arxiv.org/abs/2604.09784
blog: malbergo.me/discrete-flow-…

A laughable problem for me these days is that @nmboffi and I share a research brain, and we have had, time and again, a conversation that ends with “ha so I guess we’re writing the same paper.” Soon we will return to just doing it together :). Here we are doing it again with discrete flow maps and flow language models! A complete and thorough paper led by @PPotaptchik @json_yim @adhisarav @peholderrieth. We took a bit of time to post it to ensure we understood a few more things about the stability of the loss functions.

Like @osclsd , @FEijkelboom, and @nmboffi , we think this could be a very helpful paradigm for thinking about fast inference and even better alignment!

Here’s our version of the story, and I hope it makes clear how green field this research direction is — we provide a comprehensive picture of the KL losses you can write from the properties of the flow map, some nice geometric proofs about the mean denoiser and the simplex, and find that at this time, the ESD can actually be the most performant, with some caveats. Excited for everyone to work together and push this class of models to their limit!
View quoted post on X