Twitxy Saved

Molei Tao

Verified account This account is verified. Learn more

@MoleiTaoMath

Georgia Tech Prof; Tsinghua, Caltech, NYU Courant
* (diffusion) generative model, probabilistic ML
* AI4Science
* deep learning theory
* applied & comput. math
225 Following 2.3K Followers 504 Posts

Latest posts 5

Pinned post

Molei Tao Verified account @MoleiTaoMath
Does GenAI create new knowledge? arxiv.org/abs/2602.06021 gives
* 1st explicit characterization of diffusion model's generalization
* more precise than offered by classical stat. learning theory
* systematic integration of various inductive biases (training+architecture+inference)
arxiv.org Diffusion Model's Generalization Can Be Characterized by... We study a data-dependent notion of diffusion-model generalization: when a model does not memorize the training set, where do its generated samples go relative to the geometry induced by the data?...
4 replies 28 reposts 180 likes 19K views View on X
Molei Tao Verified account @MoleiTaoMath
Want faster language model inference? MDraft trains diffusion drafters with multi-draft on-policy distillation, boosting accepted draft lengths for more efficient speculative decoding!
Petr @pmolodyk Nov 1
[1/8] Can we improve parallel drafters with on-policy distillation?
Introducing MDraft: on-policy distillation for diffusion drafters.
At T=1, mean acceptance length vs. DFlash:
• Qwen3-4B: +11.9%
• Qwen3-8B: +13.4%
Same inference, just swap the drafter checkpoint! 🧵
View quoted post on X
0 replies 0 reposts 11 likes 1.1K views View on X
Molei Tao Verified account @MoleiTaoMath
Latest result in fine tuning of diffusion model, general method, but demonstrated highly effective even for video generations.
Jaemoo Choi @JaemooChoi Oct 9
Simple, efficient, scalable diffusion RL without likelihood ratios?

Meet RVM: Reward-based Velocity Matching

🎯 Rewards directly in velocity space
⚡ Cheap video fine-tuning
🧩 Unifies recent objectives
🎬 Fixes the static-video problem by dynamic motion reward

How it works 🧵
View quoted post on X