Twitxy Saved

Navid Azizan

Verified account This account is verified. Learn more

@NavidAzizan

@MIT Prof | machine learning, systems & control, optimization | Prev: @Stanford, @Caltech, @GoogleDeepMind
Cambridge, MA azizan.mit.edu Joined June 2018
294 Following 1.7K Followers 114 Posts

Latest posts 5

Navid Azizan Verified account @NavidAzizan
arxiv.org HardFlow: Hard-Constrained Sampling for Flow-Matching Models via... Diffusion and flow-matching have emerged as powerful methodologies for generative modeling, with remarkable success in capturing complex data distributions and enabling flexible guidance at...
MIT LIDS @MITLIDS Sep 16
When #AI operates in the physical world, “pretty close” may not cut it. LIDS researchers developed HardFlow, a method that helps pretrained generative AI satisfy hard constraints while improving solution quality — without retraining. bit.ly/4xydxBN
View quoted post on X
Navid Azizan Verified account @NavidAzizan
Excited to be at #NeurIPS with several of my brilliant students! Some of them are looking for internships and full-time roles, and we are also recruiting new students and postdocs—come find us at any of these sessions!
- @young_j_park will present "Know What You Don't Know: Uncertainty Calibration of Process Reward Models" arxiv.org/abs/2506.09338
- @KavehAlim will present "Activation-Informed Merging of Large Language Models" arxiv.org/abs/2502.02421
- @youngjaem0 will present "HardNet: Hard-Constrained Neural Networks" arxiv.org/abs/2410.10807
- Haoyuan Sun will present "On the Role of Transformer Feed-Forward Layers in Nonlinear In-Context Learning" arxiv.org/abs/2501.18187
- Andrea Goertzen and Sunbochen Tang will present "ECO: Energy-Constrained Operator Learning for Chaotic Dynamics with Boundedness Guarantees" arxiv.org/abs/2512.01984

Huge thanks to our amazing co-authors and collaborators—@HW_HaoWang, @KGreenewald, Amin Heyrani Nobari, Ali ArjomandBigdeli, @variational_i, @_faezahmed, @jababi, Ji Young Byun, and Rama Chellappa—and to @MITIBMLab, @Amazon, @Google, and @MathWorks for their support.

#NeurIPS2025 @NeurIPSConf
@MIT @MITEngineering @MIT_SCC @MITMechE @MITEECS @MITAeroAstro @MITChemE @MITIDSS @MITLIDS
1 replies 3 reposts 22 likes 2.4K views View on X
Navid Azizan Verified account @NavidAzizan
Introducing Instance-Adaptive Inference-Time Scaling!

Paper: arxiv.org/abs/2506.09338
Code: github.com/azizanlab/inst…
🧠 Inference-time scaling lets LLMs spend more compute to solve harder problems, but not every question needs that!

After all, we don’t use a whiteboard to solve 1 + 1. So why should an LLM?

Introducing Instance-Adaptive Inference-Time Scaling, a smarter way to allocate compute during inference.

💡 By calibrating PRMs, we can estimate how likely each reasoning step is to lead to a correct answer. This lets us:
- Use less compute on easy questions and on likely incorrect reasoning paths
- Spend more compute on harder questions and on promising reasoning steps
🎯 Same accuracy, up to 50% less compute.

Paper → arxiv.org/abs/2506.09338
Code → github.com/azizanlab/inst…
Calibration dataset → huggingface.co/datasets/young…
Calibrated PRMs → huggingface.co/collections/yo…

Joint work with @KGreenewald, @KavehAlim, @HW_HaoWang, and @NavidAzizan.
View quoted post on X
0 replies 2 reposts 15 likes 2.6K views View on X
Navid Azizan Verified account @NavidAzizan
arxiv.org Training-Free Uncertainty Estimation for Embedding Models Embedding models, often obtained via self-supervised learning, extract general-purpose representations from data. Quantifying the reliability of these representations is crucial, as many...
How to assess a general-purpose AI model’s reliability before it’s deployed. A new technique from MIT LIDS researchers @NavidAzizan and Young-Jin Park enables users to compare several large models and choose the one that works best for their task. bit.ly/3zNWiEf
View quoted post on X
2 replies 3 reposts 15 likes 4.9K views View on X