Twitxy Saved

Andreas Krause

Verified account This account is verified. Learn more

@arkrause

Professor at ETH Zurich
Zurich las.ethz.ch/krausea.html Joined March 2011
458 Following 5.8K Followers 328 Posts

Latest posts 5

Andreas Krause Verified account @arkrause
How can one steer generative flow models (e.g., for geometric molecular design) not via explicit hand-designed reward functions but implicitly via high-level discovery goals expressed in natural language? LFD provides an approach to do so along with scientific case studies.
Riccardo De Santi Verified account @r_de_santi Oct 14
We’re bringing natural-language control to any scientific generator.

We are very excited to introduce LLM-to-Flow Distillation (LFD), a method to adapt scientific generators to high-level natural-language discovery goals.

Starting from textual goals like “design peptides with promising anticancer activity” or “design small molecules binding to the D2 dopamine receptor”, LFD distills high-level goal-related knowledge from LLMs into scientific generators through iterative DPO on LLM-generated sub-goals.

🔥 LFD does not need task-specific proxy rewards, works with any frontier LLM via API-access, and outperforms state-of-the-art reward-guided methods such as FlowGRPO and DiffusionNFT on held-out computational evaluations. (1/6)
View quoted post on X
0 replies 1 reposts 32 likes 2.4K views View on X
Andreas Krause Verified account @arkrause
Turns out self-distillation (via SDPO) is also a promising way to align, personalize and continually adapt LLMs directly from user conversations, without requiring any explicit preference labels or reward models! @ETH_AI_Center
Deployed LLMs and users generate millions of conversations every day.

These are full of useful learning signals, yet we don't use them for training.

We introduce self-distillation for learning directly from user conversations – no rewards, no labels, no extra models.
View quoted post on X
0 replies 4 reposts 41 likes 6.4K views View on X
Andreas Krause Verified account @arkrause
SDPO enables RL agents to learn from rich feedback (i.e., not only whether an attempt failed, but why it failed, such as error messages). Even without such rich feedback, SDPO can reflect on past attempts and outperform GRPO. SDPO accelerates solution discovery at test time!
Jonas Hübotter Verified account @jonashubotter Jan 29
Training LLMs with verifiable rewards uses 1bit signal per generated response. This hides why the model failed.

Today, we introduce a simple algorithm that enables the model to learn from any rich feedback!
And then turns it into dense supervision.

(1/n)
View quoted post on X
Andreas Krause Verified account @arkrause
Exciting work by our startup @latticeflowai ! Assessing risks associated with AI models on a deep technical level is essential for their successful deployment!
@ETH_AI_Center
LatticeFlow AI @latticeflowai May 13, 2025
🚨 We have BIG news to share today, we’re introducing AI Insights -  the First Independent LLM Evaluation Service for Risk & Readiness.

🔗 insights.latticeflow.ai
View quoted post on X