Anson Lei

@AnsonISL

DPhil student @a2i_oxford | Machine Learning, Causality, Robotics

Oxford, England Joined March 2020

178 Following 121 Followers 18 Posts

Latest posts 3

We’ve been thinking a lot about what it means for a model to understand the world, and prediction alone doesn’t seem to be the full answer.

This is our attempt to write down our thoughts on AI and scientific discovery, and how mechanistic structures might be the answer.

Ingmar Posner @IngmarPosner Jul 16

Introducing: Mechanistic World Models.

Scientific discovery is not just prediction. It requires uncovering the mechanisms generating what we observe. A capability current ML lacks.

With @AnsonISL and @bschoelkopf.
@a2i_oxford, @oxengsci and @MPI_IS.
arxiv.org/abs/2607.12474

View quoted post on X

Anson Lei @AnsonISL Dec 6, 2024

Very excited to share our new work - SPARTAN: A Sparse Transformer Learning Local Causation.

We develop a Transformer world model that learns local causal dependencies between entities, leading to improved adaptation efficiency and robustness with accurate prediction.

🧵

0:31

Anson Lei @AnsonISL Jul 4, 2022

Super excited to share our new work - a personal first - Variational Causal Dynamics (VCD).
We trained a latent state space model with a causal and modular structure for efficient adaptation.
Work at @a2i_oxford with @bschoelkopf, @IngmarPosner
Paper: arxiv.org/abs/2206.11131
1/3

0:31