Sophie Wang

@SophieLWang

Studying intelligent representations @MIT_CSAIL

sophielwang.com Joined November 2023

165 Following 3.3K Followers 271 Posts

Latest posts 5

Pinned post

Sophie Wang @SophieLWang Oct 6

Can “chicken” make a base model reason? 🐔

Yes!

Why? With the right first tokens, base models can match RL in reasoning. We trace this to learned training data associations and use a simple data edit to make “chicken” elicit reasoning too.

blog: sophielwang.com/cues

0:11

Sophie Wang @SophieLWang Oct 19

From the archives 🦫

Sophie Wang @SophieLWang Oct 12

I wrote a blog post detailing the writing approach I took while working on my recent paper: sophielwang.com/blog/paper-wri…

I describe the behind the scenes for how this paper came to be, why and how I storyboarded figures before running experiments, and some figure design tips! :)

Sophie Wang @SophieLWang Oct 6

Can “chicken” make a base model reason? 🐔

Yes!

Why? With the right first tokens, base models can match RL in reasoning. We trace this to learned training data associations and use a simple data edit to make “chicken” elicit reasoning too.

blog: sophielwang.com/cues

View quoted post on X

Sophie Wang @SophieLWang Oct 9

Super interesting work showing that representations can be aligned across modalities using an orthogonal transformation!

Dominik Schnaus @dominik_schnaus Oct 9

DINOv2 has never seen a caption, and Qwen3 has never seen an image. We still aligned their embedding spaces without a single image-caption pair.

It even works when the images and the captions come from different datasets.

Project page: dominik-schnaus.github.io/unpaired-roset…

⬇️

View quoted post on X

Sophie Wang @SophieLWang Oct 7

In our blog post, you can interactively explore the reasoning effect of token cues and RL on base models!

📎 paper: arxiv.org/abs/2610.06851
✍ blog: sophielwang.com/cues
💻 code: github.com/sophicle/cues

0:08

0:13

Sophie Wang @SophieLWang Oct 6

Can “chicken” make a base model reason? 🐔

Yes!

Why? With the right first tokens, base models can match RL in reasoning. We trace this to learned training data associations and use a simple data edit to make “chicken” elicit reasoning too.

blog: sophielwang.com/cues

View quoted post on X