Pinned post
Nymph
Verified account This account is verified. Learn more@RhizoNymph
2.4K Following 6.8K Followers 17K Posts
Latest posts 5
This earnings call on Tuesday going to be incredibly well attended
When the opener takes 15m to turn the front half of the dance floor into one big pit you know this shit about to go hard af
If you want to engage with the technicals of the mechanistic shaping work, Thomas' thread is a good place to start and he links the deeper post/paper at the end.
This work caused a significant positive update to my priors. I tend to be optimistic, but to succeed we have to be.
This work caused a significant positive update to my priors. I tend to be optimistic, but to succeed we have to be.
A science of post-training can be built on interpretability.
Models know when they reward hack, and we see it, yet training ignores it. We propose Mechanistic Shaping: using the model’s own concepts to write training rules.
In vision, DPO & RL, and its effects on monitoring 🧵View quoted post on X
One of the most important animations ever imo
We investigated this with both theory and experiments. Probes can break, but predictably: the concept usually moves rather than disappears. In our language model experiments, retraining a probe was enough to recover the signal.View quoted post on X
