cammarata psyop aside, it is an honor to see one of the modern mechinterp GOATs acknowledge @yaboilyrical and @qorprate's work. expect more bangers from these two
Additionally, there is a large body of academic work (including mine) that has gradually and cautiously added to evidence that MLP neurons are an interpretable basis. It's been a bit of a heterodox line of work historically so it'd be good to see them get due credit. They surely support the conceptual claims of the blogpost:View quoted post on X
- 2020: @megamor2 et al. arxiv.org/abs/2012.14913 MLPs as KV memories
- 2021: Damai Dai et al. arxiv.org/abs/2104.08696 "knowledge neurons"
- 2023: @_AmilDravid et al. arxiv.org/abs/2306.09346 "rosetta neurons"
- 2024: @YGandelsman et al. arxiv.org/abs/2406.04341 gradient effects of vision model neurons
- 2024: @damichoi95 @vvhuang_ et al. transluce.org/neuron-descrip… autointerp on LM neurons
- 2025: me @ZhengxuanZenWu @TransluceAI transluce.org/neuron-circuits arxiv.org/abs/2601.22594 neuron basis is sparse in LMs
- 2026: @yaboilyrical et al. arxiv.org/abs/2605.12290 steering refusal w/ neurons
(not comprehensive by any means!)
