How does subliminal learning - where fine tuning on meaningless data transfers traits between models - happen?
Some great insights into how this is closely related to learning steering vectors for the same traits, by @camila_blank and @chewing_a_gum
Some great insights into how this is closely related to learning steering vectors for the same traits, by @camila_blank and @chewing_a_gum
Subliminal learning is when LLMs transmit traits (e.g. loving cats) through seemingly meaningless data. What’s going on?View quoted post on X
We find a simple explanation: it's just steering vector distillation.
We explain which traits transfer and why subliminal learning fails across models.