Pinned post
Catastrophic forgetting: your model "forgets" a task, and probing confirms the info is gone. Case closed... right?
Not so fast
We found that sometimes tests like probing don't tell the full story. Features are still there, just misaligned or too crowded.
Let's dive in!🧵
Not so fast
We found that sometimes tests like probing don't tell the full story. Features are still there, just misaligned or too crowded.
Let's dive in!🧵
