We have a new paper on topic models!
We introduce Mechanistic Topic Models (MTMs). MTMs model SAE feature counts rather than words or plain embeddings, combining the benefits of LLM-based and probabilistic topic models.
Paper (published in TACL) : arxiv.org/abs/2507.23220
We introduce Mechanistic Topic Models (MTMs). MTMs model SAE feature counts rather than words or plain embeddings, combining the benefits of LLM-based and probabilistic topic models.
Paper (published in TACL) : arxiv.org/abs/2507.23220
1:46