📢 New EMNLP 2026 paper and open model! A Language Model from 1913. A collaboration across UCL NLP, Oxford, UWaterloo, and Adelaide.
Our paper on History Language Models has been accepted to the EMNLP Main Conference!View quoted post on X
We trained TypewriterLM, a 7B model on 54 billion tokens of historical text published before 1913.
Paper: arxiv.org/abs/2606.02991…