Nick Levine

New work with @AlecRad and @DavidDuvenaud:

Have you ever dreamed of talking to someone from the past? Introducing talkie, a 13B model trained only on pre-1931 text.

Vintage models should help us to understand how LMs generalize (e.g., can we teach talkie to code?). Thread:

talkie has a lot of jesus neurons

agents have no sense of time but they value promptness

Sometimes I remember that “The Beatles” is a pun and

New work with @DavidDAfrica:

We reproduced emergent misalignment and subliminal learning in talkie, a model trained on pre-1931 text.