Brown NLP

@Brown_NLP

Language Understanding and Representation Lab at Brown University. PI: Ellie Pavlick.

Providence, RI lunar.cs.brown.edu Joined October 2020

145 Following 3.4K Followers 160 Posts

Latest posts 5

LUNAR Lab is looking for a postdoc to work on understanding and interpreting reasoning in LLMs and humans, broadly construed. The position is funded by Schmidt Sciences and is for at least 18 months, with the likely option to extend. Apply here! forms.gle/CrmrCzun79G9Ca…

Brown NLP @Brown_NLP Dec 6, 2024

David Byrne won't be @NeurIPSConf, but we will be!

Jack Merullo @jack_merullo_ Dec 5, 2024

Can we find circuits directly from a model’s params? At Neurips I’m presenting work on understanding how attn heads in LMs communicate by analyzing their weights. We find a lot of interesting things, like a 3D subspace that controls which index in a list to attend to!

View quoted post on X

Brown NLP @Brown_NLP Oct 19, 2024

LUNAR Lab is looking for a postdoc to work on mechanistic interpretability + AI safety/trustworthiness! The position is for two years, with a possibility of extending.

If interested, submit a CV here. Applicants will be considered on a rolling basis. forms.gle/2HFM1BMFxS5ZA3…

Brown NLP @Brown_NLP Apr 29, 2024

Can Large Language Models Understand ‘Meaning’? youtu.be/6iO8TtCs_Cw?si… via @YouTube

Brown NLP @Brown_NLP Nov 17, 2023

Accepted at EMNLP: LLMs often have to integrate information in context with facts learned during pretraining. Sometimes these facts disagree, so how do they handle this competition? We find that we can modulate single attention heads to control which version to use!