Twitxy Saved

Linas Nasvytis

Verified account This account is verified. Learn more

@LinasNasvytis

PhD @Stanford. Experience-efficient reasoning / scientific discovery
Prev @GoodfireAI
Stanford, CA 馃嚭馃嚫 linasnasvytis.com Joined September 2021
474 Following 964 Followers 108 Posts

Latest posts 5

Pinned post

Linas Nasvytis Verified account @LinasNasvytis
1/ New preprint! Reasoning models often require hundreds of task examples and thousands of rollouts to improve on a task. How can they learn more from much less?

Introducing CORE: contrastive self-reflection for rapid, sample-efficient, and interpretable self-improvement 馃У
5 replies 31 reposts 156 likes 20K views View on X
Linas Nasvytis Verified account @LinasNasvytis
incredibly exciting time to do interp!
Nick Verified account @nickcammarata Oct 15
interpretability might be the most important scientific problem in the world right now, as I don't think we can solve alignment if we don't know what we're building. I think I have good news about it. I co-authored early work in mechanistic interpretability at OpenAI and came away pessimistic, because neural networks appeared to fold into arbitrary tangled knots. years later, I started openai's first large-scale automated interpretability project, finding about 2% of neurons legible with the primitive tools we had

with modern agentic tools and a much closer look, the picture looks totally different. the vast majority in models up to trillions of parameters are legible, and their circuits beautiful. many famous examples of tangled neurons turned out to be misunderstood. The roadblocks I expected mostly aren't there. I now think ambitious interpretability will be solved by the time we need it most, and possibly quite soon, as automated scientists keep improving. it may be a bitter lesson for interpretability: the simple thing, at absurd scale, works

already-clean.goodfire.com
View quoted post on X
2 replies 0 reposts 12 likes 383 views View on X
Linas Nasvytis Verified account @LinasNasvytis
When @michaelyli_ strikes, he strikes hard
Michael Y. Li Verified account @michaelyli_ Sep 25
Can an LM, starting from random init (!!), learn to generate all of its pretraining data?

Introducing Self-Play Pretraining with Zero Data. Two models start from random initialization: a generator proposes programs for a universal Turing machine and a learner trains on their outputs. We never train on any real data, but see predictable scaling on natural datasets: zero-shot val loss on images, text, audio, and melodies decreases predictably with self-play compute. And the learner develops in-context learning capabilities.

A fun proof-of-concept, co-led with @AdityaCowsik and @KfirDolev and co-authors @gbruno_dl, @ANourya @noahdgoodman, and @YoavLevine.
View quoted post on X
0 replies 0 reposts 15 likes 1.5K views View on X
Linas Nasvytis Verified account @LinasNasvytis
Simple activation probes help us discover reward hacks that LLM monitors miss, even on new environments the probes were never trained on.

Reading what the model says it鈥檚 thinking can only tell us part of the story. Incredibly excited about using internal activations to better monitor and discover reward hacking!

arxiv.org/abs/2609.19101
arxiv.org Monitoring and Discovering Reward Hacking with Internal... As models scale, reward hacking becomes more frequent, more sophisticated, and more consequential. Does it leave a telltale signature in model representations? This work analyzes how reward...
Goodfire @GoodfireAI Sep 17
Models know when they鈥檙e reward hacking. But they still do it a ton - in 50-96% of rollouts we studied!

We built activation monitors that detect the behavior behind the Hugging Face hack in real time. This can help us stop hacks now - and train future models that don鈥檛 cheat. 馃У
View quoted post on X
2 replies 8 reposts 49 likes 3.6K views View on X
Linas Nasvytis Verified account @LinasNasvytis
Silico has changed the way I do research, really excited this is out! Try it.
Goodfire @GoodfireAI Aug 4
Silico, the platform for ambitious AI research, is publicly available today.

AI is advancing fast. The tools to understand it need to advance even faster. Silico lets you interpret and train your models at frontier scale.

Learn more + get access 馃У
View quoted post on X