Twitxy Saved

Adam Shai

Verified account This account is verified. Learn more

@adamimos

simplexaisafety.com Joined June 2022
472 Following 1.8K Followers 397 Posts

Latest posts 5

Adam Shai Verified account @adamimos
All I ask is that people are honest, even if just to themselves, about their expectations of AI abilities over the last 3 years and months of progress.
Sridhar Ramesh @RadishHarmers Sep 23
To be clear, I don't actually think math is dead. I just worry it is. I'm aware that things can be true that I don't think are true. I didn't think an LLM would crack a Millennium Problem in mid-2026 either.
View quoted post on X
0 replies 1 reposts 4 likes 1.3K views View on X
Adam Shai Verified account @adamimos
Great advice. Good writing is music. Your ears can tell.
XY Han Verified account @XYHan_ Sep 13
the easiest way to edit papers is actually just to read it out loud. if any of the below happens, its a sign the paper is not clear enough and edits are needed:

* you are just saying words and you don't even understand what's happening
(that's a sign its not clear enough)

* the sentence is a mouthful with lots of clauses. you run out of breath just saying it.
(that's a sign that the sentence needs to be broken up)

* the sentence is awkward spoken out loud
(then it is awkward written down too)

* it feels like you're just saying math symbols or reciting numbers (this is a sign that it is too technical or too dry)

* you don't even enjoy the process of reading it aloud (that's a sign that the style and presentation is too dry/unclear/slow)

* you say symbols and you forget what they mean yourself or where you defined them
(that's a sign you need to hint/remind readers what they are)
View quoted post on X
Adam Shai Verified account @adamimos
We've just published our nonergodic post on @lesswrong . Especially good for conversation/discussion!

We think this is especially important for those interested in understanding model internals in LLMs.

lesswrong.com/posts/JfJ4WTRH…
www.lesswrong.com The Geometry of Nonergodic Composition — LessWrong • Telescoping cones recovered by linear regression from a transformer’s residual-stream activations. Each component grows and shrinks in accordance…
Adam Shai Verified account @adamimos Sep 9
Training data for LLMs is made up of many sources. Given that, what structure should we expect in the activations?

New work from Simplex shows how the belief geometry over this type of data forms telescoping cones, and transformers represent them! 🧵👇

simplex.pub/nonergodic-geo…
View quoted post on X
1 replies 9 reposts 72 likes 3.9K views View on X
Adam Shai Verified account @adamimos
Today, we are launching Belief Updates, the Simplex research blog, with two posts.

Read the welcome post here: simplex.pub/welcome/

And see our post about nonergodicy in the quote.

We are starting Belief Updates for a few reasons: 🧵👇
simplex.pub Welcome to Belief Updates Launch note for Belief Updates, the Simplex research blog.
Adam Shai Verified account @adamimos Sep 9
Training data for LLMs is made up of many sources. Given that, what structure should we expect in the activations?

New work from Simplex shows how the belief geometry over this type of data forms telescoping cones, and transformers represent them! 🧵👇

simplex.pub/nonergodic-geo…
View quoted post on X