Twitxy Saved

Ethan Roland

@ModuloRoland

AI Researcher
Atlanta, USA Joined August 2014
219 Following 297 Followers 286 Posts

Latest posts 5

Pinned post

Ethan Roland @ModuloRoland
Excited to share our new work with @AnthropicAI

Our new paper (ICML 2026, Spotlight) tackles frontier model misuse by isolating select knowledge into detachable modules during training, enabling an on/off switch for dangerous capabilities during inference.
Anthropic Verified account @AnthropicAI Jul 8
We’re pleased to have collaborated with AE Studio on this research.

Read more here: anthropic.com/research/off-s…
View quoted post on X
1 replies 1 reposts 14 likes 3.5K views View on X
Ethan Roland @ModuloRoland
Awesome work!! Really glad folks are pursuing GR in a posttraining setting
Jake Ward @_jake_ward Oct 19
Models love reward hacking. Maybe we should just let them!

In our new paper, we let models reward hack during RL but we dictate which parameters learn this behavior. When we disable these parameters for deployment, the model keeps its new capabilities but doesn't hack!
View quoted post on X
Ethan Roland @ModuloRoland
wow what an interesting spin on nanogpt
Samip Verified account @industriaalist Oct 12
Replacing backprop with zeroth-order optimization is inevitable.

Introducing Noise: a speedrun for pretraining without backprop.

Last week we presented Dust, the first method to approach backprop with SGD for pretraining transformers. We think another 1,000x improvement on top of it is possible, and it will require *co-designing* credit assignment, optimizers, architectures, and eventually, hardware.

We built Noise to iterate on this faster.
View quoted post on X