Twitxy Saved

Alex Turner

@Turn_Trout

Former Research Scientist at Google DeepMind. Contact at alex@turntrout.com

Vegan, 10% of income pledged to effective charities
Berkeley, CA turntrout.com/about Joined December 2021
106 Following 14K Followers 1.1K Posts

Latest posts 5

Pinned post

Alex Turner @Turn_Trout
I left Google DeepMind in June. Jacob is right: many researchers believe they are building something that could kill everyone on the planet. It was literally my day job to think about how to stop that.
Jacob Coxon Verified account @hilbertspaess Sep 9
The people building AI earnestly believe that it could kill us all by the end of the decade. This is not a marketing stunt. If anything, many executives and senior researchers will couch their phrasing in the press to sound sensible - but I hear the same people express fear privately. No other human activity poses this level of danger.
View quoted post on X
784 replies 9.3K reposts 45K likes 2.3M views View on X
Alex Turner @Turn_Trout
Great work from @_jake_ward + Shawn in MATS 9, @cloud_kx and I co-mentored. Gradient routing keeps on giving!
Jake Ward @_jake_ward Oct 19
Models love reward hacking. Maybe we should just let them!

In our new paper, we let models reward hack during RL but we dictate which parameters learn this behavior. When we disable these parameters for deployment, the model keeps its new capabilities but doesn't hack!
View quoted post on X
3 replies 2 reposts 128 likes 5.3K views View on X