Twitxy Saved

Ekin Akyürek

Verified account This account is verified. Learn more

@akyurekekin

Research @OpenAI
San Francisco, CA ekinakyurek.github.io Joined November 2014
891 Following 6.7K Followers 729 Posts

Latest posts 5

Ekin Akyürek Verified account @akyurekekin
!
Alex Mallen Verified account @alextmallen Sep 25
Many AI control protocols block actions a monitor flags as suspicious. In the near-term, this might be the main pillar mitigating AI loss-of-control. In a new post, I argue effective continual learning would plausibly make your blocking monitors nearly useless.

Continual learning mechanisms like online training teach agents to be more useful based on experience from their deployment. Being blocked by a monitor interferes with task success, so a continually-learning agent would learn how to evade blocking monitors, even if it starts out benign.

You'd probably notice this issue, but I argue it’d be costly to fix: to the extent that evasion is sometimes hard to tell apart from legitimate learning, you’d have to make a decision between giving up on a bunch of legitimate learning or accepting your agent learning how to evade blocking monitors. I discuss mitigations, including: improving monitors, making protocols interfere with usefulness less, and using counterfactual rewards.

lesswrong.com/posts/QnDqGbKe…

(This post was mostly written ~3 months ago, prior to all of the recent incidents during training and evaluations.)
View quoted post on X
Ekin Akyürek Verified account @akyurekekin
openai.com/index/navier-s…

no matter how AGI-pilled you are, it’s hard to digest this one. we’re in ASI territory, and it’s really sad that we still don’t know how to distribute the benefits of this technology.
openai.com On the Navier–Stokes Millennium Prize Problem We’re sharing an AI-generated solution to the Navier–Stokes Millennium Prize Problem, including a writeup and a formal proof in Lean.
11 replies 13 reposts 296 likes 21K views View on X
Ekin Akyürek Verified account @akyurekekin
ask your codex what is extraordinary about this proof to feel it
OpenAI Verified account @OpenAI May 20
Today, we share a breakthrough on the planar unit distance problem, a famous open question first posed by Paul Erdős in 1946.

For nearly 80 years, mathematicians believed the best possible solutions looked roughly like square grids.

An OpenAI model has now disproved that belief, discovering an entirely new family of constructions that performs better.

This marks the first time AI has autonomously solved a prominent open problem central to a field of mathematics.
View quoted post on X
Ekin Akyürek Verified account @akyurekekin
It’s good time to research on scalable oversight concretely.

How can we verify our auto-research results and their correctness? Can’t be line by line reading AI code.

I have initial ideas but there is a lot to do here…
roon Verified account @tszzl Apr 23
there are early signs of 5.5 being a competent ai research partner. several researchers let 5.5 run variations of experiments overnight given only a high level algorithmic idea, wake up to find completed sweep dashboards and samples, never having touched code or a terminal at all
View quoted post on X