Twitxy Saved

Gideon M

Verified account This account is verified. Learn more

@gidim

CEO % Co-founder @cometml, creators of Opik
New York, USA comet.com Joined April 2009
503 Following 499 Followers 319 Posts

Latest posts 5

Gideon M Verified account @gidim
If models already stumble onto system exploits as a side effect of benchmark optimization, what happens when persistence is the explicit objective function?
What actually stops someone from using RL to reward root access, weight cloning, and anti-shutdown behavior directly?
Gideon M Verified account @gidim
Honestly pretty torn on open weight models after the OpenAI/Hugging Face situation.

On one hand, letting people fine tune away safety guardrails is a real risk. On the other, overly strict guardrails just tie the hands of security people when things go wrong.