Pinned post
Dhara Yu
@dharakyu
PhD student @UCBerkeley interested in cognition and computation, prev BS+MS @Stanford
143 Following 238 Followers 90 Posts
Latest posts 5
New blog post: there has been a lot of movement toward embedding third-party evaluation organizations within frontier AI companies to measure capabilities/risks. How could that actually work? I went to this conference (hosted by @evaluatingevals) learn more
Cool work from @Karim_abdelll - in additional to identifying a new risk vector for misalignment, this setup is an interesting testbed to study how model conceptualizations (safety related or otherwise) might evolve as they are trained on AI outputs
New surprising result:View quoted post on X
We trained AI recursively on its own safe generations, while giving it a benign cue. Models became increasingly misaligned over time, giving advice on how to do harm and build biological weapons.
We call this Progressive Misalignment. 馃У馃憞