Twitxy Saved

Helen Toner

Verified account This account is verified. Learn more

@hlntnr

AI, national security, China. Part of the founding team at @CSETGeorgetown (opinions my own). Author of Rising Tide on substack: helentoner.substack.com
cset.georgetown.edu Joined November 2014
1.3K Following 39K Followers 2.3K Posts

Latest posts 5

Helen Toner Verified account @hlntnr
...he literally did the SNL skit
0:12
Bearly AI Verified account @bearlyai 1d
Dario’s concluding pitch in the Anthropic IPO roadshow video that dropped today:

“If today we look at things like cancer, Alzheimer’s, heart disease, mental illness. These will be relics of the past in. I think, less than a decade."

I believe that the company which gets the risks right will also be the company that has the license to operate that society trusts and society believes can build the benefits in the right way.

I think if we do this right, we can create an age of miracles where humanity is able to solve problems that have eluded us for millennia.

We have to make sure that all the risks, all the ways that things can go wrong with this technology, we very carefully address those risks as we bring the benefits, and as we have a viable business at the same time.

I invite you to join us on the next phase of this journey.”
View quoted post on X
7 replies 37 reposts 434 likes 165K views View on X
Helen Toner Verified account @hlntnr
Unfortunate for someone playing a senior role in US AI policy (via the new SI Force) to get so many basic facts wrong here.

- The agents *were* sandboxed, and used zero days (ie previously unknown cyber flaws) to escape their sandboxes
- The agents *were* given specific constraints on how to succeed at the benchmark, and flagrantly contravened them
- The agents did *not* go hunt for the answers to the test (they already had the answers, by cheating); 1200 agents coordinated via tens of thousands of messages over several days on much more ambitious and weird attempts to *not be caught* for cheating, and hacking Hugging Face was one side quest along the way

I know there has been an avalanche of different incidents over the past few months, and in some cases the sandboxes were misconfigured or it's not clear how far the agents strayed from what they were told. I have sympathy for anyone struggling to keep up.

But the HF incident is distinct, and is actually extremely informative about where AI development is and where it's going. Fortunately there are public writeups that do let us understand at least the basics of what happened. I hope Shyam reads them soon.
Jawwwn Verified account @Jawwwn Oct 11
Palantir CTO @ssankar on the OpenAI - Hugging Face incident:

"The models did not do anything they were not instructed to do."

"First you have human error. They were not in a sandbox. They had access to the internet. It was a horrible cybersecurity configuration."

"Then from that perspective, they were asked to succeed at a specific benchmark, and they were not given constraints on how to do that. They said, 'Oh, the best way to succeed at the benchmark is to get the answers to the test.'"

"I think it's a defective product."

Via @margbrennan @FaceTheNation
View quoted post on X
44 replies 160 reposts 1K likes 80K views View on X