Daniel Chang

SemiAnalysis Verified account @SemiAnalysis_ · 6d

Today we’re releasing GDPx, a benchmark for measuring agentic capabilities across the most valuable domains.

GDPx is a true frontier-level benchmark: even the best model scores just 12% (1/7)🧵

View quoted post on X

Thomas Wolf Verified account @Thom_Wolf · Jul 22

I don’t believe reality is a simulation, but you genuinely couldn’t script this timeline:

• Two weeks ago: At @swyx’s AI Engineer World’s Fair in SF, I decide at the last minute to introduce my friend @uri_rolls onstage for his talk on cyber benchmarks for infrastructure penetration and access control (see below, amazing team).

I say: “There is a future where cyber is alive and everyone is well protected and I’m pretty sure that future involves open-source models.”

And later: “A big challenge is going to be speed: the speed of attack versus defense. When an intruder starts to enter, you have to see what’s happening and catch them.”

• One week ago: @huggingface is hit by a sophisticated intrusion over the weekend. The traces look unlike anything we’ve seen before and suggest serious AI involvement, but we don’t yet know which model was used.

The closed models we ask for help choke on their guardrails. We need to react fast, so we turn to @Zai_org’s GLM-5.2 to help us analyze the attack.

• Earlier this week: @OpenAI reaches out, discloses what happened, and partners with us on the investigation.

The intruder turns out to be exactly what we had discussed two weeks earlier: a fully autonomous agent, powered by an unreleased frontier model, attempting to gain access to part of our infrastructure.

Sometimes the timeline we live in is genuinely vertigo-inducing.

View quoted post on X

Noam Brown Verified account @polynoamial · Apr 23

I'm a manager at @OpenAI, but with GPT-5.5 I'm a more effective IC than I've ever been. I can now write CUDA kernels like a pro. I can rely on it to run my research experiments. And we know how to make it much more powerful from here.

View quoted post on X