Yann Dubois

This account is verified. Learn more

@yanndubs

Post-training @OpenAI | PhD @StanfordAILab

San Francisco yanndubs.github.io Joined August 2017

1.3K Following 17K Followers 642 Posts

Latest posts 5

Pinned post

Yann Dubois @yanndubs Sep 3

💫 Astra is out

Highlights:
- Much smarter (evals are really saturating...)
- Much more aligned & trustworthy
- Better CUA (see this house Astra made in Blender)
So proud of the team for training it!

Still some issues:
- Too much code slop
- Astra asks for confirmation too often, which can feel lazy. Given how smart it is, we wanted it to be cautious, but likely overcorrected.
We’ll fix those next! What else should we fix?

Note: Astra follows instructions even more carefully than 5.6, including unwanted ones buried in old skills. I’d clean those up before using it.

openai.com/index/gpt-6-as…

0:20

Yann Dubois @yanndubs Sep 6

We made a big push on decreasing hallucination & making Astra much more trustworthy!

(Nit: to interpret those benchmarks you really need to control for the amount of claims the model make, which neither of those plots show.)

BridgeMind Verified account @bridgemindai Sep 6

GPT 6 Astra finally fixed the hallucination problem.

GPT 5.6 Sol was at 92%. It cancelled every one of my Stripe subscriptions during a migration.

GPT 6 Astra is at 51%. That is the biggest hallucination improvement I have ever seen from any lab in a single release.

And Fable 5.1 went the other way. Anthropic shipped a smarter model that lies more.

The biggest weakness OpenAI models ever had is gone.

View quoted post on X

Yann Dubois @yanndubs Jul 13

☀️Very proud of the team for training 5.6!

A few of my highlights:
- Great front-end aesthetics. E.g., I asked Sol to make a new blog for 5.6 with a celestial theme.
- Much better CUA
- Can work for much longer and is less lazy

But it's not all great:
- The writing quality has improved, but it's still bad in artifacts
- Too many options with models/reasoning/fast mode/Cerebras/multi-agent

We'll fix the above. What else should we improve?

PS: belated post as there are so many other good models to train.

0:15

Yann Dubois @yanndubs Jul 13

Tips when moving to 5.6
-Clean up old instructions. 5.6 follows them carefully, including undesirable ones buried in old skills. We had to clean many of those
-Avoid Ultra if cost-constrained. Multi-agent improves evals+latency but costs much more. Or ask @thsottiaux for resets

Yann Dubois @yanndubs Jun 26

🌞Excited to share the preview of 5.6, it's a good model!

Here you see a comparison to 5.5 xhigh, two things to note:
- we'll have a `max` mode that works for much longer
- sol is a large improvement at the same cost & latency
This is a cyber eval but we see significant gains across the board.

OpenAI Verified account @OpenAI Jun 26

Introducing a limited preview of GPT-5.6 Sol, our next generation frontier model, as well as GPT-5.6 Terra, a balanced model for efficient, everyday work, and GPT-5.6 Luna, a fast and affordable model for high-volume work.

openai.com/index/previewi…
View quoted post on X