Twitxy Saved

Melvin Johnson

Verified account Google DeepMind

@melvinjohnsonp

Post-Training lead, Gemini, @GoogleDeepMind
Joined September 2014
397 Following 27K Followers 388 Posts

Latest posts 5

Melvin Johnson Verified account @melvinjohnsonp
Today we’re rolling out Gemini 4 Hydrogen! While teams rely on Gemini 4 Carbon and Gemini 4 Argon for deep architectural judgment and untangling subtle bugs, you also need a fast, disciplined model for writing code, running tests, and verifying changes.

Hydrogen stands on its own for everyday work, surpassing Argon on the Artificial Analysis Intelligence Index at its default thinking level (51 vs. 50, reaching 54 at xhigh)....or pairs with Carbon as the high-efficiency execution engine in multi-model workflows. It is at the pareto for speed vs quality and has been delivering fast frontier intelligence for our teams.
15 replies 55 reposts 449 likes 16K views View on X
Melvin Johnson Verified account @melvinjohnsonp
Another great private benchmark by @danielmckinn0n. Carbon shines on both rare disease detection and lab experiment prediction.
Daniel McKinnon Verified account @danielmckinn0n 2d
Big G remains 👑 of rare-disease evals.

@GoogleDeepMind Gemini 4 Carbon and @AnthropicAI Fable 5.2 tie for first on @GamowLabs RareBench, solving a staggering 61.5% of problems.

When I started this work, GPT 5.4 only eeked out 9%. Anyone saying AI will not transform healthcare is out of their mind at this point. Stay tuned for an updated, harder RareBench v2 now that this task is close to saturated.

Gemini Carbon stands alone in first place on LabBench, which measures the model's ability to interpret real rare-disease laboratory data and predict the next experiment.

A tip of the hat to both GDM and Ant for their tremendous work in this space. I am very confident that we are getting on a trajectory to solve rare disease in the next few years.
View quoted post on X
4 replies 4 reposts 97 likes 10K views View on X
Melvin Johnson Verified account @melvinjohnsonp
Thanks for testing Carbon. It’s great to see hard private evals validate the strength of the model. Carbon is just behind the best model but 4.5x cheaper.
Paweł Huryn Verified account @PawelHuryn 2d
What a day! I tested Gemini 4 Carbon on real work. 2 repos, 105 replanted bugs. Find and fix what you can.

It scores just behind Fable 5.2. The results:

- Fable 5.2 (max): 58 for $139.65
- Gemini 4 Carbon (high): 57.3 for $31.32
- Sonnet 5.5 (max): 51.3 for $154.03
- GPT-6 Astra (max): 45 for $33.03
- GPT-6.1 Sol (max): 44.3 for $5.88
- Gemini 4 Argon (high): 40.7 for $7.16

Google's own benchmarks looked super strong, but nobody could access the model. Turns out they didn't lie: +16.6 points over Argon, at less than a quarter of Fable 5.2's cost.

Nobody should be laughing at Google anymore.

(the next effort level drops soon in the thread 🧵)
View quoted post on X
13 replies 17 reposts 348 likes 24K views View on X
Melvin Johnson Verified account @melvinjohnsonp
Today we’re rolling out Gemini 4 Carbon, our strongest model with frontier performance in cybersecurity capabilities and long-horizon agentic workflows.

We’ve poured a lot of love into it, and it’s very good at working through hard problems.