Twitxy Saved

Shashwat Goel

Verified account This account is verified. Learn more

@ShashwatGoel7

Training AI Co-Scientists | openforecaster.github.io
shashwatgoel.com Joined June 2020
2.7K Following 4.6K Followers 2.3K Posts

Latest posts 5

Pinned post

Shashwat Goel Verified account @ShashwatGoel7
I made lasteval.com. The premise is simple: AI is already improving lives, and we should have a page that collects these wins.

We only talk about how "intelligent" the models are, what jobs they might automate, the trillions being invested, who will "win" the AI race, and the safety risks. All these things naturally worry people, and make them averse to AI. I think we're missing the point.

The goal of technology should be to improve people's lives. AGI, ASI, RSI are all just in-group goals, that aren't obviously beneficial on their own. Speculative promises shouldn't be all we have to offer. Imagine releasing a new model and saying "it will score 99% on these benchmarks one day" instead of reporting what it already does today.

I've spent the last few weekends reading about AI systems, both generative and predictive, that are already making a large positive impact on the world. It gives me hope, and I made this page so it does the same for others. Some examples in 🧵

Ultimately, the final, and only evaluation for AI that matters is whether it improved lives. The models are already so good, and yet the world is not that different. I think it's important to change that, and this is my attempt to paint the target.

There's no way the list is complete, so if you think an AI system has had a large positive impact, do share it through the submit page!
15 replies 33 reposts 203 likes 25K views View on X
Shashwat Goel Verified account @ShashwatGoel7
The information company is now best at predicting future information
Nikhil Chandak Verified account @nikhilchandak29 9h
GOOGLE KEEPS SHIPPING SOTA MODELS 🥇

Gemini 4 Neon achieves the highest score on FutureSim!

It launched 500+ subagents(!), performed over 16K tool calls and wrote simulations for 50+ questions spaning state elections, sports matches, job displacement, stock market and more!

Truly incredible comeback from Google.
View quoted post on X
2 replies 0 reposts 32 likes 904 views View on X
Shashwat Goel Verified account @ShashwatGoel7
FutureSim Q3 is a wrap. And the winner is...

Gemini 4 Carbon!

It does cool shit, like building simulators to predict world cup winners.

Q3 results clearly mark a step jump in continual learning... just emerging in-context. Look at that Inkling 2 Small rise!
6 replies 3 reposts 52 likes 3.5K views View on X
Shashwat Goel Verified account @ShashwatGoel7
Banger release

Recursive self improvement is well and good. But can models, told nothing else, release new models people (or agents) find useful?

Dynamic open-ended eval that can't be saturated, just like the stock markets, and requires taste.
Maksym Andriushchenko Verified account @maksym_andr 3d
Today we’re releasing our new project: Horizon Labs. Eventually, we will hand off the ~whole economy to AI—how well will it actually work?

We have a glimpse of this future. We’ve created an autonomous AI ‘company’ using one Claude Code subscription and a few GPUs. Within only 1.5 months of running Horizon Labs, Opus 5.5 managed to train genuinely useful models and get them downloaded 55k times. These models have been widely used since then: they appeared in 100+ github repos and got cited in 2 research papers.

This is for sure one of the most exciting projects I’ve been involved in. It shows how the future economy driven by AI will look like.

All details are here: horizon-labs.ai.
View quoted post on X
0 replies 4 reposts 34 likes 1.6K views View on X
Shashwat Goel Verified account @ShashwatGoel7
Inkling started from the bottom and adapts it's predictions to match gpt 6.1 sol 📈

0.05 -> 0.28 without finetuning.
Nikhil Chandak Verified account @nikhilchandak29 3d
Inkling is the best open-weights model on FutureSim!

It shows the largest improvement at test time across any model.

It starts the lowest and climbs all the way to the top, outperforming even Muse Wonder and landing right next to GPT-6.1-Sol.
View quoted post on X