Twitxy Saved

Justin

Verified account Intology

@HJCH0

Locus @Intology
San Mateo justin-cho.com Joined October 2018
857 Following 1K Followers 644 Posts

Latest posts 5

Pinned post

Justin Verified account @HJCH0
Locus sets SOTA on automated post-training capabilities and produces a model that's in production facing millions of users, completely end-to-end!

Here's a glimpse to the endless possibilities we're materializing with our research on automated scientific discovery:
Intology Verified account @intology Aug 3
The models are improving the models.

Locus, our automated AI research system, is SOTA on PostTrainBench and post-trains Qwen3 base models that surpass the human post-trained Qwen3 model.

Today, LLMs post-trained end-to-end by Locus are in production to millions. 🧵👇

PostTrainBench evaluates agents' ability to post-train models on various domains given 10 H100 hours.

We extend PostTrainBench via PostTrainBench+, which has a greatly expanded compute budget that provides clearer signal on automated post-training capabilities. We find that thousands of H100 hours help distinguish methods' performance post-training Qwen3 1.7B-Base models, and that Locus scales best. In this setting, modes trained by Locus collectively surpass the perforamce of the offical human post-trained Qwen3 1.7B model.

In a test of generalization, we ran Locus on all live Kaggle competitions with prize money and public leaderboards. After 16 days, Locus achieved the 4th highest average rank among all participants.
View quoted post on X
1 replies 0 reposts 18 likes 1.4K views View on X
Justin Verified account @HJCH0
We went from SOTA on autonomous post-training to frontier performance on autonomous molecular design (eg antibody design) in just a couple of months!

What's exciting about these results is that Locus achieved them via improvements in domain-agnostic auto-research capabilities:
- Diverse exploration
- Better Generalization to avoid overfitting
- Resilience to noise
- High sample-efficiency to learn from data-scarce tasks

This marks a crucial milestone towards building auto-research systems that can closing the loop for scientific challenges that have even larger search spaces and longer, more expensive, and noisier evaluation cycles.
Intology Verified account @intology 6d
Locus sets the frontier for automating molecular design

Our automated research system Locus develops scientific AI models that outperform SOTA expert solutions

Unlocking the potential of scientific AI requires leveraging proprietary data. Locus achieves this autonomously 🧵👇

--

We test Locus across a number of tasks related to molecular scoring and design: training molecular property prediction models for a proprietary task, fine-tuning Boltz-2 to predict small-molecule potency, and building antibody design workflows around BoltzGen, Boltz-2, ESMC, and ESMFold2.

Each of these settings are real-world AI for science use cases, where tasks are often out-of-distribution for existing foundation models and limited in data, while featuring expensive and noisy evaluators. Compared to state-of-the-art baselines and LLM agents set to optimize these tasks, Locus achieves higher performance. Additionally, Locus generalizes better despite limited data, finds more sample efficient solutions, and explores a higher diversity of solutions.
View quoted post on X
1 replies 2 reposts 17 likes 853 views View on X
Justin Verified account @HJCH0
True progress is built on rigorous evals

Contrary to hype, coding agents make little scientific progress when
* tasked with long-horizon research
* controlled for data contamination
* allowed no human interventions

NanoGPT-Bench paves an exciting path towards scientific agents
Intology Verified account @intology May 19
Can coding agents do research?

We release NanoGPT-Bench, an internal eval we’ve used to test agents on an AI R&D problem with months of human progress

Codex, Claude Code, Autoresearch recover only 9.3% of human progress, mostly tuning hyperparams & ignoring algorithmic research

NanoGPT-Bench is built on the NanoGPT Speedrun, a popular LLM pretraining competition to minimize the training time of a GPT-2 style model. Existing human submissions constitute nearly 2 years of work. To control for dependencies and contamination in frontier models, we standardize evaluation to a 5-month window of world records. Evaluation is fully autonomous and end-to-end, with no human intervention or internet access. 🧵
View quoted post on X
1 replies 0 reposts 11 likes 1.7K views View on X
Justin Verified account @HJCH0
I've joined @intology!

I'm excited to push the boundaries of AI-accelerated scientific discovery with an incredibly driven and talented team. Looking forward to dive deep into research on AI-driven automation and creativity!
2 replies 4 reposts 12 likes 1.8K views View on X
Justin Verified account @HJCH0
Can’t recommend working with Alex enough! It’s hard to think of a positive trait that doesn’t apply to Alex, he’s creative, caring, passionate, and super sharp. You shouldn’t miss out on this opportunitiy if ur planning on doing a PhD
Alex Spangher Verified account @AlexanderSpangh Nov 11, 2025
✨ Very overdue update:

I'll be starting as an Assistant Professor in CS at University of Minnesota, Twin Cities, Fall 2026. I will be recruiting PhD students!!

Please help me spread the word! [Thread] 1/n
View quoted post on X