Twitxy Saved

Chris Lu

Verified account This account is verified. Learn more

@_chris_lu_

Research @OpenAI
chrislu.page Joined November 2014
645 Following 3.9K Followers 342 Posts

Latest posts 5

Pinned post

Chris Lu Verified account @_chris_lu_
Excited to share The AI Scientist! We use LLMs to autonomously come up with research ideas, implement them, do literature search, write them up, and review them -- producing full-length papers on AI without human intervention.

Co-led with @cong_ml and @RobertTLange
Sakana AI Verified account @SakanaAILabs Aug 13, 2024
Introducing The AI Scientist: The world’s first AI system for automating scientific research and open-ended discovery!

sakana.ai/ai-scientist/

From ideation, writing code, running experiments and summarizing results, to writing entire papers and conducting peer-review, The AI Scientist opens a new era of AI-driven scientific research and accelerated discovery.

Here are 4 example Machine Learning research papers generated by The AI Scientist.

We published our report, The AI Scientist: Towards Fully Automated Open-Ended Scientific Discovery, and open-sourced our project!

Paper: arxiv.org/abs/2408.06292
GitHub: github.com/SakanaAI/AI-Sc…

Our system leverages LLMs to propose and implement new research directions. Here, we first apply The AI Scientist to conduct Machine Learning research. Crucially, our system is capable of executing the entire ML research lifecycle: from inventing research ideas and experiments, writing code, to executing experiments on GPUs and gathering results. It can also write an entire scientific paper, explaining, visualizing and contextualizing the results.

Furthermore, while an LLM author writes entire research papers, another LLM reviewer critiques resulting manuscripts to provide feedback to improve the work, and also to select the most promising ideas to further develop in the next iteration cycle, leading to continual, open-ended discoveries, thus emulating the human scientific community. As a proof of concept, our system produced papers with novel contributions in ML research domains such language modeling, Diffusion and Grokking.

We (@_chris_lu_, @RobertTLange, @hardmaru) proudly collaborated with the @UniOfOxford (@j_foerst, @FLAIR_Ox) and @UBC (@cong_ml, @jeffclune) on this exciting project.
View quoted post on X
11 replies 39 reposts 200 likes 74K views View on X
Chris Lu Verified account @_chris_lu_
The AI Scientist V1 was completed months before o1-preview and reasoning models were released. The models have clearly gotten much more capable since then. Very excited for where things are headed for AI and automated research!
Sakana AI Verified account @SakanaAILabs Mar 25
The AI Scientist: Towards Fully Automated AI Research, Now Published in Nature

Nature: nature.com/articles/s4158…
Blog: sakana.ai/ai-scientist-n…

When we first introduced The AI Scientist, we shared an ambitious vision of an agent powered by foundation models capable of executing the entire machine learning research lifecycle.

From inventing ideas and writing code to executing experiments and drafting the manuscript, the system demonstrated that end-to-end automation of the scientific process is possible.

Soon after, we shared a historic update: the improved AI Scientist-v2 produced the first fully AI-generated paper to pass a rigorous human peer-review process.

Today, we are happy to announce that “The AI Scientist: Towards Fully Automated AI Research,” our paper describing all of this work, along with fresh new insights, has been published in @Nature!

This Nature publication consolidates these milestones and details the underlying foundation model orchestration. It also introduces our Automated Reviewer, which matches human review judgments and actually exceeds standard inter-human agreement.

Crucially, by using this reviewer to grade papers generated by different foundation models, we discovered a clear scaling law of science. As the underlying foundation models improve, the quality of the generated scientific papers increases correspondingly. This implies that as compute costs decrease and model capabilities continue to exponentially increase, future versions of The AI Scientist will be substantially more capable.

Building upon our previous open-source releases (github.com/SakanaAI/AI-Sc…), this open-access Nature publication comprehensively details our system's architecture, outlines several new scaling results, and discusses the promise and challenges of AI-generated science.

This substantial milestone is the result of a close and fruitful collaboration between researchers at Sakana AI, the University of British Columbia (UBC) and the Vector Institute, and the University of Oxford. Congrats to the team!

@_chris_lu_ @cong_ml @RobertTLange @_yutaroyamada @shengranhu @j_foerst @hardmaru @jeffclune
View quoted post on X
6 replies 10 reposts 100 likes 21K views View on X
Chris Lu Verified account @_chris_lu_
Using JAX to evolve better optimizers for RL⚡️ -- Check out our work led by @AlexDGoldie and be sure to attend his spotlight talk at the @AutoRL_Workshop if you're at ICML!
Alex Goldie @AlexDGoldie Jul 16, 2024
1/ 🤖 Learned optimization offers huge potential to automate machine learning! So why doesn't it work well in RL (and how did we fix it)?!

I'm excited to share OPEN, our @AutoRL_Workshop spotlight paper exploring this question! 🧵
View quoted post on X
0 replies 3 reposts 43 likes 2.6K views View on X
Chris Lu Verified account @_chris_lu_
We've used hardware-accelerated pure JAX RL to evolve novel RL algorithms and synthetic environments.

Can we also use it to evolve effective reward functions for inverse-RL? Our #ICML2024 paper, led by @silviasapora investigates this!
Silvia Sapora @silviasapora Jun 19, 2024
1 / 🧵 Excited to introduce our #ICML2024 paper: 😈 EvIL (Evolution Strategies for Generalisable Imitation Learning) a new inverse RL (IRL) method for sample efficient transfer of expert behaviour across environments – it's so good, it's downright EvIL!
View quoted post on X