Twitxy Saved

Tara Rezaei

Verified account Mirendil

@tararezaeikh

co-founder @mirendil, prev mit, openai, prod
tarark.com Joined June 2023
510 Following 6.2K Followers 187 Posts

Latest posts 5

Pinned post

Tara Rezaei Verified account @tararezaeikh
Today, we are formally announcing @mirendil. Mirendil exists to be a straight shot at solving bottlenecks to step-change acceleration across all areas of science and technology. If you are excited about this mission, feel free to reach out.
Behnam Neyshabur Verified account @bneyshabur Jun 24
Today, I’m excited to formally announce @mirendil with my amazing co-founders Harsh Mehta, Shayan Salehian, and Tara Rezaei!

We’re fortunate to work with @a16z and @kleinerperkins, who led our seed round of $200M, followed by a major investment from NVIDIA, among others.

Mirendil exists to accelerate science and technology, and through them, to help solve humanity's most pressing problems.

Self-accelerating AI R&D is the most direct path to delivering on AI's broader promise, which is why we believe the most important application of AI is AI itself. Get this loop right, and it compounds. It fundamentally changes the rate of progress itself across all domains.

We believe this capability should be democratized. It should be used to power all scientific efforts trying to innovate at the frontier. There are far more important problems—and broader ones—than any single lab can take on, so more groups should be able to pursue them.

This pulls concentration of power away from a few labs: businesses and science labs can own their AI and infrastructure, keep their margins, and control their own destiny instead of ceding it all to a single AI lab.

We’re a small team with a singular focus. Our founding team consists of 20 researchers and engineers from frontier institutions including Anthropic, xAI, Google DeepMind, and OpenAI, united by a passion for science and a drive to build the technologies that move it faster. If you want to build the system that builds systems, join us!

@HarshMeh1a, @shayan_, @tararezaeikh
View quoted post on X
59 replies 23 reposts 325 likes 74K views View on X
Tara Rezaei Verified account @tararezaeikh
We’ve raised $1B led by @kleinerperkins and @clearlake.

We’re still a small team with one goal, to make frontier AI R&D accessible to scientists, researchers and technologists. Join us if it also excites you.
Mirendil Verified account @mirendil 5d
Today we're announcing our $1B Series A, led by @kleinerperkins and @clearlake.

We believe making frontier AI R&D more accessible is the most direct path to AI that solves humanity's most pressing problems across science and technology.
View quoted post on X
45 replies 19 reposts 385 likes 15K views View on X
Tara Rezaei Verified account @tararezaeikh
If you wanted to build a product for AI R&D, what would you build?

It would probably allow agents easy access to compute, run and manage hundreds of agents in parallel, be long-running, reliable and let agents operate on any machine.

Meet Lor, now in private beta.

Let us know if you'd like to be an early user.
Mirendil Verified account @mirendil Oct 28
Meet Lor.

We’re building Lor to do the work of an entire AI lab. Today, its agents write our code, run experiments, and iterate on the results for days, on any machine, hundreds at a time.

Now in private beta ↓
View quoted post on X
7 replies 8 reposts 78 likes 5.8K views View on X
Tara Rezaei Verified account @tararezaeikh
Today, we are introducing Fern: our first model that supports up to 10M tokens in context window!🌿

You could put an entire repository (or repositories!) in the context, continue to work on problems for days without hitting compaction limits or use it to consolidate other agents’ works. 

As always, we have a lot more work to do but wanted to give you the update. Excited hear how you would use a 10M token context window.
Behnam Neyshabur Verified account @bneyshabur Oct 26
Introducing Fern, Mirendil’s first model: pretrained from scratch, with up to 10M tokens of context!

That’s ~0.5M lines of code (roughly Megatron-LM scale) or days of an agent’s work, all in context at once.

Its first version, Fern 0.1, had a short round of post-training 🚢
View quoted post on X
11 replies 13 reposts 173 likes 8.4K views View on X
Tara Rezaei Verified account @tararezaeikh
An early but encouraging step towards the future we are building at Mirendil.
Behnam Neyshabur Verified account @bneyshabur Oct 21
We formally announced Mirendil less than 4 months ago. Today, I'm excited to share an important milestone for:

Pretraining at scale without a pretraining team.

Mirendil's mission is to solve Recursive Self-Improvement (RSI) and use it to democratize frontier AI development, ultimately accelerating science and technology. At Mirendil, when we think about RSI, we think holistically about the company as an intelligent entity that self-improves toward its goal. From that perspective, the most powerful notion of acceleration is reducing the time and resources (number of human experts, compute, and other costs) needed to achieve ambitious goals.

Given that pretraining is perhaps the most important yet most challenging part of frontier AI development, we decided to run an ambitious controlled experiment: Starting fully from scratch, can we significantly reduce the time, number of human experts, and compute resources needed to go all the way to successfully pretraining a strong coding model at scale?

Mirendil-Base is the result of this experiment. Our first pretrained model was built by one researcher in 3.5 months, with less than $10M in compute. This includes all the research and small-scale experiments it took to get there, as well as the final training run.

The recipe holds up as the models get bigger. For reference, Mirendil-Base is in the 100B-500B parameter range, Mirendil-Base-Large in the 500B-2T range, and Mirendil-Base-XL in the 2T-10T range.

We're beginning to see a world where a single researcher, empowered by AI, can take on work that once required an entire research organization. As these systems improve, the bottleneck shifts from the size of a team to the ambition and judgment of the people directing them. This has profound implications for who gets to build AI and, ultimately, who gets to push the frontiers of science and technology forward.

We’ll share independent evaluations, post-training benchmarks and API-access sooner than you think so stay tuned!
View quoted post on X