Twitxy Saved

Devvrit

Verified account This account is verified. Learn more

@Devvrit_Khatri

Founding Member @Mirendil, Past: GradStudent @UTCompSci, StudentResearcher at Meta and Google. Post-training - RL, Distillation, Continual Learning et al.
devvrit.com Joined December 2019
369 Following 1.1K Followers 307 Posts

Latest posts 5

Devvrit Verified account @Devvrit_Khatri
Thanks! @inderjit_ml gets most of the credit. He put faith in me and gave a chance to pursue Deep Learning at a time I didn’t know what PyTorch was :)
Inderjit Dhillon @inderjit_ml Nov 4
This would also be a good time to congratulate @Devvrit_Khatri and @nileshgupta2797 who also recently obtained their PhDs. I am so glad to have served as their PhD advisor - all credit to them for becoming strong, independent and influential researchers. Congratulations!
View quoted post on X
Devvrit Verified account @Devvrit_Khatri
<3
Arno Verified account @aarnogau Oct 28
My friends can attest, Ive been wanting to push boundaries of harnesses for a while.

When I was introduced to mirendil I was immediately intrigued that a small neolab was planning to compete in the big leagues, in the domain of agentic intelligence. It sounded insane, ambitious, and a great place to create the next generation of ai tooling.

Like how a noun needs a verb, no matter how powerful the model gets we will always need a harness. The space isnt quite solved but its close. Harnesses are all aligning to the same few architectures (more to come for how we built ours). Each generation of model has made it more clear what architectures are actually required.

Our goal was fundamental and simple. Give the model agency. Give the human freedom.

Im excited to introduce Lor, our new product built from first principles to be an always-on, multi client, multi environment delegator for coding and experiments.

We're opening up our beta. I'd love to chat with anyone pushing the limits of engineering and discovery.

Message me on any platform or sign up here if you're interested in trying it out
mirendil.com/lor-beta/
View quoted post on X
Devvrit Verified account @Devvrit_Khatri
I've almost fully switched to it internally. There are many more features that the team will ship in coming weeks... and it'll start getting more and more obvious how this is designed with automating research as the primary principle in mind.
Mirendil Verified account @mirendil Oct 28
Meet Lor.

We’re building Lor to do the work of an entire AI lab. Today, its agents write our code, run experiments, and iterate on the results for days, on any machine, hundreds at a time.

Now in private beta ↓
View quoted post on X
3 replies 0 reposts 41 likes 2.3K views View on X
Devvrit Verified account @Devvrit_Khatri
On policy methods change non-principal direction, and hence also avoid forgetting. We take this insight and restrict any finetuning algo to do the same. Result: almost no forgetting, while still learning the target task well.
Also scales well with # params & data.
Arnav Chavan Verified account @ArnavChavan6 Oct 22
How can LLMs learn new skills from offline data without losing what they already know?

Introducing Subspace Tuning (SST): a simple approach that improves the learning–forgetting trade-off by controlling where weight updates happen.

Paper: arxiv.org/abs/2610.22293
Blog: app.notion.com/p/ac-notes/Tow…
🧵 1/8
View quoted post on X
3 replies 10 reposts 84 likes 6.9K views View on X