@bertgodel
Pinned post
Synthetic data gen is getting really goodView quoted post on X
Introducing Inkling 2 Small. Scoring 31 on the AA Intelligence Index, it's a big jump over its predecessor.View quoted post on X
Inkling 2 Small is available for fine-tuning and inference on Tinker today, with full weight release planned soon.
thinkingmachines.ai/news/inkling-2…
We ran ~150 async RL runs to see when score centering (SC) is enough, and the short answer is as long as the trainer stays close to the sampler. Small batches, stale data or a high lr pull the trainer away. Extras on top of SC like TIS or KL penalty helped less than we expected:View quoted post on X
A few months ago Surya (@kickingkeys), a designer at Websim (@websim_ai) in New York, posted a project that went viral: “You can just RL a coding model to paint with javascript btw.”View quoted post on X
We sat down with Surya and were shocked to learn that he only wrote his first line of code in 2024 and had not heard of RL before January. We wanted to know how someone with that background goes from zero to training models in under two years, and whether anyone else could do that too.
Our top 2 lessons from Surya:
- Anyone can learn how these systems work if you are curious and willing to put in the time.
- The best way to learn is to spend less time asking what AI can do to serve you and more time asking what it can do to serve the people around you.
Some of Surya’s recent projects include training models to paint, setting up AI for a coffee shop owner so he has more time to write, and having agents watch him in the art studio and turn the footage into a reality-TV-style story.
Surya is doing this for the love of the game.
Read our full interview in the thread!
cc @thisisrayouf
