Twitxy Saved

idan shenfeld

Verified account This account is verified. Learn more

@IdanShenfeld

Cambridge, MA idanshenfeld.com Joined December 2022
213 Following 2.6K Followers 234 Posts

Latest posts 5

Pinned post

idan shenfeld Verified account @IdanShenfeld
People keep saying 2026 will be the year of continual learning.

But there are still major technical challenges to making it a reality.

Today we take the next step towards that goal — a new on-policy learning algorithm, suitable for continual learning!

(1/n)
51 replies 221 reposts 1.5K likes 245K views View on X
idan shenfeld Verified account @IdanShenfeld
Maybe a good time to announce that I joined @thinkymachines three month ago.

Very excited about this release. Some highlights:
- pre-trained in less than 3 days
- RL is a single joint run, no need for cumbersome MOPD
- Self-Distillation was used to improve the model alignment and safety!
- the model is very finetunable, way more than other OSS models
Thinking Machines Verified account @thinkymachines 5d
Introducing Inkling 2 Small. Scoring 31 on the AA Intelligence Index, it's a big jump over its predecessor.

Inkling 2 Small is available for fine-tuning and inference on Tinker today, with full weight release planned soon.

thinkingmachines.ai/news/inkling-2…
View quoted post on X
27 replies 25 reposts 598 likes 27K views View on X
idan shenfeld Verified account @IdanShenfeld
SFT without forgetting? Possible if you make your data more on policy! Really nice work from @aakara
Aayush Karan Verified account @aakaran31 Oct 2
SFT is not dead! 🥳

We found a way to make SFT rival current prevailing posttraining methods, often generalizing better and forgetting less than RL and OPSD. 🤯

Following our prior work on reasoning with sampling, we now introduce sampling to the posttraining stack.

1/n
View quoted post on X
1 replies 1 reposts 26 likes 3.5K views View on X
idan shenfeld Verified account @IdanShenfeld
Interesting new approach to catastrophic forgetting
Assaf Ben Kish Verified account @abk_tau Oct 2
(1/7) Humans can acquire many capabilities without (catastrophically) forgetting previous ones. Why can't neural networks do the same?

Local Support Learning (LSL) takes us a step closer towards this goal.
In LLMs of up to 7B parameters, LSL augments gradient-based training to retain prior capabilities while learning new tasks at full capacity. Notably, it does so without access to prior data.

Key idea: casting forgetting as a geometric problem, and optimizing for the worst case.

Paper: arxiv.org/abs/2610.02126
Website and code: assafbk.github.io/lsl
View quoted post on X
0 replies 0 reposts 25 likes 4.9K views View on X
idan shenfeld Verified account @IdanShenfeld
Sometimes we are so focused on LLMs that we miss how AI has improved in other use cases
Victor Butoi @ion_barrel Sep 24
X-rays are everywhere in medicine, but extracting general, quantitative anatomical information from them remains remarkably difficult.

Announcing FleXray: an open-source, open-weight model for zero-shot anatomical segmentation across the human body—from different regions, viewing angles, and acquisition settings.

FleXray learns from large-scale synthetic supervision generated from 3D anatomy, then transfers directly to real clinical X-rays.

Try it now on your own X-rays in our in-browser demo!

🧵 1/N — project page, demo, weights, code & paper below ↓
View quoted post on X