Twitxy Saved

Amir Bar

Verified account AMI Labs

@_amirbar

Assistant Professor @imperialcollege
MTS @amilabs
London amirbar.net Joined March 2016
1.5K Following 4.2K Followers 777 Posts

Latest posts 5

Amir Bar Verified account @_amirbar
cool. it will be interesting to see in larger scale. Intuitively, we know that random search scales exponentially with the number of parameters whereas sgd is polynomial (for convex objectives).
spicylemonade Verified account @spicey_lemonade Oct 22
WE DID IT! We can now pretrain transformers without backprop and even beat backprop+Adam on validation loss with insane speeds.

Now the big question is scale. Itโ€™s Ironic, we have reached a breakthrough In AI capability due to inspiration from a safety blog
View quoted post on X
0 replies 1 reposts 13 likes 1.6K views View on X
Amir Bar Verified account @_amirbar
Join Jesse's tutorial if you're attending NeurIPS!
Chieh-Hsin (Jesse) Lai Verified account @JCJesseLai Oct 22
๐ŸŽ‰ Excited to bring our book The Principles of Diffusion Models to @NeurIPSConf 2026 as a tutorialโ€”this time, all about diffusion LLMs! ๐Ÿš€

๐Ÿ”น How do ideas from continuous diffusion extend to language generation?

๐Ÿ”น What are the latest advances and open frontiers in diffusion LLMs?

From foundational principles to cutting-edge research. Stay tuned!

๐Ÿ“† Mon, Dec 7, 9 AM AEDT
๐Ÿ“ TikTok Ent Centre (Sydney, Australia)

w/ organizers @ssahoo_ @mittu1204 @StefanoErmon
View quoted post on X
Amir Bar Verified account @_amirbar
NAVA-WAM: Can we learn latent actions for World Action Models?

We revisit a classic idea: jointly learning inverse and forward dynamics models while avoiding the identity shortcut (e.g., @SeonghyeonYe, @garridoq_, @jeffacce, @pulkitology, and others).

The twist: Both models are implemented within a single WAM architecture, using attention masks!

To prevent the identity shortcut, the latent actions can only sees a noisy version of the next frame, forcing the latent action to capture useful dynamics rather than simply copying the future.

This simple pretraining strategy improves both performance and efficiency across robotics benchmarks!

๐Ÿงต๐Ÿ‘‡
Zhaochong An @ZhaochongAn Oct 5
๐Ÿค– Abundant videos capture how the world works, but robot policies still rely on costly action labels to learn.

๐Ÿ”ฅ Excited to share our work at @Meta:

๐Ÿ“ข Native Action-Prior Learning from Videos for World Action Models ๐Ÿ“ข

๐Ÿ“„arxiv.org/pdf/2610.03391
๐ŸŒzhaochongan.github.io/NAVA-WAM/

๐Ÿงต
View quoted post on X
0 replies 8 reposts 85 likes 4.5K views View on X
Amir Bar Verified account @_amirbar
๐—ฃ๐—ฟ๐—ผ๐—ช๐—”๐—  imagines latent visual subgoals to guide action prediction. Strong performance across robotics benchmarks and real-world experiments.
๐Ÿงต๐Ÿ‘‡
Fei Zhang @809428184Fei Oct 5
๐Ÿ‘‹ ๐—›๐—ฒ๐—น๐—น๐—ผ ๐—ง๐˜„๐—ถ๐˜๐˜๐—ฒ๐—ฟ! ๐—™๐—ถ๐—ฟ๐˜€๐˜ ๐˜๐˜„๐—ฒ๐—ฒ๐˜ ๐—ฎ๐—น๐—ฒ๐—ฟ๐˜ ๐Ÿšจ
Why not give it to a paper!

Excited to share our work at @Meta: ๐—ฃ๐—ฟ๐—ผ๐—ช๐—”๐— 
In this paper, we try to answer:
"How should a robot imagine the future before it acts?"

๐ŸŒ Webpage: sii-ferenas.github.io/ProWAM-page/
๐Ÿงต๐Ÿ‘‡
View quoted post on X