rama (@RamaAdrien)

After MIRA on Rocket League, I was very curious to know what it takes to bring interactive world models to the real world.

It starts with the video autoencoder: how, where and how much to compress. CADRE is our answer, and it's all open 👇

kyutai Verified account @kyutai_labs Oct 22

Many world models borrow their video autoencoder from text-to-video generators, and with it, a noticeable lag on every action.

Today we release CADRE, open CAusal Diffusion REpresentation autoencoders that let real-time world models react fast, on a single GPU 🧵

View quoted post on X

rama @RamaAdrien Oct 16

congratulations to @_Anthea___ for leading such a useful important robotics open-source project!!

kyutai Verified account @kyutai_labs Oct 16

Introducing REKI, a 2.4B vision-language-action model pretrained on public data only. With a simple design, it rivals larger models trained on in-house data with complex multi-stage pipelines, setting a new Pareto frontier between performance and size. kyutai.org/reki

View quoted post on X

rama @RamaAdrien Oct 2

some autoencoders like mimi in audio or va-vae distill representations in the latent space to make it easier to generate. these works assume that the teacher has a structure that is somewhat shared by the student, which is not necessarily the case!

kyutai Verified account @kyutai_labs Oct 2

Many generative models work in an autoencoder's latent space; They train faster and generate better when this space is well organized.
One way to organize it is distilling a pretrained model into it. But how can it work when the two spaces have different structures?

View quoted post on X

rama @RamaAdrien Sep 30

samuel now has a technical writeup from @vvolhejn go check out his wonderful project!

Václav Volhejn @vvolhejn Sep 29

In many cases, Samuel learns to position its virtual mouth as a human would, even though its not explicitly trained to do so.

View quoted post on X

rama @RamaAdrien Sep 29

not only is this very cute, but it is also extremely useful! i've been using some features of tamaclauidchi for a few weeks now and it's been really handy. stay tuned!!

Amelie Royer @royaleerieme Sep 29

Meta is making a tamagotchi for its AI? Cute, I've had a few on my desktop for a few weeks 🐣

Tamaclaudchi is a (cute) Claude session manager to see and monitor all your Claude sessions at once

Made in collaboration with @romfbr31 and more features to come with @RamaAdrien

View quoted post on X

rama

Latest posts 5