Stability AI

What if making video-based world models smaller isn't just about better compression, but about making their representations easier to predict?

Recent approaches to video generation explore building scenes from coarse to fine. The first few tokens capture the big picture, like a person playing a guitar, while later tokens progressively add visual details.

Our Interactive Research team just published SemanTok, which takes this idea further. By making those early tokens more semantically meaningful, we give the model a clearer understanding of what's happening in a scene, making the representation easier to predict and video generation more efficient.

The result: a model using SemanTok matches or beats the performance of a model more than three times its size.

Read the full paper: stability.ai/research/seman…

Many thanks to The Information for sitting down with our Executive Chairman Sean Parker and CEO @premakkaraju to talk about our work building tools for music professionals.

Color consistency is a persistent friction point in production. Our interactive research team just returned from The 19th European Conference on Computer Vision (@eccvconf), where they presented new work focused on solving just this: ensuring colors match reliably across shots and AI-generated reference photos.

Today marks a new milestone for Stability AI. We've closed our Series B, bringing total funding to $232M under new leadership. This moment is more than the number, it's about who's in the room.

Today we wanted to share two new tools that give you different ways to work with Stable Audio 3.0: a new Stable Audio plugin that brings generation directly into your favorite DAW and an enhanced web experience on StableAudio.com, with more ways to edit and work with what you generate. Both are powered by our commercially-safe models, which means you own your outputs, and can distribute outputs freely.

These are both in beta, so some features are experimental. We will continue to iterate on the experience in real time.