Twitxy Saved

Jona Ruthardt

@jonaruthardt

AI Research | PhD student @ Fundamental AI Lab | Vision-Language Modelling and Multi-Modal Learning
Nuremberg jonaruthardt.github.io Joined December 2009
151 Following 55 Followers 23 Posts

Latest posts 3

Pinned post

Jona Ruthardt @jonaruthardt
What if you could ๐˜ต๐˜ฆ๐˜ญ๐˜ญ vision encoders ๐˜ธ๐˜ฉ๐˜ข๐˜ต to encode?

Check out our latest work where we introduce ๐—ฆ๐˜๐—ฒ๐—ฒ๐—ฟ๐—ฎ๐—ฏ๐—น๐—ฒ ๐—ฉ๐—ถ๐˜€๐˜‚๐—ฎ๐—น ๐—ฅ๐—ฒ๐—ฝ๐—ฟ๐—ฒ๐˜€๐—ฒ๐—ป๐˜๐—ฎ๐˜๐—ถ๐—ผ๐—ป๐˜€.
Manu Gaur Verified account @gaur_manu Apr 10
Pretrained ViTs like DINOv2 or CLIP are great, but they produce fixed, generic representations that encode the most salient visual concepts (e.g., "cat").
In human vision, prior priming with language changes how people parse an image. We believe visual encoders should do the same
๐Ÿšจ Introducing Steerable Visual Representations, a new family of visual features you can steer with text towards specific visual concepts.
View quoted post on X
Jona Ruthardt @jonaruthardt
Check out our new paper ๐Ÿ‘‡
Yuki @y_m_asano 4d
๐ŸŒ What if an image generator could see?

@GoogleDeepMind's Vision Banana showed it can, but kept data, recipe and weights closed. So we rebuilt it fully open:

โœจ FLUX.2 Klein 4B/9B finetune w/ public data only
โœจ 73.9 vs Vision Bananaโ€™s 69.9 mIoU zero-shot on Cityscapes
โœจWe release code + 148 checkpoints for the community/

Aaand we innovate:
๐Ÿ“ˆ We develop a new test-time scaling recipe we call โ€œlegend-ensemblingโ€: this gives strong gains by applying more compute without retraining anything.

๐Ÿ”— openvisionbanana.github.io
๐Ÿ“„ arxiv.org/abs/2611.15844

A @FunAILab work from A. Jadon, @v_pariza, @FragileGoodwill, @jonaruthardt, @ASophiaKoepke, @abursuc and me.
View quoted post on X
Jona Ruthardt @jonaruthardt
Today, I had the chance to present our latest work on ๐—ฆ๐˜๐—ฒ๐—ฒ๐—ฟ๐—ฎ๐—ฏ๐—น๐—ฒ ๐—ฉ๐—ถ๐˜€๐˜‚๐—ฎ๐—น ๐—ฅ๐—ฒ๐—ฝ๐—ฟ๐—ฒ๐˜€๐—ฒ๐—ป๐˜๐—ฎ๐˜๐—ถ๐—ผ๐—ป๐˜€ at @SonyAI_global in their Tokyo office.

This wraps up our @FunAILab visit to Japan. Grateful for the engaging discussions and new connections along the way.