If you like recipes that scale without bells and whistles, and learn robust representations from images alone, check out our latest work!
Super happy to have contributed to this with such an amazing team!
Super happy to have contributed to this with such an amazing team!
SSL shouldn't require complex training recipes to scale, but the current SotA needs them.View quoted post on X
Introducing JEM: a principled SSL method derived from information theory. The first latent patch-level objective demonstrated from 300M→7B params. Stable training, matches or beats DINOv3.