Twitxy Saved

Sergei Nozdrenkov

@nozdrenkov

Creating a life I love! 🪸🐝 wildflow.ai | Ex-@Google X
London nozdrenkov.com Joined June 2011
427 Following 548 Followers 266 Posts

Latest posts 5

Pinned post

Sergei Nozdrenkov @nozdrenkov
🪸 [Call for contributors!] 🪸 New release: "Google Docs for Coral Reefs" is live!! You can now explore the reef with your dive buddies, select coral colonies, tag species, add comments, and search for visually similar colonies across the reef, all in 3D!

🔵 Why? Coral reefs are such precious, beautiful, incredibly complex, and threatened ecosystems. They are dying fast. A lot of amazing people are fighting to keep them alive. We need to deploy more solutions faster. That requires a deep understanding of how coral reefs function. What works, what doesn't, to coordinate precise action. The evidence is buried in a humongous amount of data scattered across organisations, hard drives, and disconnected tools. We need one place to share the data, examine it, analyse it, and turn it into action. That’s why we’re building this!

🔵 Ground truth is everything. We start with the highest-signal data: time-series 3D. You see each colony from many angles, at true scale, and track how it evolves over time. But the data is enormous. Even small survey plots are hundreds of gigabytes. We already process and stream it directly in the browser. Now we turn it into a workspace.

🔵 Dive buddies. Annotating hectares of reef is soo lonely. So we built multiplayer! Bring your friends and annotate together in 3D. See where everyone is looking in real time and split up the work. Leave comments at exact locations. Use @ tags for species, health, etc. Pretty much like Google Docs or Figma, but for a 3D reef.

🔵 Smart selection. Corals are painfully hard to annotate! Their shapes and colours are all different, and it's hard to see where one colony ends and another begins. Even amazing 2D models like SAM struggle with reef photos and orthos. Lousy masks and vague point annotations create bad training data. Those errors wreck downstream AI models. Luckily, we have an unfair advantage. Each coral appears in many photos from different angles. Our selector works in a shared 3D embedding space, across every view at once. Just Shift+click, drag out a semantic radius, and select anything directly in 3D.

🔵 Semantic search. Start with a colony, coral fragment, or disease patch. Hit the ≈ button and find visually similar things across the reef. Create a category and add the right matches. Keep going until you’ve mapped it. Then move on to the next one.

🔵 Under the hood. We project DINOv3 features from the photos into the 3D splats. Then we use LDA to adapt them to your categories and make the model lightweight enough to work in the browser.

🔵 Please break it. This demo is one tiny patch of reef, held together with duct tape and full of bugs. But even in this state, no other browser tool lets a team annotate a 3D reef together like this.

🔵 Huge thanks to the superstar Matthew Osborne, creator of The Living Atlas, for leading the development! The fantastic Jan Paulini built our first species list. And to the amazing people doing the real work in the water, who kindly shared this reef data with us:
@alderdice_r, @reefgenomics, @emmafcamp,
@PaigeStrudwick,
@ChristineDRoper, and many others.

🔵 Please annotate a few colonies. It would help us a lot! Together, we map every reef on Earth! 🤗 🌍
0:44
7 replies 13 reposts 67 likes 15K views View on X
Sergei Nozdrenkov @nozdrenkov
my name is Sergei, i'm an engineer. i want to create the most comprehensive model of the biosphere, to align humanity with nature. i think we could be the first generation that leaves nature better than we found it. i want to understand the secrets of life.
1 replies 1 reposts 12 likes 844 views View on X