Twitxy Saved

Julia Chae

@juliachae_

phd-ing @MIT_CSAIL w/ interest in multimodal representations, fine-grained perception, AI for science; prev @VectorInst, @UofTRobotics
Cambridge, Massachusetts Joined August 2022
432 Following 401 Followers 114 Posts

Latest posts 5

Pinned post

Julia Chae @juliachae_
My first first-authored (w/ @shobsund) paper of my phd is finally out! 🚀

Check out our thread to see how general-purpose representations + personalized synthetic data enable personalized vision representations.

🌐: personalized-rep.github.io
Shobhita Sundaram Verified account @shobsund Dec 23, 2024
Personal vision tasks–like detecting *your mug*-are hard; they’re data scarce and fine-grained.

In our new paper, we show you can adapt general-purpose vision models to these tasks from just three photos!

📝: arxiv.org/abs/2412.16156
💻: github.com/ssundaram21/pe…

(1/n)
View quoted post on X
6 replies 7 reposts 160 likes 29K views View on X
Julia Chae @juliachae_
👀 open to new discussions!
Benno Krojer Verified account @benno_krojer Oct 28
Some ideas:

- make this work also when the generation process is a diffusion-autoregression hybrid

- cross-modal non-linear manifold steering? (@thomas_fel_ @GoodfireAI 👀)

- been thinking with @juliachae_ how to formalize better what modality-unique concepts are, in some automated way... in this paper we had to creatively come up with such concepts, like high-to-low resolution images or formal-vs-colloquial language
(talk to us if this is of interest to you!)
View quoted post on X
Julia Chae @juliachae_
this is such a neat analysis and a great sneak peak into shared semantic geometry between modalities!
Benno Krojer Verified account @benno_krojer Oct 28
New preprint:
Cross-modal steering vectors transfer zero-shot in both directions 🖼️ ↔️ 📝
From text generation to image generation and vice-versa

Exciting evidence for a shared conceptual space!

Fantastic effort led by Donghao Zeng and awesome co-authors @nsubramani23 & @TamarRottShaham

Details 🧵👇
View quoted post on X
Julia Chae @juliachae_
check out this cool work by jenny highlighting importance of human verification before blindly accepting LLM outputs when using them within our workflow 👀
jenny huang Verified account @jennyihuang Sep 30
new preprint: language models are “insecure” reporters.

researchers and engineers have become increasingly reliant on LLM-written reports---second-hand accounts of code and experiments---to understand agent-generated work.

in this study, we ask: “how transparent are these LLM-generated reports?” 🔍
View quoted post on X
Julia Chae @juliachae_
🤩 love to see scaled up supervision from clever alternative domain sources of data! synthetic data for CT go brr
Victor Butoi @ion_barrel Sep 24
X-rays are everywhere in medicine, but extracting general, quantitative anatomical information from them remains remarkably difficult.

Announcing FleXray: an open-source, open-weight model for zero-shot anatomical segmentation across the human body—from different regions, viewing angles, and acquisition settings.

FleXray learns from large-scale synthetic supervision generated from 3D anatomy, then transfers directly to real clinical X-rays.

Try it now on your own X-rays in our in-browser demo!

🧵 1/N — project page, demo, weights, code & paper below ↓
View quoted post on X