Twitxy Saved

Serena Yeung-Levy

Verified account This account is verified. Learn more

@yeung_levy

Assistant Professor of Biomedical Data Science and (by courtesy) of CS and EE @Stanford. AI, healthcare, computer vision.
Stanford, CA marvl.stanford.edu Joined October 2010
209 Following 7.2K Followers 119 Posts

Latest posts 5

Serena Yeung-Levy Verified account @yeung_levy
How good are current large vision-language models at performing the tasks needed for surgical AI? We conducted an assessment of leading models including proprietary (GPT / Gemini / Med-Gemini) and open-source (Qwen2-VL / Pali Gemma / etc.) generalist autoregressive models, contrastive CLIP models, and surgery-targeted models (SurgVLP). See how they stack up and where we are on the path to different surgical AI applications in our new work here: arxiv.org/pdf/2504.02799

Work led by Anita Rau (who is on the job market!) together with @mark_endo1, @AkliluJosiah2, Jeff Heo, @KhaledSaab11, Alberto Paderno, Jeff Jopling, and @HNSurgeon.
Josiah Aklilu @AkliluJosiah2 Apr 14, 2025
There’s growing excitement around VLMs and their potential to transform surgery🏥—but where exactly are we on the path to AI-assisted surgical procedures?

In our latest work, we systematically evaluated leading VLMs across major surgical tasks where AI is gaining traction..🧵
View quoted post on X
1 replies 8 reposts 53 likes 10K views View on X
Serena Yeung-Levy Verified account @yeung_levy
We're excited to introduce a new VLM benchmark, MicroVQA, to support frontier models pushing towards scientific research capabilities! MicroVQA comprises 1K manually created, researcher-level questions about biological image data, contributed by biologist researchers from diverse domains. Questions span major aspects of research work involving microscopy data, including expert visual understanding, hypothesis generation, and experimental proposal. See initial benchmarking results and how to test models on the benchmark below and in our #CVPR2025 paper. Work led by @jmhb0 @jnirsch Laura Bravo Sanchez together with wonderful collaborators!
Introducing MicroVQA: A Multimodal Reasoning Benchmark for Microscopy-Based Scientific Research #CVPR2025

✅ 1k multimodal reasoning VQAs testing MLLMs for science
🧑‍🔬 Biology researchers manually created the questions
🤖 RefineBot: a method for fixing QA language shortcuts
🧵
View quoted post on X
0 replies 7 reposts 68 likes 10K views View on X
Serena Yeung-Levy Verified account @yeung_levy
Just published in @ScienceAdvances, our work demonstrating the ability of AI and 3D computer vision to produce automated measurement of human interactions in video data from early child development research -- providing over 100x time savings compared to human annotation and enabling quantitative, big data studies. We use our method, HARMONI, to characterize longitudinal trends in infant and toddler interaction with caregivers, in over 500 hours of video data. Work led by @JenWeng4 together with co-PI @SandersMDMPH and @K_L_Humphreys, and with a great interdiscplinary team including Laura Bravo Sanchez, @bergelsonlab, @akanazawa, @StanfordCERC, and many others!

science.org/doi/10.1126/sc…
2 replies 13 reposts 53 likes 5.9K views View on X
Serena Yeung-Levy Verified account @yeung_levy
We've just released BIOMEDICA, an open-source resource making all scientific articles from PubMed Central Open Access conveniently accessible for model training through Hugging Face, with accompanying tags and metadata. Includes 24M image-text pairs from 6M articles, annotations, and trained SOTA models -- check out more info below. Great teamwork led by @Ale9806_ @minwsun @jmhb0 !
Biomedical datasets are often confined to specific domains, missing valuable insights from adjacent fields. To bridge this gap, we present BIOMEDICA: an open-source framework to extract and serialize PMC-OA.

📄Paper: lnkd.in/dUUgA6rR
🌐Website: lnkd.in/dnqZZW4M
View quoted post on X
8 replies 41 reposts 208 likes 29K views View on X