How good are current large vision-language models at performing the tasks needed for surgical AI? We conducted an assessment of leading models including proprietary (GPT / Gemini / Med-Gemini) and open-source (Qwen2-VL / Pali Gemma / etc.) generalist autoregressive models, contrastive CLIP models, and surgery-targeted models (SurgVLP). See how they stack up and where we are on the path to different surgical AI applications in our new work here: arxiv.org/pdf/2504.02799
Work led by Anita Rau (who is on the job market!) together with @mark_endo1, @AkliluJosiah2, Jeff Heo, @KhaledSaab11, Alberto Paderno, Jeff Jopling, and @HNSurgeon.
Work led by Anita Rau (who is on the job market!) together with @mark_endo1, @AkliluJosiah2, Jeff Heo, @KhaledSaab11, Alberto Paderno, Jeff Jopling, and @HNSurgeon.
There’s growing excitement around VLMs and their potential to transform surgery🏥—but where exactly are we on the path to AI-assisted surgical procedures?View quoted post on X
In our latest work, we systematically evaluated leading VLMs across major surgical tasks where AI is gaining traction..🧵