@arorashMD
Pinned post
when I left radiology for pursuing ai research and advisory, I took a break for 4 months for some travel and surgeries and my account balance almost touched minimum balanceView quoted post on X
from there till whatever we have achieved at our lab @CRASHLabAI in a short amount of time, grateful to everyone who supported 🙏
🔥Today, we are releasing one of the first visual reasoning benchmarks for autonomous AI diagnosis in healthcare!
🚀Introducing Radiology’s Last Exam 2.0 (RadLE 2.0) from @CRASHLabAI, an uncertainty-aware benchmark for autonomous diagnosis in radiology!
✅In the last few days, the AI frontier has moved significantly. @OpenAI launched GPT-5.6 Sol. @Meta launched Muse Spark 1.1. @xAI dropped Grok 4.5.
🙌We’ve benchmarked all frontier, open-source and medical VLMs in RadLE2.0 and the leaderboard is now LIVE!
🚨 Before AI models are handed autonomy, one question matters more than any accuracy score: Do they know when to STOP and hand over to a human?
⚠️ A confident wrong diagnosis is far more dangerous than an honest “I don’t know.” Yet most models are bad at admitting the latter!
🚀 We release five RadLE 2.0 Scores: Confidence Weighted, Reliability, Accuracy, Safety and Handover Readiness and we find that models from @OpenAI @AnthropicAI @MetaAI @GoogleDeepMind @xAI @nvidia @Alibaba_Qwen @MistralAI @MiniMax_AI all score very differently as they optimize for different metrics!
🚨But most importantly, NONE of the Models have been able to reach the average human expert baseline!
⚡️A thread on what we found and which models aced our metrics! Link to the leaderboard and technical report at the end of the thread!View quoted post on X
A Systematic Review and Meta-analysis of the Effectiveness of Remdesivir to Treat SARS-CoV-2 in Hospitalized Patients: Have the Guidelines Evolved With the Evidence?View quoted post on X
bit.ly/3JmI5Dc
