In fact this study’s been out as a preprint since April 2025, so the researchers got their work out in reasonable time.
i am begging academics to study AI capabilities using frontier models.View quoted post on X
the models used in this study (which is going to be cited for years as proof that "AI is bad at health advice") are GPT-4o, Llama 3, and Command R+, two obsolete models and one i've never heard of.