Matthew B. Jané

I’ve been quiet on social media lately, but today I’m launching Audit Clinical Evidence (ACE), an initiative I’ve been developing over the past year.

ACE documents errors, inconsistencies, and potential research misconduct, including falsification, in clinical and medical research. Our audit reports are evidence-based and openly available, with supporting analyses and materials shared for transparency and independent scrutiny.

We use the ACE Research Integrity Violations (ACE-RIV) taxonomy to classify and document these issues systematically and consistently.

Many more posts to come!

Take a look: AuditClinicalEvidence.org

I relocated my artifact and effect size simulator on my website and added new visualizations and features. It now includes odds ratios and risk ratios!

Check it out: matthewbjane.com/artifact-simul…

New ACE audit report: Singh et al. (1997), one of the most cited trials of resistance training for depression in older adults.

Misreporting of standard deviations and impossible statistics led many meta-analyses to artificially inflated effects. The largest effect a correct extraction can produce is −0.72. Yet the median effect meta-analyses assign to Singh is −2.74!! Why is that? 1/3

auditclinicalevidence.org/reports/ACE202…

The Audit Clinical Evidence (ACE) Initiative posted an update to the first audit report (wrt Abdelbasset et al 2019). Gideon Meyerowitz-Katz found some additional errors in the baseline tables that have now been included in the report.

Some additional things:

- Version control through Zenodo is fully set up. Each report has a change log and a DOI for each version.

- New cover pages and some new aesthetic changes to the PDF versions of the audit reports.
- Thanks Gideon Meyerowitz-Katz for posting the report on pubpeer!

I will make a separate post summarizing the findings for this report.

auditclinicalevidence.org/reports/ACE202…

{tidyplots} looks convenient and produces some really clean plots. I’m going to have to try this out.

tidyplots.org