Journal Article

A real-world clinical validation for AI-based MRI monitoring in multiple sclerosis

Beadnall, Heidi, Dugal, Tej, Krieger, Stephen, Zivadinov, Robert, Masters, Lynette, Butzkueven, Helmut, Brown, J. William L., Guilfoyle, Daniel, Wang, Dongang, Tang, Zihao, Ward, Kayla, Ly, Linda, Das, Tilak, Cabezas, Mariano, Brunacci, David, Klistorner, Alexander, Shieh, Andy, Barnett, Michael, Wang, Chenyu, Barnett, Yael, Kyle, Kain, Wiendl, Heinz, Zhan, Geng, Bischof, Antje, van der Walt, Anneke

2023

Overview

Modern management of MS targets No Evidence of Disease Activity (NEDA): no clinical relapses, no magnetic resonance imaging (MRI) disease activity and no disability worsening. While MRI is the principal tool available to neurologists for monitoring clinically silent MS disease activity and, where appropriate, escalating treatment, standard radiology reports are qualitative and may be insensitive to the development of new or enlarging lesions. Existing quantitative neuroimaging tools lack adequate clinical validation. In 397 multi-center MRI scan pairs acquired in routine practice, we demonstrate superior case-level sensitivity of a clinically integrated AI-based tool over standard radiology reports (93.3% vs 58.3%), relative to a consensus ground truth, with minimal loss of specificity. We also demonstrate equivalence of the AI-tool with a core clinical trial imaging lab for lesion activity and quantitative brain volumetric measures, including percentage brain volume loss (PBVC), an accepted biomarker of neurodegeneration in MS (mean PBVC −0.32% vs −0.36%, respectively), whereas even severe atrophy (>0.8% loss) was not appreciated in radiology reports. Finally, the AI-tool additionally embeds a clinically meaningful, experiential comparator that returns a relevant MS patient centile for lesion burden, revealing, in our cohort, inconsistencies in qualitative descriptors used in radiology reports. AI-based image quantitation enhances the accuracy of, and value-adds to, qualitative radiology reporting. Scaled deployment of these tools will open a path to precision management for patients with MS.

• Publisher: Nature Publishing Group UK,Nature Publishing Group,Nature Portfolio
• Subject: 692/308/575 / 692/617/375/1666 / Algorithms / Artificial intelligence / Atrophy / Biomedicine / Biotechnology / Hospitals / Magnetic resonance imaging / Medical imaging / Medicine / Medicine & Public Health / Multiple sclerosis / Neurodegeneration / Neuroimaging / Neurology / Patients