Journal Article

MRI-based Neuropathy Score Reporting And Data System (NS-RADS): multi-institutional wider-experience usability study of peripheral neuropathy conditions among 32 radiology readers

Souza, Felipe, Mohanan, Shilpa, Geisbush, Thomas, Manov, John, Guirguis, Mina, Maloney, Sean, Walter, Sven S., Fritz, Jan, Thurlow, Peter C., Horneber, Elizabeth, Pezeshk, Parham, Purushothaman, Rangarajan, Chalian, Majid, Pandey, Tarun, Deshmukh, Swati D., Aguilera, Antonio, Xi, Yin, Chaganti, SubbaRao, Rasper, Michael, Mogharrabi, Bayan, Duarte Silva, Flavio, Ashikyan, Oganes, Stebner, Alexander, Christensen, Diana, Cardoso, Fabiano Nassar, Downing, Chad, Kim, Jun Man, Andreisek, Gustav, Petterson, Matthew, Vilanilam, George, Wong, Philip K., Manzano, Wilfred, Evers, Jochen, Jagadale, Akshaya, Wu, Jim S, Raichandani, Surbhi, Lutz, Amelie M., Subhawong, Ty, Chhabra, Avneesh, Park, Eunhae, Antil, Neha, Bajaj, Gitanjali, Komarraju, Aparna, Cabrera, Clementina, Umpierrez, Monica

2024

Overview

Objective To determine the inter-reader reliability and diagnostic performance of classification and severity scales of Neuropathy Score Reporting And Data System (NS-RADS) among readers of differing experience levels after limited teaching of the scoring system. Methods This is a multi-institutional, cross-sectional, retrospective study of MRI cases of proven peripheral neuropathy (PN) conditions. Thirty-two radiology readers with varying experience levels were recruited from different institutions. Each reader attended and received a structured presentation that described the NS-RADS classification system containing examples and reviewed published articles on this subject. The readers were then asked to perform NS-RADS scoring with recording of category, subcategory, and most likely diagnosis. Inter-reader agreements were evaluated by Conger’s kappa and diagnostic accuracy was calculated for each reader as percent correct diagnosis. A linear mixed model was used to estimate and compare accuracy between trainees and attendings. Results Across all readers, agreement was good for NS-RADS category and moderate for subcategory. Inter-reader agreement of trainees was comparable to attendings (0.65 vs 0.65). Reader accuracy for attendings was 75% (95% CI 73%, 77%), slightly higher than for trainees (71% (69%, 72%), p = 0.0006) for nerves and comparable for muscles (attendings, 87.5% (95% CI 86.1–88.8%) and trainees, 86.6% (95% CI 85.2–87.9%), p = 0.4). NS-RADS accuracy was also higher than average accuracy for the most plausible diagnosis for attending radiologists at 67% (95% CI 63%, 71%) and for trainees at 65% (95% CI 60%, 69%) ( p = 0.036). Conclusion Non-expert radiologists interpreted PN conditions with good accuracy and moderate-to-good inter-reader reliability using the NS-RADS scoring system. Clinical relevance statement The Neuropathy Score Reporting And Data System (NS-RADS) is an accurate and reliable MRI-based image scoring system for practical use for the diagnosis and grading of severity of peripheral neuromuscular disorders by both experienced and general radiologists. Key Points • The Neuropathy Score Reporting And Data System (NS-RADS) can be used effectively by non-expert radiologists to categorize peripheral neuropathy. • Across 32 different experience-level readers, the agreement was good for NS-RADS category and moderate for NS-RADS subcategory. • NS-RADS accuracy was higher than the average accuracy for the most plausible diagnosis for both attending radiologists and trainees (at 75%, 71% and 65%, 65%, respectively).

• Publisher: Springer Berlin Heidelberg,Springer Nature B.V
• Subject: Accuracy / Adult / Aged / Agreements / Classification / Clinical Competence / Cross-Sectional Studies / Data systems / Diagnosis / Diagnostic Radiology / Diagnostic systems / Female / Humans / Imaging / Internal Medicine / Interventional Radiology / Magnetic Resonance / Magnetic resonance imaging / Magnetic Resonance Imaging - methods / Male / Medicine / Medicine & Public Health / Middle Aged / Muscles / Nerves / Neuromuscular diseases / Neuroradiology / Observer Variation / Peripheral Nervous System Diseases - diagnostic imaging / Peripheral neuropathy / Radiologists / Radiology / Radiology - education / Reliability / Reproducibility of Results / Retrospective Studies / Severity of Illness Index / Teaching methods / Ultrasound