Journal Article

Reducing misdiagnoses and cognitive errors using virtual patients and automated feedback in a clinical reasoning curriculum

Lee, Chel Hee, Smith, David, Rogers, Suzanne, Waechter, Jason, Kusnoor, Anita, Eickman, Kara, Wong, Matt

2026

Overview

Introduction Diagnostic errors remain prevalent across all specialties, driven largely by deficits in clinical reasoning (CR). Although CR is a core competency, most medical schools lack structured pre-clerkship CR training. Virtual patients (VPs) with automated feedback offer scalable, simulation-based training to improve diagnostic skills and reduce faculty workload. The aim of this study was to assess whether a CR curriculum using VPs with automated scoring and deliberate practice improves diagnostic accuracy and CR. Methods We conducted a multi-site observational study across five North American medical schools. First- and second-year students completed up to 20 diagnostic VP cases on TeachingMedicine.com, each with automated scoring to inform individualized feedback. We analyzed 1.55 million datapoints from 12,400 cases completed by 1,066 students to assess differences in CR performance between correctly and incorrectly diagnosed cases, associations between CR components and diagnostic accuracy, and learning gains over time. Results Misdiagnoses occurred in 20.1% of cases. Correct diagnoses were associated with higher diagnostic justification (DxJ) scores (+ 50%), better test ordering (+ 51%), and fewer cognitive errors (–89%). Multivariate analysis identified DxJ and cognitive errors as the strongest predictors of diagnostic accuracy. With repeated practice, students improved DxJ by 72%, test ordering by 40%, and reduced misdiagnoses threefold and cognitive errors by half, with no plateau observed after 20 cases. By end of pre-clerkship, first-year students who completed 20 cases outperformed second-year students who completed 10 in all CR metrics. All results were statistically significant with p  < 0.0001. Conclusions This curriculum shows that CR skills are highly trainable through deliberate practice. Improved DxJ and reduced cognitive errors are strongly associated with lower misdiagnosis rates. In contrast to a common misperception, training CR diagnostic skills is successful when started in the beginning of 1st year medical school prior to students’ acquisition of significant medical knowledge.

• Publisher: BioMed Central,Springer Nature B.V,BMC
• Subject: Accuracy / Algorithms / Allied Health Occupations Education / Automation / Clinical reasoning / Cognition & reasoning / Cognitive errors / Cognitive Processes / Core Competencies / Curricula / Curriculum / Deliberate practice / Education / Educational Environment / Faculty Workload / Feedback / Formative evaluation / Instructional design / Internal Medicine / Medical Care Evaluation / Medical Education / Medical schools / Medical students / Medicine / Misdiagnosis / Multivariate Analysis / Osteopathic medicine / Patients / Physiology / Pre-clerkship / Scoring Rubrics / Skill Development / Skills / Statistical Analysis / Test Results / Test Selection / Theory of Medicine/Bioethics / Time / Workloads