Journal Article

Evaluating podcasts as a tool for OSCE training: a randomized trial using generative AI-powered simulation

Pers, Yves-Marie, Guerrot, Dominique, Figueres, Lucile, Yauy, Kevin, Bouazzi, Leila, Dupont, Vincent, Guenou, Emmanuel, Barbe, Coralie

2025

Overview

Introduction Objective Structured Clinical Examinations (OSCEs) are critical for assessing clinical competencies in medical education. While traditional teaching methods remain prevalent, this study introduces an innovative approach by evaluating the effectiveness of an OSCE preparation podcast in improving medical students’ OSCE performance using nephrology as a proof of concept. This novel method offers a flexible and accessible format for supplementary learning, potentially revolutionizing medical education. Methods A mono-centric randomized controlled trial was conducted among 50 fourth-year medical students. Participants were randomly assigned to either the podcast intervention group or a control group. Both groups completed six nephrology-specific OSCE stations on DocSimulator, a generative AI-powered virtual patient platform. Scores from three baseline and three post-intervention OSCE stations were compared. The primary outcome was the change in OSCE scores. Secondary outcomes included interest in nephrology and students’ self-reported competence in nephrology-related skills. Results The baseline OSCE scores did not differ between the two groups (23.8 ± 3.9 vs. 23.3 ± 5.3; p  = 0.77). After the intervention, the podcast group demonstrated a significantly higher OSCE score compared to the control group (27.6 ± 3.6 vs. 23.6 ± 5.0; p  = 0.002) with a greater improvement in OSCE scores (+ 3.52[0.7,6.5] vs. -1.22[-3,5.5]; p  = 0.03). While the podcast did not increase students’ intention to specialize in nephrology (4.2% vs. 4.0%; p  = 0.99), it significantly improved their confidence in nephrology-related clinical skills (41.7% vs. 16%, p  = 0.04). 68% of students in the podcast group found OSCE training podcast useful for their OSCE preparation, and 96% reported they would use it again. Conclusions The use of an OSCE preparation podcast significantly enhanced students’ performance in AI-based simulations and confidence in nephrology clinical competencies. Podcasts represent a valuable supplementary tool for medical education, providing flexibility and supporting diverse learning styles. Trial Registration Not applicable.

• Publisher: BioMed Central,BioMed Central Ltd,Springer Nature B.V,BMC
• Subject: Adult / Artificial Intelligence / Clinical Competence - standards / Communication Skills / Competence / Computers / Control Groups / Curricula / Digital broadcasting / Education / Education, Medical, Undergraduate - methods / Educational Measurement - methods / Educational research / Educational Resources / Educational tests and measurements / Examinations / Female / Formative Evaluation / Generative AI / Generative artificial intelligence / Humans / Internship Programs / Internships / Learning / Learning Strategies / Life Sciences / Male / Measurement Techniques / Medical Education / Medical Evaluation / Medical students / Nephrology / Nephrology - education / Objective structured clinical examinations / Patients / Performance evaluation / Podcast / Podcasting / Podcasts / Questionnaires / Simulation / Simulation methods / Skill Development / Skills / Statistical Analysis / Student Participation / Student Surveys / Students, Medical / Summative Evaluation / Testing / Theory of Medicine/Bioethics / Webcasts as Topic