Catalogue Search | MBRL
Search Results Heading
Explore the vast range of titles available.
MBRLSearchResults
-
DisciplineDiscipline
-
Is Peer ReviewedIs Peer Reviewed
-
Item TypeItem Type
-
SubjectSubject
-
YearFrom:-To:
-
More FiltersMore FiltersSourceLanguage
Done
Filters
Reset
107
result(s) for
"Simulated clients"
Sort by:
Evaluating youth-friendly health services: young people's perspectives from a simulated client study in urban South Africa
by
Clarke, Lynda
,
Webb, Emily L.
,
Geary, Rebecca S.
in
Adolescent
,
adolescent health services
,
Attitude of Health Personnel
2015
Few youth-friendly health services worldwide have been scaled up or evaluated from young people's perspectives. South Africa's Youth Friendly Services (YFS) programme is one of the few to have been scaled up. This study investigated young people's experiences of using sexual and reproductive health services at clinics providing the YFS programme, compared to those that did not, using the simulated client method.
Fifteen primary healthcare clinics in Soweto were randomly sampled: seven provided the YFS programme. Simulated clients conducted 58 visits; young men requested information on condom reliability and young women on contraceptive methods. There were two outcome measures: a single measure of the overall clinic experience (clinic visit score) and whether or not simulated clients would recommend a clinic to their peers. The clinic visit score was based on variables relating to the simulated clients' interactions with staff, details of their consultation, privacy, confidentiality, the healthcare workers' characteristics, and the clinic environment. A larger score corresponds to a worse experience than a smaller one. Multilevel regression models and framework analysis were used to investigate young people's experiences.
Health facilities providing the YFS programme did not deliver a more positive experience to young people than those not providing the programme (mean difference in clinic visit score: −0.18, 95% CI: −0.95, 0.60, p=0.656). They were also no more likely to be recommended by simulated clients to their peers (odds ratio: 0.48, 95% CI: 0.11, 2.10, p=0.331). More positive experiences were characterised by young people as those where healthcare workers were friendly, respectful, knew how to talk to young people, and appeared to value them seeking health information. Less positive experiences were characterised by having to show soiled sanitary products to obtain contraceptives, healthcare workers expressing negative opinions about young people seeking information, lack of privacy, and inadequate information.
The provision and impact of the YFS programme are limited. Future research should explore implementation. Regular training and monitoring could enable healthcare workers to address young people's needs.
Journal Article
Virtual Patient Simulations in Health Professions Education: Systematic Review and Meta-Analysis by the Digital Health Education Collaboration
2019
Virtual patients are interactive digital simulations of clinical scenarios for the purpose of health professions education. There is no current collated evidence on the effectiveness of this form of education.
The goal of this study was to evaluate the effectiveness of virtual patients compared with traditional education, blended with traditional education, compared with other types of digital education, and design variants of virtual patients in health professions education. The outcomes of interest were knowledge, skills, attitudes, and satisfaction.
We performed a systematic review on the effectiveness of virtual patient simulations in pre- and postregistration health professions education following Cochrane methodology. We searched 7 databases from the year 1990 up to September 2018. No language restrictions were applied. We included randomized controlled trials and cluster randomized trials. We independently selected studies, extracted data, and assessed risk of bias and then compared the information in pairs. We contacted study authors for additional information if necessary. All pooled analyses were based on random-effects models.
A total of 51 trials involving 4696 participants met our inclusion criteria. Furthermore, 25 studies compared virtual patients with traditional education, 11 studies investigated virtual patients as blended learning, 5 studies compared virtual patients with different forms of digital education, and 10 studies compared different design variants. The pooled analysis of studies comparing the effect of virtual patients to traditional education showed similar results for knowledge (standardized mean difference [SMD]=0.11, 95% CI -0.17 to 0.39, I
=74%, n=927) and favored virtual patients for skills (SMD=0.90, 95% CI 0.49 to 1.32, I
=88%, n=897). Studies measuring attitudes and satisfaction predominantly used surveys with item-by-item comparison. Trials comparing virtual patients with different forms of digital education and design variants were not numerous enough to give clear recommendations. Several methodological limitations in the included studies and heterogeneity contributed to a generally low quality of evidence.
Low to modest and mixed evidence suggests that when compared with traditional education, virtual patients can more effectively improve skills, and at least as effectively improve knowledge. The skills that improved were clinical reasoning, procedural skills, and a mix of procedural and team skills. We found evidence of effectiveness in both high-income and low- and middle-income countries, demonstrating the global applicability of virtual patients. Further research should explore the utility of different design variants of virtual patients.
Journal Article
Clinical Virtual Simulation in Nursing Education: Randomized Controlled Trial
by
Padilha, José Miguel
,
Machado, Paulo Puga
,
Ramos, José
in
Attrition
,
Clinical assessment
,
Clinical Competence - standards
2019
In the field of health care, knowledge and clinical reasoning are key with regard to quality and confidence in decision making. The development of knowledge and clinical reasoning is influenced not only by students' intrinsic factors but also by extrinsic factors such as satisfaction with taught content, pedagogic resources and pedagogic methods, and the nature of the objectives and challenges proposed. Nowadays, professors play the role of learning facilitators rather than simple \"lecturers\" and face students as active learners who are capable of attributing individual meanings to their personal goals, challenges, and experiences to build their own knowledge over time. Innovations in health simulation technologies have led to clinical virtual simulation. Clinical virtual simulation is the recreation of reality depicted on a computer screen and involves real people operating simulated systems. It is a type of simulation that places people in a central role through their exercising of motor control skills, decision skills, and communication skills using virtual patients in a variety of clinical settings. Clinical virtual simulation can provide a pedagogical strategy and can act as a facilitator of knowledge retention, clinical reasoning, improved satisfaction with learning, and finally, improved self-efficacy. However, little is known about its effectiveness with regard to satisfaction, self-efficacy, knowledge retention, and clinical reasoning.
This study aimed to evaluate the effect of clinical virtual simulation with regard to knowledge retention, clinical reasoning, self-efficacy, and satisfaction with the learning experience among nursing students.
A randomized controlled trial with a pretest and 2 posttests was carried out with Portuguese nursing students (N=42). The participants, split into 2 groups, had a lesson with the same objectives and timing. The experimental group (n=21) used a case-based learning approach, with clinical virtual simulator as a resource, whereas the control group (n=21) used the same case-based learning approach, with recourse to a low-fidelity simulator and a realistic environment. The classes were conducted by the usual course lecturers. We assessed knowledge and clinical reasoning before the intervention, after the intervention, and 2 months later, with a true or false and multiple-choice knowledge test. The students' levels of learning satisfaction and self-efficacy were assessed with a Likert scale after the intervention.
The experimental group made more significant improvements in knowledge after the intervention (P=.001; d=1.13) and 2 months later (P=.02; d=0.75), and it also showed higher levels of learning satisfaction (P<.001; d=1.33). We did not find statistical differences in self-efficacy perceptions (P=.9; d=0.054).
The introduction of clinical virtual simulation in nursing education has the potential to improve knowledge retention and clinical reasoning in an initial stage and over time, and it increases the satisfaction with the learning experience among nursing students.
Journal Article
Artificial Intelligence Supporting the Training of Communication Skills in the Education of Health Care Professions: Scoping Review
by
Steinhäuser, Jost
,
Stamer, Tjorven
,
Flägel, Kristina
in
Academic discourse
,
Analysis
,
Artificial Intelligence
2023
Communication is a crucial element of every health care profession, rendering communication skills training in all health care professions as being of great importance. Technological advances such as artificial intelligence (AI) and particularly machine learning (ML) may support this cause: it may provide students with an opportunity for easily accessible and readily available communication training.
This scoping review aimed to summarize the status quo regarding the use of AI or ML in the acquisition of communication skills in academic health care professions.
We conducted a comprehensive literature search across the PubMed, Scopus, Cochrane Library, Web of Science Core Collection, and CINAHL databases to identify articles that covered the use of AI or ML in communication skills training of undergraduate students pursuing health care profession education. Using an inductive approach, the included studies were organized into distinct categories. The specific characteristics of the studies, methods and techniques used by AI or ML applications, and main outcomes of the studies were evaluated. Furthermore, supporting and hindering factors in the use of AI and ML for communication skills training of health care professionals were outlined.
The titles and abstracts of 385 studies were identified, of which 29 (7.5%) underwent full-text review. Of the 29 studies, based on the inclusion and exclusion criteria, 12 (3.1%) were included. The studies were organized into 3 distinct categories: studies using AI and ML for text analysis and information extraction, studies using AI and ML and virtual reality, and studies using AI and ML and the simulation of virtual patients, each within the academic training of the communication skills of health care professionals. Within these thematic domains, AI was also used for the provision of feedback. The motivation of the involved agents played a major role in the implementation process. Reported barriers to the use of AI and ML in communication skills training revolved around the lack of authenticity and limited natural flow of language exhibited by the AI- and ML-based virtual patient systems. Furthermore, the use of educational AI- and ML-based systems in communication skills training for health care professionals is currently limited to only a few cases, topics, and clinical domains.
The use of AI and ML in communication skills training for health care professionals is clearly a growing and promising field with a potential to render training more cost-effective and less time-consuming. Furthermore, it may serve learners as an individualized and readily available exercise method. However, in most cases, the outlined applications and technical solutions are limited in terms of access, possible scenarios, the natural flow of a conversation, and authenticity. These issues still stand in the way of any widespread implementation ambitions.
Journal Article
Virtual Patients Using Large Language Models: Scalable, Contextualized Simulation of Clinician-Patient Dialogue With Feedback
by
Overgaard, Joshua
,
Del Fiol, Guilherme
,
Cook, David A
in
Application programming interface
,
Artificial intelligence
,
Authenticity
2025
Virtual patients (VPs) are computer screen-based simulations of patient-clinician encounters. VP use is limited by cost and low scalability.
We aimed to show that VPs powered by large language models (LLMs) can generate authentic dialogues, accurately represent patient preferences, and provide personalized feedback on clinical performance. We also explored using LLMs to rate the quality of dialogues and feedback.
We conducted an intrinsic evaluation study rating 60 VP-clinician conversations. We used carefully engineered prompts to direct OpenAI's generative pretrained transformer (GPT) to emulate a patient and provide feedback. Using 2 outpatient medicine topics (chronic cough diagnosis and diabetes management), each with permutations representing different patient preferences, we created 60 conversations (dialogues plus feedback): 48 with a human clinician and 12 \"self-chat\" dialogues with GPT role-playing both the VP and clinician. Primary outcomes were dialogue authenticity and feedback quality, rated using novel instruments for which we conducted a validation study collecting evidence of content, internal structure (reproducibility), relations with other variables, and response process. Each conversation was rated by 3 physicians and by GPT. Secondary outcomes included user experience, bias, patient preferences represented in the dialogues, and conversation features that influenced authenticity.
The average cost per conversation was US $0.51 for GPT-4.0-Turbo and US $0.02 for GPT-3.5-Turbo. Mean (SD) conversation ratings, maximum 6, were overall dialogue authenticity 4.7 (0.7), overall user experience 4.9 (0.7), and average feedback quality 4.7 (0.6). For dialogues created using GPT-4.0-Turbo, physician ratings of patient preferences aligned with intended preferences in 20 to 47 of 48 dialogues (42%-98%). Subgroup comparisons revealed higher ratings for dialogues using GPT-4.0-Turbo versus GPT-3.5-Turbo and for human-generated versus self-chat dialogues. Feedback ratings were similar for human-generated versus GPT-generated ratings, whereas authenticity ratings were lower. We did not perceive bias in any conversation. Dialogue features that detracted from authenticity included that GPT was verbose or used atypical vocabulary (93/180, 51.7% of conversations), was overly agreeable (n=56, 31%), repeated the question as part of the response (n=47, 26%), was easily convinced by clinician suggestions (n=35, 19%), or was not disaffected by poor clinician performance (n=32, 18%). For feedback, detractors included excessively positive feedback (n=42, 23%), failure to mention important weaknesses or strengths (n=41, 23%), or factual inaccuracies (n=39, 22%). Regarding validation of dialogue and feedback scores, items were meticulously developed (content evidence), and we confirmed expected relations with other variables (higher ratings for advanced LLMs and human-generated dialogues). Reproducibility was suboptimal, due largely to variation in LLM performance rather than rater idiosyncrasies.
LLM-powered VPs can simulate patient-clinician dialogues, demonstrably represent patient preferences, and provide personalized performance feedback. This approach is scalable, globally accessible, and inexpensive. LLM-generated ratings of feedback quality are similar to human ratings.
Journal Article
Virtual Patient Simulations Using Social Robotics Combined With Large Language Models for Clinical Reasoning Training in Medical Education: Mixed Methods Study
2025
Virtual patients (VPs) are computer-based simulations of clinical scenarios used in health professions education to address various learning outcomes, including clinical reasoning (CR). CR is a crucial skill for health care practitioners, and its inadequacy can compromise patient safety. Recent advancements in large language models (LLMs) and social robots have introduced new possibilities for enhancing VP interactivity and realism. However, their application in VP simulations has been limited, and no studies have investigated the effectiveness of combining LLMs with social robots for CR training.
The aim of the study is to explore the potential added value of a social robotic VP platform combined with an LLM compared to a conventional computer-based VP modality for CR training of medical students.
A Swedish explorative proof-of-concept study was conducted between May and July 2023, combining quantitative and qualitative methodology. In total, 15 medical students from Karolinska Institutet and an international exchange program completed a VP case in a social robotic platform and a computer-based semilinear platform. Students' self-perceived VP experience focusing on CR training was assessed using a previously developed index, and paired 2-tailed t test was used to compare mean scores (scales from 1 to 5) between the platforms. Moreover, in-depth interviews were conducted with 8 medical students.
The social robotic platform was perceived as more authentic (mean 4.5, SD 0.7 vs mean 3.9, SD 0.5; odds ratio [OR] 2.9, 95% CI 0.0-1.0; P=.04) and provided a beneficial overall learning effect (mean 4.4, SD 0.6 versus mean 4.1, SD 0.6; OR 3.7, 95% CI 0.1-0.5; P=.01) compared with the computer-based platform. Qualitative analysis revealed 4 themes, wherein students experienced the social robot as superior to the computer-based platform in training CR, communication, and emotional skills. Limitations related to technical and user-related aspects were identified, and suggestions for improvements included enhanced facial expressions and VP cases simulating multiple personalities.
A social robotic platform enhanced by an LLM may provide an authentic and engaging learning experience for medical students in the context of VP simulations for training CR. Beyond its limitations, several aspects of potential improvement were identified for the social robotic platform, lending promise for this technology as a means toward the attainment of learning outcomes within medical education curricula.
Journal Article
Over-the-counter antibiotic sales in community and online pharmacies, China
by
Chen, Zhenyuan
,
Feng, Jie
,
Gong, Yanhong
in
Anti-Bacterial Agents - therapeutic use
,
Antibiotics
,
Capital cities
2020
To determine the prevalence of and factors associated with dispensing antibiotics without a prescription in online and community pharmacies in China.
We conducted a nationwide cross-sectional study of online and community pharmacies in 27 cities and counties in nine provinces in China (selected by multistage sampling) from July 2017 to December 2018. We assessed sale of antibiotics without a prescription and quality of pharmacy services through simulated clients who asked to buy specific antibiotics. We compared the prevalence of sales between online and community pharmacies, and between location and features of community pharmacies.
Of 220 online and 675 community pharmacies, 174 (79.1%) and 586 (86.8%) sold antibiotics without a valid prescription, respectively. About half of the online pharmacies had a notice on their website about the illegality of selling prescription-only medicines without a prescription while none of the community pharmacists had. More online pharmacies without this notice dispensed antibiotics without a valid prescription (
< 0.001). Antibiotics' sale without a prescription was significantly less prevalent in provincial capital cities (71.6%; 161/225) than prefectural-level cities (95.1%; 214/225) and counties (93.8%; 211/225;
< 0.001). Most pharmacy staff did not ask for important information from clients before dispensing the antibiotic or provide them with necessary information about the antibiotic.
Given the high proportion of sales of prescription-only medicines without a prescription, there is a need to strengthen enforcement of regulations, improve public education on antibiotics, train pharmacy staff and consolidate public involvement in antibiotic stewardship in retail pharmacies in China.
Journal Article
Mass Casualty Incident Training in Immersive Virtual Reality: Quasi-Experimental Evaluation of Multimethod Performance Indicators
2025
Immersive virtual reality (iVR) has emerged as a training method to prepare medical first responders (MFRs) for mass casualty incidents (MCIs) and disasters in a resource-efficient, flexible, and safe manner. However, systematic evaluations and validations of potential performance indicators for virtual MCI training are still lacking.
This study aimed to investigate whether different performance indicators based on visual attention, triage performance, and information transmission can be effectively extended to MCI training in iVR by testing if they can discriminate between different levels of expertise. Furthermore, the study examined the extent to which such objective indicators correlate with subjective performance assessments.
A total of 76 participants (mean age 25.54, SD 6.01 y; 45/76, 59% male) with different medical expertise (MFRs: paramedics and emergency physicians; non-MFRs: medical students, in-hospital nurses, and other physicians) participated in 5 virtual MCI scenarios of varying complexity in a randomized order. Tasks involved assessing the situation, triaging virtual patients, and transmitting relevant information to a control center. Performance indicators included eye-tracking-based visual attention, triage accuracy, triage speed, information transmission efficiency, and self-assessment of performance. Expertise was determined based on the occupational group (39/76, 51% MFRs vs 37/76, 49% non-MFRs) and a knowledge test with patient vignettes.
Triage accuracy (d=0.48), triage speed (d=0.42), and information transmission efficiency (d=1.13) differentiated significantly between MFRs and non-MFRs. In addition, higher triage accuracy was significantly associated with higher triage knowledge test scores (Spearman ρ=0.40). Visual attention was not significantly associated with expertise. Furthermore, subjective performance was not correlated with any other performance indicator.
iVR-based MCI scenarios proved to be a valuable tool for assessing the performance of MFRs. The results suggest that iVR could be integrated into current MCI training curricula to provide frequent, objective, and potentially (partly) automated performance assessments in a controlled environment. In particular, performance indicators, such as triage accuracy, triage speed, and information transmission efficiency, capture multiple aspects of performance and are recommended for integration. While the examined visual attention indicators did not function as valid performance indicators in this study, future research could further explore visual attention in MCI training and examine other indicators, such as holistic gaze patterns. Overall, the results underscore the importance of integrating objective indicators to enhance trainers' feedback and provide trainees with guidance on evaluating and reflecting on their own performance.
Journal Article
Assessment of Diagnostic Competences With Standardized Patients Versus Virtual Patients: Experimental Study in the Context of History Taking
by
Stadler, Matthias
,
Siebeck, Matthias
,
Fink, Maximilian C
in
Accuracy
,
Authenticity
,
Clinical assessment
2021
Standardized patients (SPs) have been one of the popular assessment methods in clinical teaching for decades, although they are resource intensive. Nowadays, simulated virtual patients (VPs) are increasingly used because they are permanently available and fully scalable to a large audience. However, empirical studies comparing the differential effects of these assessment methods are lacking. Similarly, the relationships between key variables associated with diagnostic competences (ie, diagnostic accuracy and evidence generation) in these assessment methods still require further research.
The aim of this study is to compare perceived authenticity, cognitive load, and diagnostic competences in performance-based assessment using SPs and VPs. This study also aims to examine the relationships of perceived authenticity, cognitive load, and quality of evidence generation with diagnostic accuracy.
We conducted an experimental study with 86 medical students (mean 26.03 years, SD 4.71) focusing on history taking in dyspnea cases. Participants solved three cases with SPs and three cases with VPs in this repeated measures study. After each case, students provided a diagnosis and rated perceived authenticity and cognitive load. The provided diagnosis was scored in terms of diagnostic accuracy; the questions asked by the medical students were rated with respect to their quality of evidence generation. In addition to regular null hypothesis testing, this study used equivalence testing to investigate the absence of meaningful effects.
Perceived authenticity (1-tailed t
=11.12; P<.001) was higher for SPs than for VPs. The correlation between diagnostic accuracy and perceived authenticity was very small (r=0.05) and neither equivalent (P=.09) nor statistically significant (P=.32). Cognitive load was equivalent in both assessment methods (t
=2.81; P=.003). Intrinsic cognitive load (1-tailed r=-0.30; P=.003) and extraneous load (1-tailed r=-0.29; P=.003) correlated negatively with the combined score for diagnostic accuracy. The quality of evidence generation was positively related to diagnostic accuracy for VPs (1-tailed r=0.38; P<.001); this finding did not hold for SPs (1-tailed r=0.05; P=.32). Comparing both assessment methods with each other, diagnostic accuracy was higher for SPs than for VPs (2-tailed t
=2.49; P=.01).
The results on perceived authenticity demonstrate that learners experience SPs as more authentic than VPs. As higher amounts of intrinsic and extraneous cognitive loads are detrimental to performance, both types of cognitive load must be monitored and manipulated systematically in the assessment. Diagnostic accuracy was higher for SPs than for VPs, which could potentially negatively affect students' grades with VPs. We identify and discuss possible reasons for this performance difference between both assessment methods.
Journal Article
Exploring nursing students' perspectives and experiences with artificial intelligence-driven patient interactions during a simulated placement: A qualitative study
by
Morini, Simone
,
Carlos Martinez, Neus
,
Jafari-Salim, Behnam
in
Academic Achievement
,
Adult
,
Artificial
2025
To explore the perceptions and experiences of mental health student nurses when interacting with artificial intelligence driven virtual patients during a simulated placement as a complementary teaching approach.
Higher education institutions are increasingly adopting simulated placements to tackle the challenges posed by limited placement capacity. However, logistical challenges and resource constraints, remain significant obstacles for these institutions. Artificial intelligence and virtual reality, present a promising solution by offering nursing students flexible, immersive and safe learning environments.
This qualitative descriptive study followed the Consolidated Criteria for Reporting Qualitative Research checklist and collected data through student focus groups.
A convenience sample of fifteen (n = 15) mental health nursing students were divided in two focus group to share their perspectives and experiences of engaging with the artificial intelligence driven patients in a virtual reality platform during history taking assessment. All participants had direct communication with artificial intelligence driven patients using both software functionalities, a menu-controlled and voice-controlled. A six-step reflexive thematic analysis of group discussions transcripts was employed to identify themes of their experiences and perceptions.
Five key themes were constructed from the data analysis. 1) Confidence Building; 2) Communication skills development and application; 3) Information gathering within the assessment process; 4) Innovative tool and technology acceptance and 5) Knowledge enrichment through self-reflection.
Artificial intelligence driven virtual patients were perceived as an innovative, engaging and good complementary pedagogical approach for simulated placements to develop confidence, communication skills, nursing assessment skills and readiness for clinical practice.
•Most students viewed AI-driven VR case scenarios as a valuable addition to their simulated placement experience.•AI-driven VR scenarios boost students' confidence in assessments and strengthen their communication skills.•Students improved their ability in gathering patient information during assessments.•Participants reported knowledge gains through self-reflection.•AI-driven VR scenarios are effective, innovative tools that complement lenring in simulated placements.
Journal Article