Catalogue Search | MBRL
Search Results Heading
Explore the vast range of titles available.
MBRLSearchResults
-
DisciplineDiscipline
-
Is Peer ReviewedIs Peer Reviewed
-
Item TypeItem Type
-
SubjectSubject
-
YearFrom:-To:
-
More FiltersMore FiltersSourceLanguage
Done
Filters
Reset
5,114
result(s) for
"Clinical Competence - statistics "
Sort by:
Pathologists’ diagnosis of invasive melanoma and melanocytic proliferations: observer accuracy and reproducibility study
2017
Objective To quantify the accuracy and reproducibility of pathologists’ diagnoses of melanocytic skin lesions.Design Observer accuracy and reproducibility study.Setting 10 US states.Participants Skin biopsy cases (n=240), grouped into sets of 36 or 48. Pathologists from 10 US states were randomized to independently interpret the same set on two occasions (phases 1 and 2), at least eight months apart.Main outcome measures Pathologists’ interpretations were condensed into five classes: I (eg, nevus or mild atypia); II (eg, moderate atypia); III (eg, severe atypia or melanoma in situ); IV (eg, pathologic stage T1a (pT1a) early invasive melanoma); and V (eg, ≥pT1b invasive melanoma). Reproducibility was assessed by intraobserver and interobserver concordance rates, and accuracy by concordance with three reference diagnoses.Results In phase 1, 187 pathologists completed 8976 independent case interpretations resulting in an average of 10 (SD 4) different diagnostic terms applied to each case. Among pathologists interpreting the same cases in both phases, when pathologists diagnosed a case as class I or class V during phase 1, they gave the same diagnosis in phase 2 for the majority of cases (class I 76.7%; class V 82.6%). However, the intraobserver reproducibility was lower for cases interpreted as class II (35.2%), class III (59.5%), and class IV (63.2%). Average interobserver concordance rates were lower, but with similar trends. Accuracy using a consensus diagnosis of experienced pathologists as reference varied by class: I, 92% (95% confidence interval 90% to 94%); II, 25% (22% to 28%); III, 40% (37% to 44%); IV, 43% (39% to 46%); and V, 72% (69% to 75%). It is estimated that at a population level, 82.8% (81.0% to 84.5%) of melanocytic skin biopsy diagnoses would have their diagnosis verified if reviewed by a consensus reference panel of experienced pathologists, with 8.0% (6.2% to 9.9%) of cases overinterpreted by the initial pathologist and 9.2% (8.8% to 9.6%) underinterpreted.Conclusion Diagnoses spanning moderately dysplastic nevi to early stage invasive melanoma were neither reproducible nor accurate in this large study of pathologists in the USA. Efforts to improve clinical practice should include using a standardized classification system, acknowledging uncertainty in pathology reports, and developing tools such as molecular markers to support pathologists’ visual assessments.
Journal Article
Comparing Virtual Reality–Based and Traditional Physical Objective Structured Clinical Examination (OSCE) Stations for Clinical Competency Assessments: Randomized Controlled Trial
2025
Objective structured clinical examinations (OSCEs) are a widely recognized and accepted method to assess clinical competencies but are often resource-intensive.
This study aimed to evaluate the feasibility and effectiveness of a virtual reality (VR)-based station (VRS) compared with a traditional physical station (PHS) in an already established curricular OSCE.
Fifth-year medical students participated in an OSCE consisting of 10 stations. One of the stations, emergency medicine, was offered in 2 modalities: VRS and PHS. Students were randomly assigned to 1 of the 2 modalities. We used 2 distinct scenarios to prevent content leakage among participants. Student performance and item characteristics were analyzed, comparing the VRS with PHS as well as with 5 other case-based stations. Student perceptions of the VRS were collected through a quantitative and qualitative postexamination online survey, which included a 5-point Likert scale ranging from 1 (minimum) to 5 (maximum), to evaluate the acceptance and usability of the VR system. Organizational and technical feasibility as well as cost-effectiveness were also evaluated.
Following randomization and exclusions of invalid data sets, 57 and 66 participants were assessed for the VRS and PHS, respectively. The feasibility evaluation demonstrated smooth implementation of both VR scenarios (septic and anaphylactic shock) with 93% (53/57) of students using the VR technology without issues. The difficulty levels of the VRS scenarios (septic shock: P=.67; anaphylactic shock: P=.58) were comparable to the average difficulty of all stations (P=.68) and fell within the reference range (0.4-0.8). In contrast, VRS demonstrated above-average values for item discrimination (septic shock: r'=0.40; anaphylactic shock: r'=0.33; overall r'=0.30; with values >0.3 considered good) and discrimination index (septic shock: D=0.25; anaphylactic shock: D=0.26; overall D=0.16, with 0.2-0.3 considered mediocre and <0.2 considered poor). Apart from some hesitancy toward its broader application in future practical assessments (mean 3.07, SD 1.37 for VRS vs mean 3.65, SD 1.18 for PHS; P=.03), there were no other differences in perceptions between VRS and PHS. Thematic analysis highlighted the realistic portrayal of medical emergencies and fair assessment conditions provided by the VRS. Regarding cost-effectiveness, initial development of the VRS can be offset by long-term savings in recurring expenses like standardized patients and consumables.
Integration of the VRS into the current OSCE framework proved feasible both technically and organizationally, even within the strict constraints of short examination phases and schedules. The VRS was accepted and positively received by students across various levels of technological proficiency, including those with no prior VR experience. Notably, the VRS demonstrated comparable or even superior item characteristics, particularly in terms of discrimination power. Although challenges remain, such as technical reliability and some acceptance concerns, VR remains promising in applications of clinical competence assessment.
Journal Article
Use of the Smartphone App WhatsApp as an E-Learning Method for Medical Residents: Multicenter Controlled Randomized Trial
by
Gilles Lebuffe
,
Vincent Compere
,
Thomas Clavier
in
[SDV]Life Sciences [q-bio]
,
Adult
,
anesthesiology
2019
The WhatsApp smartphone app is the most widely used instant messaging app in the world. Recent studies reported the use of WhatsApp for educational purposes, but there is no prospective study comparing WhatsApp's pedagogical effectiveness to that of any other teaching modality.
The main objective of this study was to measure the impact of a learning program via WhatsApp on clinical reasoning in medical residents.
This prospective, randomized, multicenter study was conducted among first- and second-year anesthesiology residents (offline recruitment) from four university hospitals in France. Residents were randomized in two groups of online teaching (WhatsApp and control). The WhatsApp group benefited from daily delivery of teaching documents on the WhatsApp app and a weekly clinical case supervised by a senior physician. In the control group, residents had access to the same documents via a traditional computer electronic learning (e-learning) platform. Medical reasoning was self-assessed online by a script concordance test (SCT; primary parameter), and medical knowledge was assessed using multiple-choice questions (MCQs). The residents also completed an online satisfaction questionnaire.
In this study, 62 residents were randomized (32 to the WhatsApp group and 30 to the control group) and 22 residents in each group answered the online final evaluation. We found a difference between the WhatsApp and control groups for SCTs (60% [SD 9%] vs 68% [SD 11%]; P=.006) but no difference for MCQs (18/30 [SD 4] vs 16/30 [SD 4]; P=.22). Concerning satisfaction, there was a better global satisfaction rate in the WhatsApp group than in the control group (8/10 [interquartile range 8-9] vs 8/10 [interquartile range 8-8]; P=.049).
Compared to traditional e-learning, the use of WhatsApp for teaching residents was associated with worse clinical reasoning despite better global appreciation. The use of WhatsApp probably contributes to the dispersion of attention linked to the use of the smartphone. The impact of smartphones on clinical reasoning should be studied further.
Journal Article
Effectiveness of Immersive Virtual Reality on Orthopedic Surgical Skills and Knowledge Acquisition Among Senior Surgical Residents
2020
Video learning prior to surgery is common practice for trainees and surgeons, and immersive virtual reality (IVR) simulators are of increasing interest for surgical training. The training effectiveness of IVR compared with video training in complex skill acquisition should be studied.
To evaluate whether IVR improves learning effectiveness for surgical trainees and to validate a VR rating scale through correlation to real-world performance.
This block randomized, intervention-controlled clinical trial included senior (ie, postgraduate year 4 and 5) orthopedic surgery residents from multiple institutions in Canada during a single training course. An intention-to-treat analysis was performed. Data were collected from January 30 to February 1, 2020.
An IVR training platform providing a case-based module for reverse shoulder arthroplasty (RSA) for advanced rotator cuff tear arthropathy. Participants were permitted to repeat the module indefinitely.
The primary outcome measure was a validated performance metric for both the intervention and control groups (Objective Structured Assessment of Technical Skills [OSATS]). Secondary measures included transfer of training (ToT), transfer effectiveness ratio (TER), and cost-effectiveness (CER) ratios of IVR training compared with control. Additional secondary measures included IVR performance metrics measured on a novel rating scale compared with real-world performance.
A total of 18 senior surgical residents participated; 9 (50%) were randomized to the IVR group and 9 (50%) to the control group. Participant demographic characteristics were not different for age (mean [SD] age: IVR group, 31.1 [2.8] years; control group, 31.0 [2.7] years), gender (IVR group, 8 [89%] men; control group, 6 [67%] men), surgical experience (mean [SD] experience with RSA: IVR group, 3.3 [0.9]; control group, 3.2 [0.4]), or prior simulator use (had experience: IVR group 6 [67%]; control group, 4 [44%]). The IVR group completed training 387% faster considering a single repetition (mean [SD] time for IVR group: 4.1 [2.5] minutes; mean [SD] time for control group: 16.1 [2.6] minutes; difference, 12.0 minutes; 95% CI, 8.8-14.0 minutes; P < .001). The IVR group had significantly better mean (SD) OSATS scores than the control group (15.9 [2.5] vs 9.4 [3.2]; difference, 6.9; 95% CI, 3.3-9.7; P < .001). The IVR group also demonstrated higher mean (SD) verbal questioning scores (4.1 [1.0] vs 2.2 [1.7]; difference, 1.9; 95% CI, 0.1-3.3; P = .03). The IVR score (ie, Precision Score) had a strong correlation to real-world OSATS scores (r = 0.74) and final implant position (r = 0.73). The ToT was 59.4%, based on the OSATS score. The TER was 0.79, and the system was 34 times more cost-effective than control, based on CER.
In this study, surgical training with IVR demonstrated superior learning efficiency, knowledge, and skill transfer. The TER of 0.79 substituted for 47.4 minutes of operating room time when IVR was used for 60 minutes.
ClinicalTrials.gov Identifier: NCT04404010.
Journal Article
Validation of the mobile serious game application Touch Surgery™ for cognitive training and assessment of laparoscopic cholecystectomy
by
Proctor, Tanja
,
Kenngott, Hannes G.
,
Hendrie, Jonathan D.
in
Abdominal Surgery
,
Adult
,
Cholecystectomy
2017
Background
Touch Surgery
™
(TS) is a serious gaming application for cognitive task simulation and rehearsal of key steps in surgical procedures. The aim was to establish face, content, and construct validity of TS for laparoscopic cholecystectomy (LC). Furthermore, learning curves with TS and a virtual reality (VR) trainer were compared in a randomized trial.
Methods
The performance of medical students and general surgeons was compared for all three modules of LC in TS to establish construct validity. Questionnaires assessed face and content validity. For analysis of learning curves, students were randomized to train on VR or TS first, and then switched to the other training modality. Performance data were recorded.
Results
54 Surgeons and 51 medical students completed the validation study. Surgeons outperformed students with TS: patient preparation (students = 45.0 ± 19.1%; surgeons = 57.3 ± 15.2%;
p
< 0.001), access and laparoscopy (students = 70.2 ± 10.9%; surgeons = 75.9 ± 9.7%;
p
= 0.008) and LC (students = 69.8 ± 12.4%; surgeons = 77.7 ± 9.6%;
p
< 0.001). Both groups agreed that TS was a highly useful and realistic application. 46 students were randomized for learning curve analysis. It took them 2–4 attempts to reach a 100% score with TS. Training with TS first did not improve students’ performance on the VR trainer; however, students who trained with VR first scored significantly higher in module 3 of TS.
Conclusion
TS is an accepted serious gaming application for learning cognitive aspects of LC with established construct, face, and content validity. There appeared to be a synergy between TS and the VR trainer. Therefore, the two training modalities should accompany one another in a multimodal training approach to laparoscopy.
Journal Article
Treatment of child anxiety disorders via guided parent-delivered cognitive–behavioural therapy: Randomised controlled trial
by
Creswell, Cathy
,
Thirlwall, Kerstin
,
Karalus, Jessica
in
Anxiety
,
Anxiety disorders
,
Anxiety Disorders - psychology
2013
Promising evidence has emerged of clinical gains using guided self-help cognitive-behavioural therapy (CBT) for child anxiety and by involving parents in treatment; however, the efficacy of guided parent-delivered CBT has not been systematically evaluated in UK primary and secondary settings.
To evaluate the efficacy of low-intensity guided parent-delivered CBT treatments for children with anxiety disorders.
A total of 194 children presenting with a current anxiety disorder, whose primary carer did not meet criteria for a current anxiety disorder, were randomly allocated to full guided parent-delivered CBT (four face-to-face and four telephone sessions) or brief guided parent-delivered CBT (two face-to-face and two telephone sessions), or a wait-list control group (trial registration: ISRCTN92977593). Presence and severity of child primary anxiety disorder (Anxiety Disorders Interview Schedule for DSM-IV, child/parent versions), improvement in child presentation of anxiety (Clinical Global Impression - Improvement scale), and change in child anxiety symptoms (Spence Children's Anxiety Scale, child/parent version and Child Anxiety Impact scale, parent version) were assessed at post-treatment and for those in the two active treatment groups, 6 months post-treatment.
Full guided parent-delivered CBT produced superior diagnostic outcomes compared with wait-list at post-treatment, whereas brief guided parent-delivered CBT did not: at post-treatment, 25 (50%) of those in the full guided CBT group had recovered from their primary diagnosis, compared with 16 (25%) of those on the wait-list (relative risk (RR) 1.85, 95% CI 1.14-2.99); and in the brief guided CBT group, 18 participants (39%) had recovered from their primary diagnosis post-treatment (RR = 1.56, 95% CI 0.89-2.74). Level of therapist training and experience was unrelated to child outcome.
Full guided parent-delivered CBT is an effective and inexpensive first-line treatment for child anxiety.
Journal Article
The Influence of Online and Offline Mixed Teaching Mode Based on TPACK on the Theoretical Knowledge and Comprehensive Ability Level of Tumor Gynecology Postgraduates
by
Wang, Caizhi
,
Wang, Lihua
,
Wang, Liangliang
in
Adult
,
Clinical Competence - statistics & numerical data
,
Education, Distance - methods
2024
To explore the influence of online and offline mixed teaching modes based on TPACK on theoretical knowledge and comprehensive ability of tumor gynecology postgraduates.
In this study, a prospective randomized controlled study model was used to select 60 masters of oncology and gynecology who were interned in the Affiliated Hospital of the First Affiliated Hospital of Bengbu Medical College from September 2019 to April 2022 as the research objects. They were divided into a study group and a control group by random number table, with 30 cases in each group. The control group adopted the traditional teaching mode, while the study group adopted the mixed online and offline teaching mode based on TPACK to implement the teaching. The knowledge mastery, problem analysis ability and total ability of the two groups were compared before and after the practice.
After the practice, the scores of theoretical knowledge, clinical operation skills and case analysis ability of both groups were improved compared with those before the practice, and the scores of the study group were higher than those of the control group (P < .05). After practice, the scores of problem analysis and clinical work competence in both groups were significantly higher than those before practice, and the study group was higher than the control group (P < .05). After practice, the scores of professional technical knowledge, doctor-patient communication ability, clinical operation skill, disease observation ability and clinical first-aid ability of both groups were improved compared with those before practice, and the scores of the study group were higher than those of the control group (P < .05).
In clinical teaching, the online and offline mixed teaching mode based on TPACK has obvious effects on improving the theoretical and clinical operation level of tumor gynecology postgraduates and the total ability of medical staff.
Journal Article
Collaboration With People With Lived Experience of Mental Illness to Reduce Stigma and Improve Primary Care Services
by
Gurung, Dristy
,
Kohrt, Brandon A.
,
Jordans, Mark J. D.
in
Accuracy
,
Adult
,
Attitude of Health Personnel
2021
Collaboration with people with lived experience of mental illness (PWLE), also referred to as service users, is a growing priority to reduce stigma and improve mental health care.
To examine feasibility and acceptability of conducting an antistigma intervention in collaboration with PWLE during mental health training of primary care practitioners (PCPs).
This pilot cluster randomized clinical trial was conducted from February 7, 2016, to August 10, 2018, with assessors, PCPs, and patients blinded to group assignment. The participants were PCPs and primary care patients diagnosed with depression, psychosis, or alcohol use disorder at primary care facilities (the cluster unit of randomization) in Nepal. Statistical analysis was performed from February 2020 to February 2021.
In the control group, PCPs were trained on the World Health Organization Mental Health Gap Action Programme-Intervention Guide (mhGAP-IG). In the Reducing Stigma Among Healthcare Providers (RESHAPE) group, the mhGAP-IG trainings for PCPs were cofacilitated by PWLE who presented recovery testimonials through photographic narratives.
Prespecified feasibility and acceptability measures were adequacy of randomization, retention rates, intervention fidelity, data missingness, and safety. Outcome measures for PCPs included the Social Distance Scale (SDS), accuracy of diagnoses of mental illness in standardized role-plays using the Enhancing Assessment of Common Therapeutic factors tool (ENACT), and accuracy of diagnosis with actual patients. The primary end point was 16 months posttraining.
Among the overall sample of 88 PCPs, 75 (85.2%) were men and 67 (76.1%) were upper caste Hindus; the mean (SD) age was 36.2 (8.8) years. Nine of the PCPs (10.2%) were physicians, whereas the remaining 79 PCPs (89.8%) were health assistants or auxiliary health workers. Thirty-four facilities were randomized to RESHAPE or the control group. All eligible PCPs participated: 43 in RESHAPE and 45 in the control group, with 76.7% (n = 33) and 73.3% (n = 33) retention at end line, respectively. Due to PCP dropout, 29 facilities (85.3%) were included in end line analysis. Of 15 PWLE trained as cofacilitators, 11 (73.3%) participated throughout the 3 months of PCP trainings. Among PCPs, mean SDS changes from pretraining to 16 months were -10.6 points (95% CI, -14.5 to -6.74 points) in RESHAPE and -2.79 points (-8.29 to 2.70 points) in the control group. Role-play-based diagnoses with ENACT were 78.1% (25 of 32) accurate in RESHAPE and 66.7% (22 of 33) in the control group. Patient diagnoses were 72.5% (29 of 40) accurate by PCPs in RESHAPE compared with 34.5% (10 of 29) by PCPs in the control group. There were no serious adverse events.
This pilot cluster randomized clinical trial found that procedures were feasible and acceptable for PCPs to be trained by PWLE. These pilot results will help inform a full trial to evaluate benefits of collaboration with PWLE during training of PCPs to reduce stigma and improve diagnostic accuracy.
ClinicalTrials.gov Identifier: NCT02793271.
Journal Article
Game-based training improves the surgeon’s situational awareness in the operation room: a randomized controlled trial
by
Graafland, Maurits
,
Schijven, Marlies P.
,
Bemelman, Willem A.
in
Abdominal Surgery
,
Adult
,
Animals
2017
Background
Equipment-related malfunctions directly relate to one-fourth of the adverse events in the surgical theater. A serious game trains residents to recognize and respond to equipment problems in minimally invasive surgery (MIS). These include disturbed vision, gas transport, electrocautery, and pathophysiological disturbances. This randomized controlled trial explores whether game-based training improves surgical residents’ response to equipment-related problems during surgery.
Methods
Thirty-one surgical residents with no previous experience in MIS took part in a standardized basic laparoscopy training course. Fifteen residents were randomly assigned to the game-enhanced curriculum (intervention) and sixteen were assigned to the regular curriculum (control). Participants performed a MIS task in a live anesthetized pig model, during which three standardized equipment malfunction scenarios occurred. Observers recorded the problems recognized and solved, time, and participants’ technical performance.
Results
Twenty-four participants completed the post-test (
n
= 12 per group). The intervention group solved more problems than the control group (59 vs. 33%,
p
= 0.029). The intervention group also recognized a larger proportion of problems, although this parameter was non-significant (67 vs. 42%,
p
= 0.14). Random effects modeling showed a significant improved game performance per participant over time.
Conclusions
Surgical residents, who play for only 1 h on a custom-made serious game, respond significantly better to equipment-related problems during surgery than residents trained by a standard training curriculum. These results imply that entertaining serious games can indeed be considered for use in official training for surgeons and other medical specialists.
Journal Article
Developing scales for clinical emotional intelligence and clinical competency and initial testing in a randomized controlled trial with hybrid simulation
2025
This study aimed to develop two scales to measure nursing students' clinical emotional intelligence (Clin-EI) and clinical competency (Clin-COM) and evaluate the effects of hybrid simulation on their clinical EI and competency.
Hybrid clinical simulation training prepares learners for a complex and demanding clinical environment, facilitates practice readiness and develops a sense of emotional stability. Low emotional intelligence (EI) can compromise patient safety and quality of care.
This study applied experimental research design and a randomized controlled trial was conducted.
Two hundred and twelve nursing students were randomly selected, dividing them into group A (exposed to traditional clinical training) and group B (exposed to hybrid simulation along with traditional clinical training).
Exploratory Factor Analysis results revealed a three-factor model for the Clin-EI tool and a one-factor model for Clin-COM. Internal consistency indicators by factor level of Clin-EI (⍺ = 0.86–0.95) and Clin-COM (⍺ = 0.98) indicate good to excellent. The acquired clinical EI, clinical competency and OSCE performance of group B were higher compared with group A with mean differences of −0.889, −0.887 and −7.08 respectively, p-values were all < .001. The factors effect sizes appeared negatively Clin-EI (-0.830), Clin-COM (-0.757) and OSCE (-0.606). All variables have strong significant correlations (p-values <0.001) within both groups.
The combination of traditional clinical teaching and hybrid simulation has positively influenced the acquired EI, clinical competency and OSCE performance of nursing students. Developing a high level of clinical EI and competency ensures safe nursing practice.
●Hybrid simulation is a powerful clinical training strategy to improve EI and competency, ensuring practice readiness.●A combination of traditional clinical teaching and hybrid simulation positively influenced EI and clinical competency.●A high level of EI through hybrid simulation training facilitates clinical competency, ensuring safe nursing practice.
Journal Article