Explore the vast range of titles available.

Electronic learning (e-learning) in postgraduate medical education has seen a rapid evolution; however, we tend to evaluate it only on its primary outcome or learning aim, whereas its effectiveness also depends on its instructional design. We believe it is important to have an overview of all the methods currently used to evaluate e-learning design so that the preferred method may be identified and the next steps needed to continue to evaluate postgraduate medical e-learning may be outlined. This study aimed to identify and compare the outcomes and methods used to evaluate postgraduate medical e-learning. We performed a systematic literature review using the Web of Science, PubMed, Education Resources Information Center, and Cumulative Index of Nursing and Allied Health Literature databases. Studies that used postgraduates as participants and evaluated any form of e-learning were included. Studies without any evaluation outcome (eg, just a description of e-learning) were excluded. The initial search identified 5973 articles, of which we used 418 for our analysis. The types of studies were trials, prospective cohorts, case reports, and reviews. The primary outcomes of the included studies were knowledge, skills, and attitude. A total of 12 instruments were used to evaluate a specific primary outcome, such as laparoscopic skills or stress related to training. The secondary outcomes mainly evaluated satisfaction, motivation, efficiency, and usefulness. We found 13 e-learning design methods across 19 studies (4% 19/418). The methods evaluated usability, motivational characteristics, and the use of learning styles or were based on instructional design theories, such as Gagne's instructional design, the Heidelberg inventory, Kern's curriculum development steps, and a scale based on the cognitive load theory. Finally, 2 instruments attempted to evaluate several aspects of a design, based on the experience of creating e-learning. Evaluating the effect of e-learning design is complicated. Given the diversity of e-learning methods, there are many ways to carry out such an evaluation, and probably, many ways to do so correctly. However, the current literature shows us that we have yet to reach any form of consensus about which indicators to evaluate. There is a great need for an evaluation tool that is properly constructed, validated, and tested. This could be a more homogeneous way to compare the effects of e-learning and for the authors of e-learning to continue to improve their product.

Background Student-run clinics (SRCs) are outpatient clinics run and organized by undergraduate medical students. While these clinics offer participating students multiple learning opportunities, little is known about how participation in an SRC contributes to learning and how this learning is influenced. Methods In this qualitative clarification study, we conducted semi-structured interviews with a purposive sample of 20 students and student-coordinators participating in our learner-centred SRC (LC-SRC), to gain in-depth insight into their experiences and learning. These interviews were analysed using Glaser’s approach to grounded theory. Results Analysis revealed that responsibility, authenticity, and collaboration described how SRC participation contribute to learning. Responsibility encompassed the responsibility students had for their patients and the responsibility that the student coordinators had for the students. Authenticity reflected the context and tasks in the LC-SRC. Collaboration covered collaboration with other students, with student coordinators, and with clinical supervisors. These three themes are interrelated, and together enhanced motivation and promoted patient-centred learning in both the LC-SRC and the regular curriculum. Conclusions Learning in an LC-SRC is highly dependent on students’ feelings of responsibility for real authentic tasks and is stimulated by extensive collaboration with fellow students and supervising doctors.

Background Thesis defended on the 19th of December 2012 at the faculty of Medicine of the VU University Amsterdam. Promotors: Professor Fedde Scheele MD, PhD, (VUmc Amsterdam) and Professor Albert Scherpbier MD, PhD (University of Maastricht). Copromotors: Pim Teunissen, MD, PhD (University of Maastricht) and Carl Siegert MD, PhD (St. Lucas Andreas Hospital, Amsterdam).

Introduction Transitions are traditionally viewed as challenging for clinicians. Throughout medical career pathways, clinicians need to successfully navigate successive transitions as they become progressively more independent practitioners. In these guidelines, we aim to synthesize the evidence from the literature to provide guidance for supporting clinicians in their development of independence, and highlight areas for further research. Methods Drawing upon D3 method guidance, four key themes universal to medical career transitions and progressive independence were identified by all authors through discussion and consensus from our own experience and expertise: workplace learning, independence and responsibility, mentoring and coaching, and patient perspectives. A scoping review of the literature was conducted using Medline database searches in addition to the authors’ personal archives and reference snowballing searches. Results 387 articles were identified and screened. 210 were excluded as not relevant to medical transitions (50 at title screen; 160 at abstract screen). 177 full-text articles were assessed for eligibility; a further 107 were rejected (97 did not include career transitions in their study design; 10 were review articles; the primary references of these were screened for inclusion). 70 articles were included of which 60 provided extractable data for the final qualitative synthesis. Across the four key themes, seven do’s, two don’ts and seven don’t knows were identified, and the strength of evidence was graded for each of these recommendations. Conclusion The two strongest messages arising from current literature are first, transitions should not be viewed as one moment in time: career trajectories are a continuum with valuable opportunities for personal and professional development throughout. Second, learning needs to be embedded in practice and learners provided with authentic and meaningful learning opportunities. In this paper, we propose evidence-based guidelines aimed at facilitating such transitions through the fostering of progressive independence.

Background Postgraduate medical e-learning (PGMeL) is being progressively used and evaluated. Its impact continues to grow, yet there are barriers to its implementation. Although more attention is now being paid to quality evaluation models, little has been written about the successful implementation of PGMeL. This study aims to determine factors and define themes influencing the successful implementation of PGMeL. Methods We performed 10 semi-structured interviews with experienced e-learning creators, after which we carried out a thematic analysis to name and describe factors and themes. Results Although this was not the objective of the study, the participants stressed the importance of a definition of success. Associated with this definition were: reaching your target audience, achieving learning aims, satisfying your audience and maintaining continuity. Three themes were identified containing eleven factors that influence successful implementation. The themes were named and defined after the group that had the most influence on the factors. We named them creator-, organization- and learner-dependent factors. The creator dependent factors are: the learning aim, pedagogical strategies, content expertise, evaluation and the creators motivational path. The organization dependent factors are management support, recourse and culture. Finally, the learner dependent factors are technology, motivators/barriers and value. Conclusions This study shows that implementing PGMeL has creator-, organization- and learner-dependent factors which should be taken into account during the creating of the PGMeL. Although creator- and learner-dependent factors are mentioned in other studies, the present study also stresses the importance of organization-dependent factors. Innovation implementation theories such as Rogers’ diffusion of innovation or Kotter’s eight steps of change management show a great overlap with these factors. Future studies can both evaluate the use of these innovation models in creating PGMeL and assess the effect of the organizational factors in greater depth.

E-Learning has taken a firm place in postgraduate medical education. Whereas 10 years ago it was promising, it now has a definite niche and is clearly here to stay. However, evaluating the effect of postgraduate medical e-learning (PGMeL) and improving upon it can be complicated. While the learning aims of e-learning are evaluated, there are no instruments to evaluate the instructional design of PGMeL. Such an evaluation instrument may be developed by following the Association for Medical Education in Europe (AMEE) 7-step process. The first 5 steps of this process were previously performed by literature reviews, focus group discussion, and an international Delphi study. This study will continue with steps 6 and 7 and answer the research question: Is a content-validated PGMeL evaluation survey useful, understandable, and of added value for creators of e-learning? There are five phases in this study: creating a survey from 37 items (phase A); testing readability and question interpretation (phase B); adjusting, rewriting, and translating surveys (phase C); gathering completed surveys from three PGMeL modules (phase D); and holding focus group discussions with the e-learning authors (phase E). Phase E was carried out by presenting the results of the evaluations from phase D, followed by a group discussion. There are four groups of participants in this study. Groups A and B are experienced end users of PGMeL and participated in phase B. Group C are users who undertook e-learning and were asked to complete the survey in phase D. Group D are the authors of the e-learning modules described above. From a list of 36 items, we developed a postgraduate Medical E-Learning Evaluation Survey (MEES). Seven residents participated in the phase B group discussion: 4 items were interpreted differently, 3 were not readable, and 2 items were double. The items from phase B were rewritten and, after adjustment, understood correctly. The MEES was translated into Dutch and again pilot-tested. All items were clear and were understood correctly. The MEES version used for the evaluation contained 3 positive domains (motivation, learning enhancers, and real-world translation) and 2 negative domains (barriers and learning discouragers), with 36 items in those domains, 5 Likert scale questions of 1 to 10, and 5 open questions asking participants to give their own comments in each domain. Three e-learning modules were evaluated from July to November 2018. There were a total of 158 responses from a Dutch module, a European OB/GYN (obstetrics and gynecology) module, and a surgical module offered worldwide. Finally, 3 focus group discussions took place with a total of 10 participants. Usefulness was much appreciated, understandability was good, and added value was high. Four items needed additional explanation by the authors, and a Creators' Manual was written at their request. The MEES is the first survey to evaluate the instructional design of PGMeL and was constructed following all 7 steps of the AMEE. This study completes the design of the survey and shows its usefulness and added value to the authors. It finishes with a final, publicly available survey that includes a Creators' Manual. We briefly discuss the number of responses needed and conclude that more is better; in the end, however, one has to work with what is available. The next steps would be to see whether improvement can be measured by using the MEES and continue to work on the end understandability in different languages and cultural groups.

Digital education tools (e-learning, technology-enhanced learning) can be defined as any educational intervention that is electronically mediated. Decveloping and applying such tools and interventions for postgraduate medical professionals who work and learn after graduation can be called postgraduate medical digital education (PGMDE), which is increasingly being used and evaluated. However, evaluation has focused mainly on reaching the learning goals and little on the design. Design models for digital education (instructional design models) help educators create a digital education curriculum, but none have been aimed at PGMDE. Studies show the need for efficient, motivating, useful, and satisfactory digital education. Our objective was (1) to create an empirical instructional design model for PGMDE founded in evidence and theory, with postgraduate medical professionals who work and learn after graduation as the target audience, and (2) to compare our model with existing models used to evaluate and create PGMDE. Previously we performed an integrative literature review, focus group discussions, and a Delphi procedure to determine which building blocks for such a model would be relevant according to experts and users. This resulted in 37 relevant items. We then used those 37 items and arranged them into chronological steps. After we created the initial 9-step plan, we compared these steps with other models reported in the literature. The final 9 steps were (1) describe who, why, what, (2) select educational strategies, (3) translate to the real world, (4) choose the technology, (5) complete the team, (6) plan the budget, (7) plan the timing and timeline, (8) implement the project, and (9) evaluate continuously. On comparing this 9-step model with other models, we found that no other was as complete, nor were any of the other models aimed at PGMDE. Our 9-step model is the first, to our knowledge, to be based on evidence and theory building blocks aimed at PGMDE. We have described a complete set of evidence-based steps, expanding a 3-domain model (motivate, learn, and apply) to an instructional design model that can help every educator in creating efficient, motivating, useful, and satisfactory PGMDE. Although certain steps are more robust and have a deeper theoretical background in current research (such as education), others (such as budget) have been barely touched upon and should be investigated more thoroughly in order that proper guidelines may also be provided for them.

Background E-learning is driving major shifts in medical education. Prioritizing learning theories and quality models improves the success of e-learning programs. Although many e-learning quality standards are available, few are focused on postgraduate medical education. Methods We conducted an integrative review of the current postgraduate medical e-learning literature to identify quality specifications. The literature was thematically organized into a working model. Results Unique quality specifications ( n  = 72) were consolidated and re-organized into a six-domain model that we called the Postgraduate Medical E-learning Model (Postgraduate ME Model) . This model was partially based on the ISO-19796 standard, and drew on cognitive load multimedia principles. The domains of the model are preparation, software design and system specifications, communication, content, assessment, and maintenance. Conclusion This review clarified the current state of postgraduate medical e-learning standards and specifications. It also synthesized these specifications into a single working model. To validate our findings, the next-steps include testing the Postgraduate ME Model in controlled e-learning settings.

The progressive use of e-learning in postgraduate medical education calls for useful quality indicators. Many evaluation tools exist. However, these are diversely used and their empirical foundation is often lacking. We aimed to identify an empirically founded set of quality indicators to set the bar for “good enough” e-learning. We performed a Delphi procedure with a group of 13 international education experts and 10 experienced users of e-learning. The questionnaire started with 57 items. These items were the result of a previous literature review and focus group study performed with experts and users. Consensus was met when a rate of agreement of more than two-thirds was achieved. In the first round, the participants accepted 37 items of the 57 as important, reached no consensus on 20, and added 15 new items. In the second round, we added the comments from the first round to the items on which there was no consensus and added the 15 new items. After this round, a total of 72 items were addressed and, of these, 37 items were accepted and 34 were rejected due to lack of consensus. This study produced a list of 37 items that can form the basis of an evaluation tool to evaluate postgraduate medical e-learning. This is, to our knowledge, the first time that quality indicators for postgraduate medical e-learning have been defined and validated. The next step is to create and validate an e-learning evaluation tool from these items.