Explore the vast range of titles available.

We established a large database of trials to serve as a resource for future methodological and ethical analyses. Here, we use meta-data to describe the broad landscape of pragmatic trials including research areas, identification as pragmatic, quality of trial registry data and enrolment. Trials were identified by a validated search filter and included if a primary report of a health-related randomized trial published January 2014-April 2019. Data were collated from MEDLINE, Web of Science, ClinicalTrials.gov, and full text. 4337 eligible trials were identified from 13,065 records, of which 1988 were registered in ClinicalTrials.gov. Research areas were diverse, with the most common being general and internal medicine; public, environmental and occupational health; and health care sciences and services. The term “pragmatic” was seldom used in titles or abstracts. Several domains in ClinicalTrials.gov had questionable data quality. We estimated that one-fifth of trials under-accrued by at least 15%. There is a need to improve reporting of pragmatic trials and quality of trial registry data. Under accrual remains a challenge in pragmatic RCTs despite calls for more streamlined recruitment approaches. The diversity of pragmatic trials should be reflected in future ethical analyses.

Purpose of Review Randomized controlled trials (RCTs) in heart failure (HF) are becoming increasingly complex and expensive to conduct and if positive deliver expensive therapy tested only in selected populations. Recent Findings Electronic health records and clinical cardiovascular quality registries are providing opportunities for pragmatic and registry-based prospective randomized clinical trials (RRCTs). Simplified regulatory, ethics, and consent procedures; recruitment integrated into real-world care; and simplified or automated baseline and outcome collection allow assessment of study power and feasibility, fast and efficient recruitment, delivery of generalizable findings at low cost, and potentially evidence-based and novel use of generic drugs with low costs to society. Summary There have been no RRCTs in HF to date. Major challenges include generating funding, international collaboration, and the monitoring of safety and adherence for chronic HF treatments. Here, we use the Spironolactone Initiation Registry Randomized Interventional Trial in Heart Failure with Preserved Ejection Fraction (SPIRRIT-HFpEF), to be conducted in the Swedish Heart Failure Registry, to exemplify the advantages and challenges of HF RRCTs.

The “cohort multiple randomized controlled trial,” a new design for pragmatic trials, embeds multiple trials within a cohort. The cohort multiple RCT is an attractive alternative to conventional RCTs in fields where recruitment is slow, multiple new (competing) interventions for the same condition have to be tested, new interventions are highly preferred by patients and doctors, and the risk of disappointment bias, cross-over, and contamination is considerable. To prevent these unwanted effects, the cohort multiple RCT provides information on randomization to the intervention group/arm only, and only after randomization (i.e., prerandomization). To some, especially in a clinical setting, this is not ethically acceptable. In this article, we argue that prerandomization in the cohort multiple randomized controlled trial (cmRCT) can be avoided by adopting a staged-informed consent procedure. In the first stage, at entry into the cohort, all potential participants are asked for their informed consent to participate in a cohort study and broad consent to be either randomly selected to be approached for experimental interventions or to serve as control without further notice during participation in the cohort. In a second stage, at the initiation of an RCT within the cohort, informed consent to receive the intervention is then only sought in those randomly selected for the intervention arm. At the third stage, after completion of each RCT, all cohort participants receive aggregate disclosure of trial results. This staged-informed consent procedure avoids prerandomization in cmRCT and aims to keep participants actively engaged in the research process.

Background The clinical research enterprise is not producing the evidence decision makers arguably need in a timely and cost effective manner; research currently involves the use of labor-intensive parallel systems that are separate from clinical care. The emergence of pragmatic clinical trials (PCTs) poses a possible solution: these large-scale trials are embedded within routine clinical care and often involve cluster randomization of hospitals, clinics, primary care providers, etc. Interventions can be implemented by health system personnel through usual communication channels and quality improvement infrastructure, and data collected as part of routine clinical care. However, experience with these trials is nascent and best practices regarding design operational, analytic, and reporting methodologies are undeveloped. Methods To strengthen the national capacity to implement cost-effective, large-scale PCTs, the Common Fund of the National Institutes of Health created the Health Care Systems Research Collaboratory (Collaboratory) to support the design, execution, and dissemination of a series of demonstration projects using a pragmatic research design. Results In this article, we will describe the Collaboratory, highlight some of the challenges encountered and solutions developed thus far, and discuss remaining barriers and opportunities for large-scale evidence generation using PCTs. Conclusion A planning phase is critical, and even with careful planning, new challenges arise during execution; comparisons between arms can be complicated by unanticipated changes. Early and ongoing engagement with both health care system leaders and front-line clinicians is critical for success. There is also marked uncertainty when applying existing ethical and regulatory frameworks to PCTS, and using existing electronic health records for data capture adds complexity.

Background The need for high-quality evidence that is applicable in real-world, routine settings continues to increase. Pragmatic trials are designed to evaluate the effectiveness of interventions in real-world settings, whereas explanatory trials aim to test whether an intervention works under optimal situations. There is a continuum between explanatory and pragmatic trials. Most trials have aspects of both, making it challenging to label and categorize a trial and to evaluate its potential for translation into practice. Methods We summarize our experience applying the Pragmatic-Explanatory Continuum Indicator Summary (PRECIS) combined with external validity items based on the Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) framework to three studies to provide a more robust and comprehensive assessment of trial characteristics related to translation of research. We summarize lessons learned using domains from the combined frameworks for use in study planning, evaluating specific studies, and reviewing the literature and make recommendations for future use. Results A variety of coders can be trained to use the PRECIS and RE-AIM domains. These domains can also be used for diverse purposes, content areas, and study types, but are not without challenges. Both PRECIS and RE-AIM domains required modification in two of the three studies to evaluate and rate domains specific to study type. Lessons learned involved: dedicating enough time for training activities related to the domains; use of reviewers with a range of familiarity with specific study protocols; how to best adapt ratings that reflect complex study designs; and differences of opinion regarding the value of creating a composite score for these criteria. Conclusions Combining both frameworks can specifically help identify where and how a study is and is not pragmatic. Using both PRECIS and RE-AIM allows for standard reporting of key study characteristics related to pragmatism and translation. Such measures should be used more consistently to help plan more pragmatic studies, evaluate progress, increase transparency of reporting, and integrate literature to facilitate translation of research into practice and policy.

Background New considerations during the ethical review processes may emerge from innovative, yet unfamiliar operational methods enabled in pragmatic randomized controlled trials (RCT), potentially making institutional review board (IRB) evaluation more complex. In this manuscript, key components of the pragmatic “Aspirin Dosing: A Patient-Centric Trial Assessing Benefits and Long-term Effectiveness (ADAPTABLE)” randomized trial that required a reappraisal of the IRB submission, review, and approval processes are discussed. Main text ADAPTABLE is a pragmatic, multicenter, open-label RCT evaluating the comparative effectiveness of two doses of aspirin widely used for secondary prevention (81 mg and 325 mg) in 15,000 patients with an established history of atherosclerotic cardiovascular disease. The electronic informed consent form is completed online by the participants at the time of enrollment, and endpoint ascertainment is conducted through queries of electronic health records. IRB challenges encountered regarding centralized IRB evaluation, electronic informed consent, patient engagement, and risk determination in ADAPTABLE are described in this manuscript. The experience of ADAPTABLE encapsulates how pragmatic protocol components intended to facilitate the study conduct have been tempered by unexpected, yet justified concerns raised by local IRBs. How the lessons learned can be applied to future similar pragmatic trials is delineated. Conclusion Development of engaging communication channels between IRB and study personnel in pragmatic randomized trials as early as at the time of protocol design allows to reduce issues with IRB approval. Integrations of the lessons learned in ADAPTABLE regarding the IRB process for centralized IRBs, informed consent, patient engagement, and risk determination can be emulated and will be instrumental in future pragmatic studies.

The pragmatic explanatory continuum indicator summary (PRECIS) tool, initially published in 2009 and revised in 2015, was created to assist trialists to align their design choices with the intended purpose of their randomised controlled trial (RCT): either to guide real-world decisions between alternative interventions (pragmatic) or to test hypotheses about intervention mechanisms by minimising sources of variation (explanatory). There have been many comments, suggestions, and criticisms of PRECIS-2. This summary will be used to facilitate the development of to the next revision, which is PRECIS-3. We used Web of Science to identify all publication types citing PRECIS-2, published between May 2015 and July 2023. Citations were eligible if they contained ‘substantive’ suggestions, comments, or criticism of the PRECIS-2 tool. We defined ‘substantive’ as comments explicitly referencing at least one PRECIS-2 domain or a concept directly linked to an existing or newly proposed domain. Two reviewers independently extracted comments, suggestions, and criticisms, noting their implications for the update. These were discussed among authors to achieve consensus on the interpretation of each comment and its implications for PRECIS-3. The search yielded 885 publications, and after full-text review, 89 articles met the inclusion criteria. Comments pertained to new domains, changes in existing domains, or were relevant across several or all domains. Proposed new domains included assessment of the comparator arm and a domain to describe blinding. There were concerns about scoring eligibility and recruitment domains for cluster trials. Suggested areas for improvement across domains included the need for more scoring guidance for explanatory design choices. Published comments recognise PRECIS-2's success in aiding trialists with pragmatic or explanatory design choices. Enhancing its implementation and widespread use will involve adding new domains, refining domain definitions, and addressing overall tool issues. This citation review offers valuable user feedback, pivotal for shaping the upcoming version of the PRECIS tool, PRECIS-3. •The paper summarises user feedback from trialists relating to the pragmatic explanatory continuum indicator summary (PRECIS)-2 design tool and points toward considerations, which may be needed to develop and refine the next version of the tool.•Developers should consider adding assessments of blinding and comparator arm design decisions.•Further detail should be given to guide explanatory approaches to design decisions to address the current imbalance, which favors a more pragmatic approach.•Further consideration and research is needed to supplement these review findings to provide guidance for the use of the PRECIS tool for retrospective assessment of design choices.

This paper addresses challenges of identifying, enrolling, and retaining participants in a trial conducted within a routine care setting. All patients who are potential candidates for the treatments in routine clinical practice should be considered eligible for a pragmatic trial. To ensure generalizability, the recruited sample should have a similar distribution of the treatment effect modifiers as the target population. In practice, this can be best achieved by including—within the selected sites—all patients without further selection. If relevant heterogeneity between subgroups is expected, increasing the relative proportion of the subgroup of patients in the heterogeneous trial could be considered (oversampling) or a separate trial in this subgroup can be planned. Selection will nevertheless occur. Low enrollment and loss to follow-up can introduce selection and can jeopardize validity as well as generalizability. Pragmatic trials are conducted in clinical practice rather than in a dedicated research setting, which could reduce recruitment rates. However, if a trial poses a minimal burden to the physician and the patient and routine clinical practice is maximally adhered to, the participation rate may be high and loss to follow-up will not be a specific problem for pragmatic trials.

Background Traditional randomised controlled trials remain the gold standard for improving clinical care but they do have their limitations, including their associated high costs, high failure rate and limited external validity. An alternative methodology is the newly defined, prospective, registry-based randomised controlled trial (RRCT), where treatment and outcome data is collected in an existing registry. This scoping review explores the current literature regarding RRCTs to help identify the key design elements of RRCTs and the characteristics of clinical registries on which they are reliant on. Methods A scoping review methodology conducted in accordance with the Joanna Briggs Institute guidelines was performed. Four databases were searched for articles published from inception to June 2018: Medline; Embase; the Cumulative Index to Nursing and Allied Health Literature and; Scopus. The search strategy included MeSH and text words related to RRCT. Results We identified 2369 articles of which 75 were selected for full-text screening. Of these, only 17 articles satisfied our inclusion criteria. All studies were published between 1996 and 2017 and all were investigator-initiated. Study designs were mainly multi-site comparative/effectiveness studies incorporating the use of disease registries ( n  = 8), procedure registries ( n  = 8) and a health services registry ( n  = 1). The low cost, reduced administrative burden and enhanced external validity of RRCTs make them an attractive research methodology which can be used to address questions of public health importance. We identified that that there are variable definitions of what constituted a RRCT and that issues related to ethical conduct and data integrity, completeness, timeliness, validation and endpoint adjudication need to be carefully addressed. Conclusion RRCTs potentially have an important role to play in informing best clinical practice and health policy. There are a number of issues that need to be addressed to optimise the utility of this approach, including establishing universally accepted criteria for the definition of a RRCT.

Background Lack of data integrity is a common problem in randomized clinical trials and is more serious in economic evaluations conducted alongside explanatory clinical trials. Despite pragmatic randomized controlled trials (pRCTs) becoming recognized as the best design for economic evaluations, information on the proportion, handling approaches, and reporting quality of missing data in pRCTs-based economic evaluations remains limited. This study aimed to investigate the quantity and reporting quality of missing data in economic evaluations conducted alongside pragmatic clinical trials. Methods In this cross-sectional survey, data were extracted from PubMed and OVID (Embase, CENTRAL, HTA database, and NHS EED) from January 1, 2010, to April 24, 2022. Economic evaluations conducted alongside pRCTs were included. Two independent reviewer groups identified relevant articles, and data were extracted by three groups comprising two reviewers each. Descriptive analyses were performed to assess the characteristics of the included studies, missingness in the included studies, and handling of missing data. Results Overall, 715 studies were identified, of which 152 met the inclusion criteria. In total, 113, 119, and 132 articles reported missing data, costs, and effects, respectively. More than 50% (58/113) of the articles reported the proportion or quantity of overall missingness, and 64.71% and 54.55% reported missing costs and effects, respectively. The proportion of missingness of < 5% in the overall group was 3.45%, whereas the proportions of missing costs and effects were both < 10% (5.26% vs. 8.45%, respectively). In terms of the proportion of missing data, the overall missingness rate was 30.22% in 58 studies, whereas the median proportion of missing data was slightly higher than that of missing effects (30.92% vs. 27.78%). Of the included studies, 56 (36.84%) conducted a sensitivity analysis on handling missing data. Of these, 12.50% reported missing mechanisms, and 83.93% examined handling methods. Conclusions Insufficient description and reporting of missing data, along with a high proportion of missing data in pRCT-based economic evaluations, could decrease the reliability and extrapolation of conclusions, leading to misleading decision-making.