Journal Article

Existing guidance on reporting of consensus methodology: a systematic review to inform ACCORD guideline development

Fedorowicz, Zbys, van Zuuren, Esther J, Hughes, Ellen L, Gattrell, William T, Logullo, Patricia, Price, Amy

2022

Overview

ObjectiveTo identify evidence on the reporting quality of consensus methodology and to select potential checklist items for the ACcurate COnsensus Reporting Document (ACCORD) project to develop a consensus reporting guideline.DesignSystematic review.Data sourcesEmbase, MEDLINE, Web of Science, PubMed, Cochrane Library, Emcare, Academic Search Premier and PsycINFO from inception until 7 January 2022.Eligibility criteriaStudies, reviews and published guidance addressing the reporting quality of consensus methodology for improvement of health outcomes in biomedicine or clinical practice. Reports of studies using or describing consensus methods but not commenting on their reporting quality were excluded. No language restrictions were applied.Data extraction and synthesisScreening and data extraction of eligible studies were carried out independently by two authors. Reporting quality items addressed by the studies were synthesised narratively.ResultsEighteen studies were included: five systematic reviews, four narrative reviews, three research papers, three conference abstracts, two research guidance papers and one protocol. The majority of studies indicated that the quality of reporting of consensus methodology could be improved. Commonly addressed items were: consensus panel composition; definition of consensus and the threshold for achieving consensus. Items least addressed were: public patient involvement (PPI); the role of the steering committee, chair, cochair; conflict of interest of panellists and funding. Data extracted from included studies revealed additional items that were not captured in the data extraction form such as justification of deviation from the protocol or incentives to encourage panellist response.ConclusionThe results of this systematic review confirmed the need for a reporting checklist for consensus methodology and provided a range of potential checklist items to report. The next step in the ACCORD project builds on this systematic review and focuses on reaching consensus on these items to develop the reporting guideline.Protocol registration https://osf.io/2rzm9.

• Publisher: British Medical Journal Publishing Group,BMJ Publishing Group LTD,BMJ Publishing Group
• Subject: Biomedical research / Checklist / Clinical medicine / Consensus / Delphi method / Guidelines / Health policy / Humans / Medical research / Methods / Protocols & guidelines / Research methodology / Research Methods / Research Report / STATISTICS & RESEARCH METHODS / Systematic review