Journal Article

Variation in sensitivity and specificity of diverse diagnostic tests across health-care settings: a meta-epidemiological study

Vijfschagt, Natasja D., van den Bruel, Ann, Leeflang, Mariska M.G., Berger, Marjolein Y., Holtman, Gea A., Fanshawe, Thomas R., de Boer, Michiel R., Burger, Huibert

2025

Overview

Diagnostic test accuracy (DTA) may vary among health-care settings, which among other reasons may be due to referral from primary to secondary care. The true magnitude and direction of any difference is not certain. We analyzed the results of meta-analyses of DTA to compare sensitivity and specificity between patients in nonreferred and referred care settings. We systematically searched EBSCOhost MEDLINE for systematic reviews that included at least ten original studies of the same diagnostic test, with at least three studies each performed in nonreferred and referred care. Random-effects models, with setting as a binary covariate, were used to calculate pooled sensitivity and specificity estimates per test. Sensitivity analyses were conducted limiting the analyses to studies from countries with gatekeeping systems only. In total, nine systematic reviews evaluating thirteen diagnostic tests were included. For signs and symptoms (seven tests), the differences in sensitivity and specificity ranged from +0.03 to +0.30 and from −0.12 to +0.03, respectively; for biomarkers (four tests) differences in sensitivity ranged from −0.11 to +0.21 and specificity from −0.01 to −0.19. Differences in sensitivity and specificity for one questionnaire test were +0.1 and −0.07 respectively and for one imaging test were −0.22 and −0.07. Sensitivity analyses limited to countries with gatekeeping health care systems produced similar results. Sensitivity and specificity vary in both direction and magnitude between nonreferred and referred settings, depending on the test and target condition, with no universal patterns governing performance differences. Doctors use diagnostic tests to help assess the likelihood if a patient has a certain condition. However, the accuracy of these tests may vary depending on where they are used—such as in primary care (where patients first seek help) or in specialist care (after being referred by a doctor). We wanted to find out how much test accuracy changes between these settings. To do this, we analyzed previous studies that reviewed the accuracy of different diagnostic tests. We compared how well these tests worked in patients who had not yet been referred to a specialist vs those who had. Our analysis included results from thirteen different diagnostic tests, covering symptoms, biomarkers (such as blood tests), a questionnaire, and an imaging test. We found that test accuracy varied depending on the type of test and the condition being diagnosed. Some tests had higher sensitivity (correctly identifying patients with the disease) or specificity (correctly identifying healthy individuals) in primary care, while in specialist care, the same test could perform better, worse, or similarly. There was no clear pattern that applied to all tests. This suggests that researchers should consider how test accuracy may differ across health-care settings when conducting and interpreting diagnostic test accuracy studies. •Sensitivity and specificity vary both in direction and magnitude between settings.•Differences do not follow a specific pattern; they vary across tests and conditions.•Differences in sensitivity were larger than those in specificity.•Consider the setting in diagnostic accuracy interpretation and research design.

• Publisher: Elsevier Inc,Elsevier Limited
• Subject: Accuracy / Bias / Biomarkers / Diagnostic tests / Diagnostic tests (eg, ultrasound / Diagnostic Tests, Routine - standards / Diagnostic Tests, Routine - statistics & numerical data / Differential thermal analysis / Epidemiologic Studies / Epidemiology / Health care / Humans / Influenza / Internal Medicine / Medical imaging / Patient health questionnaire / Patients / Physicians / Primary care / Primary health care / Questionnaires / Rapid diagnostic tests / Referral and Consultation - statistics & numerical data / Secondary care centers / Sensitivity analysis / Sensitivity and Specificity / Signs and symptoms / Systematic review / Ultrasonography