Journal Article

Empirical audit and review and an assessment of evidentiary value in research on the psychological consequences of scarcity

Schatz, Derek, Carrillo, Belinda, Baum, Stephen M., Dev, Amelia S., Ellwood-Lowe, Monica E., Okafor, Gold N., Stein, Daniel H., Antonoplis, Stephen, Choi, Andrew L., Brown, N. Derek, Connor, Paul, Foushee, Ruthe, Benedetti, Arianna H., Lundell-Creagh, Ryan, Jansen, Rachel, Rosenblum, Michael, Jarvis, Shoshana N., Ocampo, Joseph M., Wang, Yilu, Azad, Zahra Rahmani, Nelson, Leif D., Donnelly, Kristin, O’Donnell, Michael, Moore, Don A.

2021

Overview

Empirical audit and review is an approach to assessing the evidentiary value of a research area. It involves identifying a topic and selecting a cross-section of studies for replication. We apply the method to research on the psychological consequences of scarcity. Starting with the papers citing a seminal publication in the field, we conducted replications of 20 studies that evaluate the role of scarcity priming in pain sensitivity, resource allocation, materialism, and many other domains. There was considerable variability in the replicability, with some strong successes and other undeniable failures. Empirical audit and review does not attempt to assign an overall replication rate for a heterogeneous field, but rather facilitates researchers seeking to incorporate strength of evidence as they refine theories and plan new investigations in the research area. This method allows for an integration of qualitative and quantitative approaches to review and enables the growth of a cumulative science.

• Publisher: National Academy of Sciences
• Subject: BRIEF REPORTS / Empirical Research / Food Insecurity / Humans / Pain Measurement / Pain sensitivity / Priming / Psychological and Cognitive Sciences / Replication / Reproducibility of Results / Research Design / Resource Allocation / Scarcity / Social Sciences