Journal Article

Household Surveys in Crisis

Meyer, Bruce D., Sullivan, James X., Mok, Wallace K. C.

2015

Overview

Household surveys, one of the main innovations in social science research of the last century, are threatened by declining accuracy due to reduced cooperation of respondents. While many indicators of survey quality have steadily declined in recent decades, the literature has largely emphasized rising nonresponse rates rather than other potentially more important dimensions to the problem. We divide the problem into rising rates of nonresponse, imputation, and measurement error, documenting the rise in each of these threats to survey quality over the past three decades. A fundamental problem in assessing biases due to these problems in surveys is the lack of a benchmark or measure of truth, leading us to focus on the accuracy of the reporting of government transfers. We provide evidence from aggregate measures of transfer reporting as well as linked microdata. We discuss the relative importance of misreporting of program receipt and conditional amounts of benefits received, as well as some of the conjectured reasons for declining cooperation and for survey errors. We end by discussing ways to reduce the impact of the problem including the increased use of administrative data and the possibilities for combining administrative and survey data.

• Publisher: American Economic Association
• Subject: 1984-2013 / Accuracy / Annual reports / Benchmarks / Bias / Censuses / Consumer surveys / Cooperation / Economic surveys / Economic theory / Errors / Estimation bias / Health surveys / Households / Innovation / Innovations / Measurement / Measurement errors / Measures / Nutrition / Opinion polls / Polls & surveys / Poverty / Public assistance programs / Rates / Respondents / Responses / Social research / Social sciences / Social Security Disability Insurance / Social surveys / Studies / Supplemental Nutrition Assistance Program / Supplemental security income / Survey data / Truth / Welfare