Published November 28, 2023 | Version v1
Journal article Open

What leads to measurement errors? Evidence from reports of program participation in three surveys

  • 1. Universidad Católica de Chile
  • 2. University of Chicago
  • 3. CERGE-EI

Description

Measurement errors are often a large source of bias in survey data. Lack of knowledge of the determinants of such errors makes it difficult to reduce the extent of errors when collecting data and to assess the validity of analyses using the data. We study the determinants of reporting error using high quality administrative data on government transfers linked to three major U.S. surveys. Our results support several theories of misreporting: Errors are related to event recall, forward and backward telescoping, salience of receipt, the stigma of reporting participation in welfare programs and respondent's degree of cooperation with the survey overall. We provide evidence on how survey design choices affect reporting errors. Our findings help survey users to gauge the reliability of their data and to devise estimation strategies that can correct for systematic errors, such as instrumental variable approaches. Understanding survey errors allows researchers collecting survey data to reduce them by improving survey design. Our results indicate that survey design should take into account that higher response rates as well as collecting more detailed information may have negative effects on survey accuracy.

Files

What-leads-to-measurement-errors-Evidence-from-reports-of-program-participation-in-three-surveys.pdf

Additional details

Identifiers

DOI
10.1016/j.jeconom.2023.105581
Other
oai:uchicago.tind.io:10042

Funding

Alfred P. Sloan Foundation
Russell Sage Foundation
Charles Koch Foundation
Menard Family Foundation
American Enterprise Institute
Czech Science Foundation
16-07603Y
Czech Science Foundation
20-27317S
Czech Academy of Sciences
RVO 67985998
ANID PIA/PUENTE
AFB220003

UChicago Information

Division(s)
Harris School of Public Policy Studies
Department(s)
Harris School of Public Policy Studies Research Publications