Published June 26, 2024 | Version v1
Journal article Open

Megastudy shows that reminders boost vaccination but adding free rides does not

Description

Encouraging routine COVID-19 vaccinations is likely to be a crucial policy challenge for decades to come. To avert hundreds of thousands of unnecessary hospitalizations and deaths, adoption will need to be higher than it was in the autumn of 2022 or 2023, when less than one-fifth of Americans received booster vaccines. One approach to encouraging vaccination is to eliminate the friction of transportation hurdles. Previous research has shown that friction can hinder follow-through and that individuals who live farther from COVID-19 vaccination sites are less likely to get vaccinated. However, the value of providing free round-trip transportation to vaccination sites is unknown. Here we show that offering people free round-trip Lyft rides to pharmacies has no benefit over and above sending them behaviourally informed text messages reminding them to get vaccinated. We determined this by running a megastudy with millions of CVS Pharmacy patients in the United States testing the effects of (1) free round-trip Lyft rides to CVS Pharmacies for vaccination appointments and (2) seven different sets of behaviourally informed vaccine reminder messages. Our results suggest that offering previously vaccinated individuals free rides to vaccination sites is not a good investment in the United States, contrary to the high expectations of both expert and lay forecasters. Instead, people in the United States should be sent behaviourally informed COVID-19 vaccination reminders, which increased the 30-day COVID-19 booster uptake by 21% (1.05 percentage points) and spilled over to increase 30-day influenza vaccinations by 8% (0.34 percentage points) in our megastudy. More rigorous testing of interventions to promote vaccination is needed to ensure that evidence-based solutions are deployed widely and that ineffective but intuitively appealing tools are discontinued.

Data availability

The experimental data analysed in this article were provided by CVS Pharmacy. The data were de-identified pursuant to 45 CFR 164.514(b)(2). Our study's analysis plan was pre-registered on the Open Science Framework (OSF; pre-registration 1: bit.ly/3n3KUh2; pre-registration 2: bit.ly/3ZRPzBk). Pre-registration 2 updates part of pre-registration 1 to address unexpected problems stemming from the failure to send messages, as planned, in interventions 7 and 8 on 3 November. This second pre-registration was posted before any outcome data were received or analysed. Fully anonymized and de-identified data on each study participant's intervention condition, launch date and bivalent COVID-19 booster vaccination decision during our follow-up period are available on the OSF as are aggregated summary statistics (https://bit.ly/3MhRHgm). However, to protect patient privacy, we cannot publicly post individual-level data on patients' covariates. Source data are provided with this paper.

All codes used to analyse study data can also be found at the OSF (https://bit.ly/3MhRHgm).

Files

Megastudy-shows-that-reminders-boost-vaccination-but-adding-free-rides-does-not.pdf

Files (33.9 MB)

Name Size Download all
Article
md5:4894c79afb4e7fbf8a7f3a458d51e613
8.6 MB Preview Download
Supplementary information files
md5:5c0847e59d966bd2fd5c7a9a1c595fe6
25.3 MB Preview Download

Additional details

Identifiers

DOI
10.1038/s41586-024-07591-x
Other
oai:uchicago.tind.io:12717

Funding

Rockefeller Foundation
Robert Wood Johnson Foundation
Unknown funder
Craig Newmark Philanthropies
Alfred P. Sloan Foundation
University of Pennsylvania
Wharton Behavioral Laboratory
Unknown funder
AKO Foundation

UChicago Information

Division(s)
Harris School of Public Policy Studies
Department(s)
Harris School of Public Policy Studies Research Publications