Browse or search publications from faculty affiliated with the lab.
Impact Matters for Giving at Checkout
We conducted two experiments on PayPal’s Give at Checkout feature to learn about the effect of 1) information about charity outcomes on donations, and 2) exposure to these point-of-sale microgiving requests on subsequent giving. In this “…
Optimal Experimental Design for Staggered Rollouts
In this paper, we study the design and analysis of experiments conducted on a set of units over multiple time periods where the starting time of the treatment may vary by unit. The design problem involves selecting an initial treatment time for…
Evaluating Treatment Prioritization Rules via Rank-Weighted Average Treatment Effects
There are a number of available methods for selecting whom to prioritize for treatment, including ones based on treatment effect estimation, risk scoring, and handcrafted rules. We propose rank-weighted average treatment effect (RATE) metrics as…
Low-Intensity Fires Mitigate the Risk of High-Intensity Wildfires in California’s Forests
The increasing frequency of severe wildfires demands a shift in landscape management to mitigate their consequences. The role of managed, low-intensity fire as a driver of beneficial fuel treatment in fire-adapted ecosystems has drawn interest in…
Proportional Response: Contextual Bandits for Simple and Cumulative Regret Minimization
In many applications, e.g. in healthcare and e-commerce, the goal of a contextual bandit may be to learn an optimal treatment assignment policy at the end of the experiment. That is, to minimize simple regret. However, this objective remains…
Proportional Response: Contextual Bandits for Simple and Cumulative Regret Minimization
In many applications, e.g. in healthcare and e-commerce, the goal of a contextual bandit may be to learn an optimal treatment assignment policy at the end of the experiment. That is, to minimize simple regret. However, this objective remains…
Can Personalized Digital Counseling Improve Consumer Search for Modern Contraceptive Methods?
This paper analyzes a randomized controlled trial of a personalized digital counseling intervention addressing informational constraints and choice architecture, cross-randomized with discounts for long-acting reversible contraceptives (LARCs),…
Machine Learning Who to Nudge: Causal vs Predictive Targeting in a Field Experiment on Student Financial Aid Renewal
In many settings, interventions may be more effective for some individuals than others, so that targeting interventions may be beneficial. We analyze the value of targeting in the context of a large-scale field experiment with over 53,000 college…
Federated Causal Inference in Heterogeneous Observational Data
We are interested in estimating the effect of a treatment applied to individuals at multiple sites, where data is stored locally for each site. Due to privacy constraints, individual-level data cannot be shared across sites; the sites may also…
Machine-Learning-Based High-Benefit Approach versus Conventional High-Risk Approach in Blood Pressure Management
In medicine, clinicians treat individuals under an implicit assumption that high-risk patients would benefit most from the treatment (‘high-risk approach’). However, treating individuals with the highest estimated benefit using a novel machine-…
Targeting, Personalization, and Engagement in an Agricultural Advisory Service
ICT is increasingly used to deliver customized information in developing countries. We examine whether individually targeting the timing of automated voice calls meaningfully increases engagement in an agricultural advisory service. We define,…
Decomposing Changes in the Gender Wage Gap over Worker Careers
A large literature in labor economics seeks to decompose observed gender wage gaps (GWGs) into different sources, including portions explained by cross-gender differences in education, occupation, and experience. This paper provides new methods…
Semiparametric Estimation of Treatment Effects in Randomized Experiments
We develop new semiparametric methods for estimating treatment effects. We focus on a setting where the outcome distributions may be thick tailed, where treatment effects are small, where sample sizes are large and where assignment is completely…
The Heterogeneous Earnings Impact of Job Loss Across Workers, Establishments, and Markets
Using generalized random forests and rich Swedish administrative data, we show that the earnings effects of job displacement due to establishment closures are extremely heterogeneous across workers, establishments, and markets. The decile of…
Torch-Choice: A PyTorch Package for Large-Scale Choice Modelling with Python
The torch-choice is an open-source library for flexible, fast choice modeling with Python and PyTorch. torch-choice provides a ChoiceDataset data structure to manage databases flexibly and memory-efficiently. The paper demonstrates constructing a…
Estimating Heterogeneous Treatment Effects with Right-Censored Data via Causal Survival Forests
Forest-based methods have recently gained in popularity for non-parametric treatment effect estimation. Building on this line of work, we introduce causal survival forests, which can be used to estimate heterogeneous treatment effects in survival…
Flexible and Efficient Contextual Bandits with Heterogeneous Treatment Effect Oracles
Contextual bandit algorithms often estimate reward models to inform decision-making. However, true rewards can contain action-independent redundancies that are not relevant for decision-making. We show it is more data-efficient to estimate any…
Battling the Coronavirus Infodemic Among Social Media Users in Africa
During a global pandemic, how can we best prompt social media users to demonstrate discernment in sharing information online? We ran a contextual adaptive experiment on Facebook Messenger with users in Kenya and Nigeria and tested 40 combinations…
Digital Public Health Interventions at Scale: The Impact of Social Media Advertising on Beliefs and Outcomes Related to COVID Vaccines
Public health organizations increasingly use social media advertising campaigns in pursuit of public health goals. In this paper, we evaluate the impact of about $40 million of social media advertisements that were run and experimentally tested…
Bias-Variance Tradeoffs for Designing Simultaneous Temporal Experiments
We study the analysis and design of simultaneous temporal experiments, where a set of interventions are applied concurrently in continuous time, and outcomes are measured on a sequence of events observed in time. As a motivating setting, suppose…
Flexible and Efficient Contextual Bandits with Heterogeneous Treatment Effect Oracles
Contextual bandit algorithms often estimate reward models to inform decision-making. However, true rewards can contain action-independent redundancies that are not relevant for decision-making. We show it is more data-efficient to estimate any…
Expanding Capacity for Vaccines against COVID-19 and Future Pandemics: A Review of Economic Issues
We review economic arguments for using public policy to accelerate vaccine supply during a pandemic. Rapidly vaccinating a large share of the global population helps avoid economic, mortality, and social losses, which in the case of Covid-19…
Personalized Recommendations in EdTech: Evidence from a Randomized Controlled Trial
We study the impact of personalized content recommendations on the usage of an educational app for children. In a randomized controlled trial, we show that the introduction of personalized recommendations increases the consumption of content in…
Effective and Scalable Programs to Facilitate Labor Market Transitions for Women in Technology
We describe the design, implementation, and evaluation of a low-cost and scalable program that supports women in Poland in transitioning into jobs in the information technology sector. This program, called “Challenges,” helps…