Site Selection Bias in Program Evaluation *

2015 ◽  
Vol 130 (3) ◽  
pp. 1117-1165 ◽  
Author(s):  
Hunt Allcott

Abstract “Site selection bias” can occur when the probability that a program is adopted or evaluated is correlated with its impacts. I test for site selection bias in the context of the Opower energy conservation programs, using 111 randomized control trials involving 8.6 million households across the United States. Predictions based on rich microdata from the first 10 replications substantially overstate efficacy in the next 101 sites. Several mechanisms caused this positive selection. For example, utilities in more environmentalist areas are more likely to adopt the program, and their customers are more responsive to the treatment. Also, because utilities initially target treatment at higher-usage consumer subpopulations, efficacy drops as the program is later expanded. The results illustrate how program evaluations can still give systematically biased out-of-sample predictions, even after many replications.

2017 ◽  
Vol 77 (1) ◽  
pp. 171-207 ◽  
Author(s):  
Howard Bodenhorn ◽  
Timothy W. Guinnane ◽  
Thomas A. Mroz

Understanding long-term changes in human well-being is central to understanding the consequences of economic development. An extensive anthropometric literature purports to show that heights in the United States declined between the 1830s and the 1890s, which is when the U.S. economy modernized. Most anthropometric research contends that declining heights reflect the negative health consequences of industrialization and urbanization. This interpretation, however, relies on sources subject to selection bias. Our meta-analysis shows that the declining height during industrialization emerges primarily in selected samples. We also develop a parsimonious diagnostic test that reveals, but does not correct for, selection bias in height samples. When applied to four representative height samples, the diagnostic provides compelling evidence of selection.


2007 ◽  
Vol 6 (1) ◽  
pp. 75-102 ◽  
Author(s):  
Catherine Yeh

AbstractOne of the seminal cultural transformations in twentieth-century China was the rise of the female impersonator, the dan actor, to national stardom, with Mei Lanfang (1894–1961) as the most famous example (see Figure I). In the short span of 20 years, this figure, once strongly associated with being the 'male flower' and the 'call-boy' of elite men, became the representative and high point of Chinese cultural achievements. The three visits Mei Lanfang made to Japan in 1919, the United States in 1930 and the Soviet Union in 1935 helped establish the image of cultural China through the art of the female impersonator.


Author(s):  
Mohamed Abuella ◽  
Badrul Chowdhury

In this study an adjusting post-processing approach is implemented for improving intra-hourly forecasts of solar power and ramp events of PV solar power systems at different locations in the United States. This study also serves as an out-of-sample test to evaluate the performance of the adjusting approach with different locations and timescales. Thus, various individual intra-hourly forecasts of solar power are combined and adjusted by applying the adjusting approach. Both point and probabilistic forecasts of solar power are included. After that, solar power ramp event forecasting by the adjusting approach is carried out.


2008 ◽  
Vol 26 (1) ◽  
pp. 3-39 ◽  
Author(s):  
Sharon Williams Utz

The prevalence of diabetes in the United States is higher among those living in rural/nonmetropolitan statistical areas than in urban centers. Managing this complex chronic illness is complicated by factors such as limited access to care, low socioeconomic status, aging, and membership in a racial or ethnic minority group. A review of the literature was conducted focusing on research about rural Americans with diabetes by searching databases of CINAHL, PubMed, and MEDLINE, and selecting articles in English that were published between 2000 and 2007. Search terms included: nursing, research, rural, rural nursing, rural health services/programs, and diabetes care. Additional search strategies included journal hand searching and networking. Twenty-six research reports were found and included qualitative and quantitative methods and program evaluations. All regions of the United States were represented except the Northwest. The vast majority of research reports were of descriptive studies (n = 16), with program evaluation reports (n = 7) and studies testing an intervention (n = 3) also represented. The quality of each study is examined and summarized.


2014 ◽  
Vol 168 (11) ◽  
pp. 1073 ◽  
Author(s):  
Kathleen L. Dooling ◽  
Daniel J. Shapiro ◽  
Chris Van Beneden ◽  
Adam L. Hersh ◽  
Lauri A. Hicks

Sign in / Sign up

Export Citation Format

Share Document