Publications

Center for Global Development. "When Will We Ever Learn? Recommendations to Improve Social Development Assistance through Enhanced Impact Evaluation," (pdf) A consultation draft. September 15, 2005.

The following is a selection of articles and websites that address different aspects of the Evaluation Gap. If you have any articles or resources to share please e-mail us.

Evaluation Methodologies

Altman, D.G., Shulz, K.F., Moher, D., Egger, M., Davidoff, F., Elbourne, D., Gotzsche, P.C., Lang, T., 2001. The Revised CONSORT Statement for Reporting Randomized Trials: Explanation and Elaboration. Annals of Internal Medicine 134, 663-694.

"DAC Criteria for Evaluating Development Assistance" 

OECD/Development Assistance Committee. "Principles for Evaluation of Development Assistance". Organisation for Economic Co-operation and Development. 1991. Paris, OECD. 2004.

OECD/Development Assistance Committee. "Principles for Evaluation of Development, 1998 Review". 1998.

OECD/Development Assistance Committee. "Review of the DAC Principles for Evaluation of Development Assistance". Organisation for Economic Co-operation and Development. 1-120. 1998.

Development Assistance Committee. "Glossary of Key Terms in Evaluation and Results Based Management". 6, 1-37. 2002. Paris, OECD. Evaluation and Aid Effectiveness.

Habicht, J.-P., Victora, C.G., Vaughan, J.P., 1999. "Evaluation designs for adequacy, plausibility and probability of public health programme performance and impact". International Journal of Epidemiology 28, 10-18.

Rossi, P.H., Freeman, H.E., Lipsey, M.W., 1999. Evaluation: A Systematic Approach. Sage Publications, Thousand Oaks, London and New Delhi.

World Bank Independent Evaluation Group (IEG) and the Poverty Analysis Monitoring and Impact Evaluation Thematic Group (PREM Network). 2006. Conducting Quality Impact Evaluations Under Budget, Time and Data Constraints. Washington, DC: World Bank.

WB.OED – Monitoring & Evaluation – methods and tools, 2002

Experiences of Implementing Impact Evaluations and Linking to Policy

Grossman, J.B., 1994. "Evaluating Social Policies: Principles and U.S. Experience". The World Bank Research Observer 9, 159-181.

Gueron, J.M., 1997. "Learning About Welfare Reform: Lessons from State-Based Evaluations". New Directions for Evaluation 76.

Gueron, J.M. 2002. "The Politics of Random Assignment: Implementing Studies and Affecting Policy," in F. Mosteller and R. Boruch, eds. Evidence Matters: Randomized Trials in Education Research. Brookings Institution Press, Washington, DC.

Mosteller, F. and Boruch, R. eds. 2002. Evidence Matters: Randomized Trials in Education Research. Brookings Institution Press, Washington, DC.

Selected Literature Reviews on Social Policy Questions

Ekman, B., 2004. "Community-based health insurance in low-income countries: a systematic review of the evidence". Health Policy and Planning 19, 249-270.

Friedlander D, Greenberg DH, Robins PK. Evaluating Government Training Programs for the Economically Disadvantaged. Journal of Economic Literature 1997;35(4):1809-55.

Gosden, T., Forland, F., Kristiansen I.S., Sutton, M., Leese, B., Giuffrida, A., Sergison, M., Pedersen, L., 2004. "Capitation, salary, fee-for-service and mixed systems of payment: effects on the behaviour of primary care physicians". The Cochrane Library.

International Labour Office. 2002. "Extending Social Protection in Health Through Community Based Health Organizations: Evidence and Challenges". Geneva, ILO. Discussion Paper Universitas Programme.

Kremer, M., 2003. "Randomized Evaluations of Educational Programs in Developing Countries: Some Lessons". American Economic Review Papers and Proceedings 93, 102-115.

Selected Impact Evaluations

Banerjee, A.V., Cole, S., Duflo, E., Linden, L. Remedying Education: Evidence from Two Randomized Experiments in India. 9-15-2003. Cambridge, MA, MIT. Mimeo.

Bryce, J., Victora, C.G., Habicht, J.-P., Vaughan, J.P., Black, R.E., 2004. The Multi-Country Evaluation of the Integrated Management of Childhood Illness Strategy: Lessons for the Evaluation of Public Health Interventions. American Journal of Public Health 94, 406-415.

Chattopadhyay, R., Duflo, E. Women as Policy Makers: Evidence form a India-Wide Randomized Policy Experiment. No. 8615. 2001. Cambridge, MA, NBER. Working Paper.

Conley, T., Udry, C. "Learning About a New Technology: Pineapple in Ghana". 817. 2000. New Haven, CT, Yale University. Economic Growth Center Discussion Paper.

Cullen, J.B., B., Jacob and S. Levitt (forthcoming). "The Impact of School Choice on Student Outcomes: An Analysis of the Chicago Public Schools". Journal of Public Economics.

Gertler, P. 2000. "Final Report: The Impact of Progresa on Health". Washington, DC, International Food Policy Research Institute.

Glewwe, P., Kremer, M., Moulin, S. 2001 "Textbooks and Test Scores: Evidence from a Randomized Evaluation in Kenya". Washington, DC, Development Research Group. The World Bank.

Glewwe, P., Ilias, N., Kremer, M. 2003. "Teacher incentives". National Bureau of Economic Research, Cambridge, Mass.

Jamison, D.T., 1978. "Radio for formal education and for development communication". Dev Commun Rep 1-2.

Lynam, D.R., Milich, R., Zimmerman, R., Novak, S.P., Logan, T.K., Martin, C., Leukefeld, C., Clayton, R., 1999. "Project DARE: no effects at 10-year follow-up". J Consult Clin Psychol 67, 590-593.

MkNelly, B. And C. Dunford. 1998. "Impact of Credit with Education on Mothers and Their Young Children's Nutrition: Lower Pra Rural Bank Credit with Education Programs in Ghana". Freedom From Hunger Research Paper No. 4, Freedom from Hunger, Davis, CA. (www.ffhtechnical.org).

Miguel, E., Kremer, M. 2001. "Worms, education and health externalities in Kenya". National Bureau of Economic Research, Cambridge, MA.

Rosenbaum, D.P., Hanson, G.S., 1998. "Assessing the Effects of School-Based Drug Education: A Six-Year Mutli-level analysis of Project D.A.R.E." Journal of Research in Crime and Delinquency 35, 381-412.

Schultz, T.P. 2000. "Final Report: The Impact of Progresa on School Enrollments". Washington, DC, International Food Policy Research Institute.

Sommer, A., Tarwotjo, I., Djunaedi, E., West, K.P., Loeden, A.A., Tilden, R., Mele, L., 1986. "Impact of vitamin A supplementation on childhood mortality. A randomised controlled community trial". Lancet 1, 1169-1173.

Comparisons of Randomized and Non-Randomized studies

Agodini, Roberto and Mark Dynarski. 2004. "Are Experiments the Only Option? A Look at Dropout Prevention Programs." The Review of Economics and Statistics, February.

Friedlander D, Robins PK. Evaluating Program Evaluations: New Evidence on Commonly Used Nonexperimental Methods. American Economic Review 1995;85(4):923-37.

Glazerman, S., Levy, D.M., 2003. "Nonexperimental Versus Experimental Estimates of Earnings Impacts". The Annals of the American Academy of Political and Social Science 589, 63-93.

Glazerman, Steven, Dan M. Levy and David Myers, 2002, "Nonexperimental Replications of Social Experiments: A Systematic Review". Interim Report/Discussion Paper, Mathematica. MPR Reference No.: 8813-300, September.

Glewwe, Paul; Kremer, Michael; Moulin, Sylvie; Zitzewitz, Eric. 2004. Retrospective vs. Prospective Analyses of School Inputs: The Case of Flip Charts in Kenya. Journal of Development Eocnomics, 74:1, June, pp. 251-268.

Lalonde, R.J., 1986. "Evaluating the Econometric Evaluations of Training Programs with Experimental Data". American Economic Review 76, 604-620.

Liebman, J.B., L.F. Katz, and J. Kling, 2004. "Beyond Treatment Effects: Estimating the Relationship Between Neighborhood Poverty and Individual Outcomes in the MTO Experiment", KSG Working Paper No. RWP04-036, Harvard University, Cambridge, MA. August.

Mathematica Policy Research. An Assessment of Alternative Comparison Group Methodologies for Evaluating Employment and Training Programs. Princeton, NJ: Mathematica Policy Research; 1986.

Wilde ET, Hollister RG, 2002. "How close is close enough? testing nonexperimental estimates of impact against experimental estimates of impact with education test outcomes." No. 1242-02 Madison, WI: Institute for Research on Poverty, University of Wisconsin, Madison.