Breakthrough to Policy Use: Reinvigorating Impact Evaluation for Global Development
Final Report of CGD's Working Group on New Evidence Tools for Policy Impact
About the Working Group
Better use of evidence in policymaking could improve lives and save hundreds of millions of dollars in public and aid spending. It’s now quicker and more affordable than ever to rigorously gather evidence. Yet only a fraction of all development programs are evaluated, and far too often, policymakers lack the solid, policy-relevant research they could use to make better decisions. Why the gap between evidence and action? The working group report charts the barriers that prevent research from informing policy and lay outs what researchers and funders can do to transform the evidence landscape.


Infographic on impact evaluation by the numbers

In 2006, when a CGD working group published its report When Will We Ever Learn?: Improving Lives Through Impact Evaluation, very few social programs benefitted from studies that could determine whether they actually make a difference. Since then, there has been tremendous progress in harnessing better evidence to inform public policy decision making, especially from impact evaluations of programs in low- and middle-income countries. Impact evaluation is a rigorous approach that establishes the attributable net impact of a project or program, making it uniquely well suited to inform decision making about resource allocation, program design, and scale up or drawdown.

But the COVID-19 pandemic put a spotlight on an unfinished agenda, underscoring the need for high-quality, timely, and context-specific evidence. The pandemic has demonstrated the cost in lives and livelihoods when policymakers make decisions based on incomplete or outdated evidence and data. Given the potential real-world benefits, why have decision makers within governments, aid agencies, multilateral organizations, and NGOs not yet fully harnessed the value of evidence—including from impact evaluations—for better public policies? Looking ahead, how can the development community renew momentum and broaden bases of support for impact evaluation and the wider evidence agenda?

In response to these questions and building on progress to date, CGD launched the Working Group on New Evidence Tools for Policy Impact from 2020 to 2022, bringing together 40 policymakers and experts from 20 countries with collective experience at over 100 organizations to review progress, identify challenges, and propose recommendations to enhance the policy value and use of data and evidence for global development, with a focus on impact evaluation. While the group highlighted that impact evaluation is far from the only evidence tool available to policymakers to understand what is working and why, it is also clear that impact evaluation is underutilized given its potential to improve and save lives through learning and improved decisions about policies and programs.

The working group’s final report highlights how far the field has come in addressing persistent critiques about the scale, generalizability, and policy utility of impact evaluation methods. By spotlighting dozens of resources and examples of good practice and policy impact, the report helps ensure we benefit from—and avoid rehashing—well-developed contributions. Across the recommendations, a core theme is the importance of shifting research agenda-setting power and resources to those who best specific policy contexts and decision making needs.

To illustrate the application of the working group’s agenda to specific development funders, the working group developed detailed recommendations for three key audiences with strong existing foundations for evaluation and evidence use to complement and leverage country government funding: philanthropiesUSAID, and the World Bank.

Complementary Materials

 

Blogs

  • Reinvigorating Impact Evaluations
    Decision makers within governments, aid agencies, multilateral organizations, and NGOs have not yet fully harnessed the value of e...
  • Scaling Programs Effectively: Two New Books
    You’ve designed a program to help more children learn to read, or to reduce the number of women who die in childbirth, or to incre...
  • Aligning the Researcher’s Toolkit with the Policymaker’s Priorities
    As the COVID-19 pandemic continues to rage and public funding is increasingly scarce, the need for high-quality, timely evidence o...
  • How More and Better Funding Can Unlock the Potential of Evidence-to-Policy Partnerships
    Today, we are excited to launch a background paper by our colleague Abeba Taddese that explores how these partnerships work, barri...

Publications

  • Leveraging Knowledge Generation for Policy Impact: Recommendations for the World Bank
    This brief lays out how the World Bank can more systematically embed impact evaluation and related data and evidence functions int...
  • Investing in a New Era of Evidence-Informed Decision Making: Recommendations for Philanthropies
    This brief details how philanthropies can invest in a new era of evidence-informed policy decisions to improve and save lives. It ...
  • Mainstreaming Evidence Use through Locally Led Development: Recommendations for USAID
    This brief details how USAID can mainstream evidence use across the agency. It is based on working group discussions, numerous con...
  • Final Report: Breakthrough to Policy Use: Reinvigorating Impact Evaluation for Global Development
    By charting a renewed agenda for more useful, responsive, and relevant impact evaluation that elevates the perspectives of govern...
  • Towards Improved and More Transparent Ethics in Randomised Controlled Trials in Development Social Science
    This paper surveys common ethical concerns and proposes a series of practical suggestions to help researchers and policymakers be ...

Events

  • Harnessing the Power of a New Toolkit for Rapid, Rigorous Evaluations and Better Public Policy
    As the COVID-19 pandemic continues to rage and public funding is increasingly scarce, the need for high-quality, timely evidence o...
  • On Power, Partnerships, and Policymaking: How to Realize the Potential of Evidence-to-Policy Partnerships
    The COVID-19 crisis has emphasized the need for high-quality, timely, context-specific evidence—for both effective policy response...
  • Evidence to Impact in Crisis: How Have We Measured Up During the COVID-19 Pandemic?
    When the COVID-19 pandemic hit, policymakers across governments faced an urgent need to make difficult decisions in a quickly evol...
  • How Is Impact Evaluation Contributing to Evidence Use in Low- and Middle-Income Countries?
    In 2006, the Center for Global Development published a working group report titled “When Will We Ever Learn” that addressed the in...
  • Harnessing the Power of a New Toolkit for Rapid, Rigorous Evaluations and Better Public Policy
    As the COVID-19 pandemic continues to rage and public funding is increasingly scarce, the need for high-quality, timely evidence o...
  • On Power, Partnerships, and Policymaking: How to Realize the Potential of Evidence-to-Policy Partnerships
    The COVID-19 crisis has emphasized the need for high-quality, timely, context-specific evidence—for both effective policy response...
  • Evidence to Impact in Crisis: How Have We Measured Up During the COVID-19 Pandemic?
    When the COVID-19 pandemic hit, policymakers across governments faced an urgent need to make difficult decisions in a quickly evol...
  • How Is Impact Evaluation Contributing to Evidence Use in Low- and Middle-Income Countries?
    In 2006, the Center for Global Development published a working group report titled “When Will We Ever Learn” that addressed the in...

Contact

For more information, contact jkaufman@CGDEV.ORG

Contact

For more information, contact jkaufman@CGDEV.ORG

Experts

Amanda Glassman
Amanda Glassman was the Center for Global Development's executive vice president, a senior fellow, and also served as chief executive officer of CGD Europe. Her research focused on...
Janeen Madan Keller
Janeen Madan Keller is Deputy Director of the Global Health Policy Program and a Policy Fellow at the Center for Global Development, where she leads policy-oriented research focuse...
Julia Kaufman
Julia Kaufman was a policy analyst for Global Health Policy at the Center for Global Development. Before joining CGD, she worked on global health research projects related to front...
Ruth Levine
Ruth E. Levine, Ph.D., is Vice President and Chief Learning Officer at The David and Lucile Packard Foundation. She is a development economist with more than three decades of exper...

Experts

  • Amanda Glassman
    Amanda Glassman was the Center for Global Development's executive vice president, a senior fellow, and also served as chief executive officer of CGD Europe. Her research focused on...
  • Janeen Madan Keller
    Janeen Madan Keller is Deputy Director of the Global Health Policy Program and a Policy Fellow at the Center for Global Development, where she leads policy-oriented research focuse...
  • Julia Kaufman
    Julia Kaufman was a policy analyst for Global Health Policy at the Center for Global Development. Before joining CGD, she worked on global health research projects related to front...
  • Ruth Levine
    Ruth E. Levine, Ph.D., is Vice President and Chief Learning Officer at The David and Lucile Packard Foundation. She is a development economist with more than three decades of exper...

Acknowledgments

Funding Acknowledgement

CGD is grateful to the William & Flora Hewlett Foundation and individual CGD funders for their support of this work.