Читать книгу Impact Evaluation of Energy Interventions - David A. Raitzer - Страница 4

Strategy 2030 of the Asian Development Bank (ADB) emphasizes the creation of knowledge during the implementation of projects and the use of evidence from past operations to design new interventions. The Strategy also envisions a more proactive role for research to backstop ADB’s function as a knowledge provider that helps replicate good project practices across Asia. For these ambitions to be fulfilled, evidence on the intended and unintended effects of interventions needs to be accumulated. Impact evaluation is an important means for generating this evidence.

To build a broader evidence base on “what works” in development, impact evaluation needs to be mainstreamed across a range of development investments. Presently, impact evaluation coverage has made more progress in the health and education sectors. While sectors dominated by “hard infrastructure”, such as energy, account for far more development investment, the number of impact evaluations on these sectors has remained much more limited. At the same time, energy investments have become much more complex, and have become more oriented toward environmental and social goals over time. Along with these innovations has come an increasing array of behavioral assumptions underpinning interventions, which impact evaluations can help to test.

Yet, energy sector interventions have special challenges for impact evaluation. Many energy investments, such as powerplants or transmission lines, are “small-n” interventions, which affect large geographies, so that there are insufficient numbers of treated and untreated units for enabling conventional statistical analyses. New powerplants and other infrastructure may also allow improved levels of energy provision, rather than presence versus absence of a service, as the typical context for many traditional impact evaluation techniques.

This review is intended to help navigate these challenges and offer insights to orient future impact evaluations on the energy sector. It attempts to characterize theories of change associated with many energy interventions, entry points for impact evaluation, impact evaluation challenges, and potential impact evaluation designs. It then reviews the impact evaluation literature to date, in terms of methods applied, interventions covered, and outcomes evaluated, and identifies gaps for future studies to address. In the process, it offers practical examples that might inspire future studies.

The literature survey finds a rapidly growing body of impact evaluation studies related to energy. Of the 85 studies identified, more than 60% were published after 2012. Impact evaluation designs have also become diversified, with expanding use of more robust methods, such as randomized experiments and regression discontinuity design, as well as greater use of “big data”. Evidence has been offered on a range of effects of electricity access including education, income, health, employment, business performance, and fertility.

Yet, many evidence gaps remain. Existing impact evaluation effort is mostly concentrated on rural electrification and improved cookstoves, even if most investments are in power generation and transmission. Other important areas of effort, such as energy efficiency, also have little impact evaluation to date. While many studies have evaluated effects of electricity access on education, far fewer have evaluated effects via intermediate services, such as health or agricultural extension facilities, and evidence on firms has remained limited.

With more big data increasingly available, it is hoped that the creative examples identified in this review can help to inspire new impact evaluation studies that address evidence gaps on energy. This work is more relevant than ever, as energy investments increasingly seek to experiment with innovations, high-level technologies, and behavioral change approaches to ensure sustainable, efficient, and inclusive use of energy. Continued efforts on impact evaluation will be critical to ensure that these experiments can be tested to generate evidence to improve energy operations over time. This review helps to show where future impact evaluation investments can best contribute new evidence and how such studies may be approached.

Yasuyuki Sawada

Chief Economist and Director General

Economic Research and Regional Cooperation Department

Asian Development Bank