6009 - Week 4.docx - Week 4 Impact Evaluation Identifying...

This preview shows page 1 - 4 out of 27 pages.

Week 4: Impact Evaluation: Identifying and Interpreting Program Effects 4.2 Key Issues and Concepts in Impact Evaluation Part 1 What Is Impact Evaluation?
o Did the program work? o How well did it work?
What If…?
Types of Impact Evaluation Questions Did the program produce the expected effects among the target population participants? Were there any unanticipated consequences—negative side effects? What are the differential effects of the program—how do effects vary, and what factors are associated with the variability? Is that variability associated with intensity of exposure to the program—is there a dose- response effect? Implementation Fidelity Questions
Week 4: Impact Evaluation: Identifying and Interpreting Program Effects How close is actual implementation to what was planned? Is there variability in implementation, especially across sites and recipients? What is the relationship between degree of implementation fidelity and level of program impact? 4.3 Key Issues and Concepts in Impact Evaluation Part 2 Impact evaluation and Causality Did our program cause certain effects? Evaluating Effects of Interventions Outcome variable (indicator) Intervention's effects on outcome variable Counterfactual (comparison/control) o Shows us intervention's actual impact Understanding Effects of Interventions Identify effects Determine if effect(s) attributable to intervention Find causal relationship between intervention and observed effect o Evaluation = measuring project outcomes (not outputs or implementation indicators) Calculate cost-effectiveness of intervention vs. other alternatives Example: Schools with Flip Charts
Week 4: Impact Evaluation: Identifying and Interpreting Program Effects

  • Left Quote Icon

    Student Picture

  • Left Quote Icon

    Student Picture

  • Left Quote Icon

    Student Picture