Purpose
Impact evaluation entails determining how projects, programs, or regulations have changed things.
Both intentional and unintentional interventions are included in this.
This course aims to equip learners with the knowledge and skills necessary to conduct impact evaluations of the programs, policies, or initiatives that interest them.
A participant should be able to conduct a thorough impact assessment of certain interventions by the end of the course.
Course objectives
By the end of the course, Participants will be able to:
- Identify the theories and methods used in impact evaluation.
- Understanding evaluation issues (biases n placement, attribution and selection)
- Describe the IE’s designs.
- Conduct a project impact analysis.
- Study impact evaluation methods and tools.
- Utilize Propensity Matching and Difference-in-Difference to analyze effect data.
- Report and discuss impact assessment results.
Duration: 5 days
TARGET AUDIENCE
This course is intended for project employees, researchers, managers, professionals in development, government policy makers, NGOs, and development agencies who want to pinpoint the effects of certain interventions.
Course Content
TOPIC 1: Impact Assessment Overview
Impact assessment’s definition
Attribution of impact evaluation
Contribution as opposed to attribution
TOPIC 2: Impact Assessment
Forms of assessment
Concepts of change
Evaluation hypothesis
Impact assessment indicators
TOPIC 3: Counterfactuals for Impact Evaluation
Causal connection
Comparison groups and alternative scenarios
Impact assessment using fictitious data
Impact assessment without baseline information or comparisons
Â
TOPIC 4: Designs for impact evaluation research
Experiment design
Controlled, randomized trials
Designing quasi-experiments
The difference in the difference
Discontinuity regression
Pairing
Non-experimental approach
TOPIC 5: Sampling for Impact Evaluation
Approaches for impact evaluation sampling
Sample size and sampling weight calculations
Statistical validity
Creating comparison groupings
TOPIC 6: Randomized Impact Assessment
Counterfactual Randomization development
Impacts of Program Placement and Participation
Measures of Participation Spillover Effects and Program Placement Integration
TOPIC 7: Method of Propensity Score Matching (PSM)
Introduction to PSM
PSM in Impact Assessment
Creation of propensity scores
Comparative Analysis (Nearest-Neighbour, Stratification, Radius, Kernel )
Significantly Robust Estimation
TOPIC 8: Difference in Difference Method
Overview of DID in Impact Evaluation
Estimator for DID (Single DID, DID with covariates, Quantile DID)
Cross-Sectional Data Balancing Tests Using DID
Propensity Score Matching Diff-in-Diff
Â
TOPIC 9: Qualitative Methods in Impact Assessment
Outcome Harvesting Significant Change Outcome Mapping
Gratitude-Based Inquiry
ÂTOPIC 10: Impact Assessment results the creation and dissemination
Impact Assessment Plan
Impact Evaluation Reports: Baseline Report, Case Studies, and Impact Evaluation Reports