Ensuring that you are meeting the needs of the

This preview shows page 12 - 14 out of 16 pages.

ensuring that you are meeting the needs of the stakeholders, but that you are maintaining the objectivity needed for this evaluation to be considered legitimate. And one of the biggest responsibilities you have is as you get closer and closer to an actual design plan for the
evaluation, that you are continually considering how to strengthen the design, and therefore, the validity of the findings and the conclusions that you are going to draw from your evaluation findings. And ultimately, you want to make your evaluation useful. So you want to help your clients, whoever they might be, use the evaluation and the results. So all of the steps preceding should help in making the evaluation as useful as possible and as attractive to the stakeholders and the clients in their communications with their funders and their policymakers and so on. 6.6 Choosing an Evaluation Study Design Part 2 So in this course on program evaluation, we're very much concerned with real world situations. And we've been talking about the four major categories of real world constraints. Budget, time, data availability, and political influences. Politics, as it were. We all know that evaluations are very, very political activities. And so I just wanted to tell you a story about a recent evaluation that I participated in, or that I led. And the real world constraints that kept flying at us, and how we tried to deal with them. So this project, this evaluation was called ARISE-- Africa Routine Immunization Systems Essentials. It's a Gates Foundation funded project. And what they were interested in was understanding why immunization rates had improved in some places in Africa and not in others. So the question was really, what is driving improvements in immunization performance? Now immunization performance tends to be measured by the indicator of the third dose of diphtheria, pertussis, and tetanus. Which in some countries is DPT, and in some countries is DTP. But the third dose is considered to be, they're almost done. And in most immunization schedules, the only thing they have left is measles. So once they get the measles immunization, they're considered fully immunized. Data on measles immunization is difficult, because a lot of measles vaccinations are given in campaign-type. You know, they'll have a vaccination day. And everybody gets that. So you have a very little sense of whether they actually got all the ones before that. So we tend to use DPT 3 as our indicator of immunization performance. So clearly the question was, OK DPT 3 coverage is increasing in some parts of Africa and not increasing necessarily in others. So what's going on? What can we learn from these places that have improved immunization performance, DPT 3 coverage? So we were asked to do this by looking at multiple countries in Africa, sub-Saharan Africa, specifically. So alright. Great. So first of all, we had our question. We had stakeholders clear about how they want to answer this question. But then we got to, well how are you going to answer that? We

  • Left Quote Icon

    Student Picture

  • Left Quote Icon

    Student Picture

  • Left Quote Icon

    Student Picture