UNIT 3 EVALUATION DESIGN-BASIC ISSUES
INTRODUCTION Evaluation design is concerned with the detailed planning of the evaluation. Evaluation design builds on the evaluation context to specifically identify practices, processes, timing and responsibilities for completing an evaluation. There is no single evaluation design that applies across all evaluations and hence there are factors to be considered when choosing an appropriate design. The design will depend on the evaluation context, time constraints, existing information and the resources available.
The Design of an evaluation: 1. Describes the evaluand 2. Formulates the objectives and tasks 3. Stipulates the manner in which the evaluation is to be conducted 4. Names the people and interest groups who are to participate 5. Determines the audiences for the presentation of the results 6. Determines audiences for the expected evaluation results .
Evaluation design and social research design? There is a key difference between designing an evaluation and conducting one’s own research: Evaluation is much more of a social process, as evaluators have to be aware of stakeholder interests and other social factors when conducting their research. Evaluation design thus goes beyond the scope of research design.
Evaluation vs. Research Design 5 Formulating the Research Problem Defining Test of Theory Defining basic population and sampling Planning and Preparing Data Collection Data Collection Process Data Analysis Reporting / Publication Scientific Discussion Predetermined Evaluation Problem Defining Assessment Criteria Planning Stakeholder Involvement Planning and Preparing Data Collection Data Collection Process Data Analysis Reporting / Internal Exchange Utilization of Results Assessment Criteria Stakeholder Involvement Utilization
Comparison Evaluation Designs are different to Research Designs because • They are not limited to a single research question • They are performing more reactive than active • They are more or less involved in a political process • They have to handle assessments in an objective way • They include the management of social processes (stakeholder involvement, exchange with commissioners) • They include the management of utilization 6