1 - Introduction

Summary

• • Why demystify evaluation; why should it be more accessible?

• • Who can the book help; who is the book aimed at?

• • What is evaluation, how it is different from research and where are its roots?

• • Why evaluate? Generating evidence for accountability, development and knowledge

• • When to evaluate? Using ex ante, ex post, formative and summative evaluations

• • The three ‘Cs’ of evaluation and using them to get the most from the book

Why ‘demystifying’ evaluation?

Evaluation is not quite the exact ‘science’ that some may suggest. At its heart, an effective evaluation is about the quality of choices made in balancing realistic expectations and needs of it, with judgements about focus, scope and methods. These choices are not made any easier by an abundance of evaluation theories and methods, a surfeit of jargon, and practitioner guidance that too often seems aimed at the expert rather than the newcomer. All this can be mystifying for those new to the field, whether tasked with specifying an evaluation, designing and delivery it, interpreting the evidence or using the findings to guide decision makers.

Can we improve on this situation? My experience as both an evaluator and a user suggests that understanding evaluation, and making sound choices about methods and approach, is within the scope of any social scientist (social science being the main focus of this book) who has at least a grasp of systematic research methods. That understanding comes from:

• • a practical appreciation of what the evidence to be generated is to be used for (and how);

• • the different practical options that might fit the evaluation circumstances and are best suited to generate that evidence;

• • the respective advantages and disadvantages of those options;

• • the pitfalls to watch out for in choosing and applying methods and how to avoid them.

The starting point for developing this understanding is cutting through the theories and reducing what may seem to be conflicting, even contradictory, approaches to ideas, language and options that can be readily understood – demystifying evaluation.

Why is it important to ensure that many more people have a better understanding of evaluation? Perhaps it is enough that a small cadre of ‘experts’ in evaluation put the time and effort into building this understanding, and applying it to the benefit of others.