Evaluations
Many of the assignments that we undertake are evaluation studies. We have been evaluating government projects and programmes for nearly 20 years.
Our approach is tailored to the needs of each client with an appropriate balance between formative and summative methods. Our philosophy is rooted in the Treasury Green Book principles and the more recent Magenta Book covering evaluation.
A helpful approach at the outset of an evaluation is to understand the logic model relating to the project or programme. This entails being clear about the inputs, processes, outputs, outcomes and ultimately impacts which are desired. Once this is clear it is possible to identify mechanisms for assessing whether this is indeed taking place and whether the project or programme is performing effectively.
We draw on a range of principles and academic theories such as Pawson and Tilley's Realistic Evaluation approach and Quinn Patton's Utilization-Focused Evaluation.
Analysis techniques draw on a range of social research skills but also include economic concepts such as checking for externalities, substitution, displacement, additionality and deadweight in order to assess performance.
We have undertaken evaluations with many different characteristics such as:
- Stakeholder perceptions studies
- Participatory evaluations
- Desk based studies
- Policy evaluations
- cost effectiveness evaluations
We have also developed guidance on best practice for designing and implementing evaluation studies for government sector clients.
A major challenge experienced by some commissioners is to ensure they achieve embedded learning as a result of evaluation studies. We have helped achieve this through a combination of carefully planned formative approaches, workshops to take stakeholders though detailed analysis and specific training on the use of analytical techniques.