Against the backdrop of scarce resources, proof of effectiveness and efficiency is becoming increasingly important. Facing these challenges, AUVA (Austrian Workers’ Compensation Board) has commissioned the scientific association ECE to develop an integrated modular system for evaluations in the field of prevention called “EvaluationKIT” (short form: eKIT). The aim was to create a common basis for the evaluation of the efficacy of prevention measures (i.e. whether they work), which could also clarify and examine the underlying causal models (i.e. why they work). eKIT has now become the common standard for the evaluation of AUVA prevention activities, which contributes to making successes and challenges transparent and the results of interventions comparable.
In the first part of my presentation, I will give an overview of the main elements of eKIT including behavioural and situational prevention, the underlying types of logic (input, output, outcome and impact), different evaluation approaches, the four-level model developed by Kirkpatrick and Kirkpatrick (2006) and the importance of the accuracy in the implementation of measures.
eKIT presents its individual modules along the process of prevention projects, starting with the project launch, the planning and development, the training of multipliers and the implementation of measures up to the completion of the project.
In this context, in the second part of my presentation I will illustrate selected modules of the eKIT using two examples: 1) the completed AUVA campaign to prevent hand injuries and 2) the current AUVA campaign on carcinogens.
Finally, I will summarise the findings from the evaluation of our prevention campaigns with eKIT and the challenges that we will have to address in the future in order to achieve our goals and target groups even better.
*eKIT (2013). An Integrated Modular System for Evaluations in the Field of Prevention at AUVA, REPORT NR. 63.1.