Today we want you to bring the topic evaluation, hot wash up and exercise debriefing at our TTX. What exactly happens there?
Evaluation in our case is the systematic and objective assessment of an ongoing or completed project, and its design, implementation and results. The aim is to determine the relevance and fulfilment of objectives, development efficiency, effectiveness, impact and sustainability. A big thanks goes to University of Medicine, Pharmacy, Science and Technology of Târgu Mureș and our evaluators for the great cooperation: Sorana Truta and Cristian Boeriu.
Evaluation is different from monitoring, which is a continuing assessment based on systematic collection of data on specific indicators as well as other relevant information. Monitoring enables project managers and other stakeholders to measure progress in terms of achieving the stated objectives and the use of allocated funds.
A hot wash and debriefing happen immediately after the exercise. This gives the participants the opportunity to discuss the experiences they made at the exercise, because the impressions are still very fresh. It is also used to discuss for participants to self-assess their performance. It also a chance to explore what achievements have been accomplished, what challenges came up and what are the potential recommendations. It can be also used for evaluators to clarify their observations. The exercise debriefing is an important time to reflect in the lessons learned from the exercise and is a critical part of any large exercises.
At the conclusion of exercise play, controllers facilitate a Hot Wash to allow players to discuss strengths and areas for improvement, and allow evaluators to seek clarification regarding player actions and decision-making processes. All participants may attend; however, observers are not encouraged to attend the meeting. The Hot Wash should not exceed 30 minutes.
EXCON members and evaluators attend a facilitated debriefing immediately following the exercise. During this debriefing, controllers and evaluators provide an overview of their observed functional areas and discuss strengths and areas for improvement.
Post-exercise debriefings aim to collect sufficient relevant data to support effective evaluation and improvement planning.
Participant Feedback Forms provide players with the opportunity to comment candidly on exercise activities and exercise design. Participant Feedback Forms should be collected at the conclusion of the Hot Wash.
The After Action Report (AAR) or evaluation report summarises key information related to evaluation. This report primarily focuses on the analysis of core capabilities, including capability performance, strengths, and areas for improvement.