Page 16 - 372.w
P. 16

Evaluation Methods

                       Consider the following ways to evaluate.Any of these methods can be used, but each requires
                       specific criteria for best effect.




                                     EXTERNAL EVALUATOR              PARTICIPANT
                       OBJECTIVE     Checklist with stated objectives   Post-event checklist

                       SUBJECTIVE    Narrative of observations       “Hot wash” comments





                       Selecting and Utilizing Evaluation Criteria
          Developing an Evaluation Plan
                       Appendix B contains a menu of criteria for evaluating the performance of LPHA emergency
                       drills and exercises.These public health–specific criteria follow the HSEEP observer docu-
                       mentation format.‡ The exercise planning team should select applicable criteria from this
                       menu, develop any additional criteria pertaining to the local plan or the nature of the exer-
                       cise, and prepare observer forms that match the criteria selected.


                       For example, in an exercise where the objective is to assess the internal workings and
                       throughput of a mass prophylaxis distribution site, the criteria selected from the menu might
                       include:

                       Criteria for Mass Prophylaxis, Mass Immunization, and
                       Pharmaceutical Stockpiles


                      1   Adapt generic mass-dispensing strategy  3    Identify and request any “just-in-time”
                           to specific event within 60 minutes of
                                                                       training needs—including use of person-
                           notification.                               al protective equipment (PPE)—at least
                                                                       2 hours prior to site opening.
                      2    Staff dispensing site(s) with adequate and  4  Ensure that system is fully in place for
                           appropriate personnel for mass dispens-
                           ing (including volunteer surge staff)       restocking supplies throughout duration
                                                                       of site activation.
                           prior to site opening.




                       ‡ Other criteria to evaluate public health emergency exercises include
                        • The Universal Task List (UTL), developed by the Department of Homeland Security, which can be found through
                         the Office for Domestic Preparedness (ODP) Secure Portal at www.llis.gov

                        • Emergency Preparedness Performance Measures from the Centers for Disease Control and Prevention, found in
                         Appendix 4 of Cooperative Agreement Guidance for Public Health Emergency Preparedness at
          14             http://www.bt.cdc.gov/planning/guidance05/index.asp
   11   12   13   14   15   16   17   18   19   20   21