Accurate field evaluations are critical in determining paramedic students' competency to provide patient care. The [U.S.] National Paramedic Curriculum does not address the skills needed by evaluators, and requirements to be a preceptor/evaluator vary from state to state. Therefore, it is imperative that educational programs develop an evaluation process that reflects valid performance criteria and assure a high degree of rating consistency among the evaluators. This study sought to determine the effects of using a video case based teaching approach in preparing paramedic preceptors for the role of evaluator.

Paramedic preceptors receiving the case-based teaching approach to prepare them for the role of evaluator would demonstrate significantly higher scores on a video posttest than paramedic preceptors who were not prepared for the role of evaluator using the case-based approach.

Thirty-four paramedic preceptors from a Midwestern fire-based Emergency Medical Services system were enrolled in this study. Two scripted video student/patient encounters were used to measure evaluation scores in a pretest-posttest comparison of control versus experimental group. The experimental group was given structured rating guidelines and practice applying those guidelines to a case study. Pretest and posttest scores were weighted and analyzed using Analysis of Variance.

Analysis of the pretest–posttest differences revealed significantly higher scores for the experimental group in the categories containing complex behaviors: communication F(1,16) = 13.21, p <.01, assessment F (1,16) = 8.81, p <.01, and knowledge F (1,16) = 29.64, p <.001. There was no significant difference between groups in the categories containing simple, easily observed behaviors: reliability F (1,16) = .55, p >.05 and cooperativeness F (1,16) = 3.02, p >.05.

Using the case study method and written guidelines that provide concrete examples of complex behaviors appears to increase reliability of evaluations among preceptors.

To study the preparedness New York City for large scale medical disasters using the Year 2000 (Y2K) New Years Eve weekend as a model.

Surveys were sent to the directors of 51 of the 9-1-1-receiving hospitals in New York City before and after the Y2K weekend. Inquiries were made regarding hospital activities, contingencies, protocols, and confidence levels in the ability to manage critical incidents, including weapons of mass destruction (WMD) events. Additional information was collected from New York City governmental agencies regarding their coordination and preparedness.

The pre-Y2K survey identified that 97.8% had contingencies for loss of essential services, 87.0% instituted their disaster plan in advance, 90.0% utilized an Incident Command System, and 73.9% had a live, mock Y2K drill. Potential terrorism influenced Y2K preparedness in 84.8%. The post-Y2K survey indicated that the threat of terrorism influenced future preparedness in 73.3%; 73.3% had specific protocols for chemical; 62.2% for biological events; 51.1% were not or only slightly confident in their ability to manage any potential WMD incidents; and 62.2% felt very or moderately confident in their ability to manage victims of a chemical event, but only 35.6% felt similarly about victims of a biological incident. Moreover, 80% felt there should be government standards for hospital preparedness for events involving WMD, and 84% felt there should be government standards for personal protective and DECON equipment. In addition, 82.2% would require a moderate to significant amount of funding to effect the standards. Citywide disaster management was coordinated through the Mayor's Office of Emergency Management.

Although hospitals were on a heightened state of alert, emergency department directors were not confident in their ability to evaluate and manage victims of WMD incidents, especially biological exposures. The New York City experience is an example for the rest of the nation to underscore the need for further training and education of preparedness plans for WMD events. Federally supported education and training is available and is essential to improve the response to WMD threats.

This study evaluates whether a continuing education program for paramedics, focusing on Children with Special Health Care Needs, improved paramedics' assessment and management.

Emergency Medical Services responses for children, 21 years of age or younger, with a congenital or acquired condition or a chronic physical or mental illness, were identified. The responses before and after the specialized education program were reviewed by a multidisciplinary team to evaluate assessment and management of the children. Interreviewer agreement between the nurses on the team and between the physicians on the team was assessed. We also evaluated whether there was an improvement in assessment and care by paramedics completing our education program.

Significant improvement was seen in appropriate assessment and overall care by paramedics who completed our specialized education program. Reviewers also noted an appropriate rating for the initial assessment category more often for responses involving paramedics who had the training. Agreement on whether assessment and treatment was appropriate for all five reviewers varied considerably, ranging from 32% to 93%. Overall there was a high percentage of agreement (>70%) between the nurses and between the physicians on most items. However, kappa statistics did not generally reflect good agreement except for most of the focused assessment items and some treatment and procedure items.

Most of the documentation on the EMS records indicated appropriate assessment and treatment during all responses for Children with Special Health Care Needs. Nevertheless, the results indicate that paramedics may improve their assessment and management of these children after specialized continuing education.