Two pilot studies were conducted to produce efficacy data on an observational tool designed to assess the use of Universal Precautions (UP) in patient care settings. The instrument addresses barrier precautions, hand-washing, handling of sharps, and avoidance of unprotected mouth to mouth resuscitation.

The Universal Precautions Assessment Tool was submitted to a panel of 3 experts to establish consensual validity. It was pilot tested by 2 simultaneous observers to establish interrater reliability.

Pilot Study I was conducted in 3 different units within a 100-bed U.S. Army hospital. Pilot Study II was conducted in the emergency department of a large university-based hospital.

Subjects observed were registered nurses providing acute patient care.

Two simultaneous raters calculated UP compliance rates of 76.4% and 78.6%, respectively, for 9 nurses in Pilot Study I, and 62% and 65%, respectively, for 5 nurses in Pilot Study II. The intraclass correlation coefficient for the raters' scores in Pilot Study I was 0.992 with a 95% confidence interval (0.979, 0.997). Consensual validity was established.

The instrument has acceptable interrater reliability under the conditions used. Limitations to use include the possibility of a Hawthorne effect and the fact that assessing proper implementation of UP occasionally relies on a “judgment call” by the observer. With test conditions adjusted to minimize these limitations and with proper consideration of sample size, the tool can be used by researchers and by monitors of hospital quality control to measure UP compliance of caregivers individually or collectively.