Objectives: Pediatric emergency medicine (PEM) physicians receive little opportunity to practice and perform chest tube insertion. We sought to develop and validate a scoring tool to assess chest tube insertion competency and identify areas where training is required for PEM physicians.
Methods: We developed a 40-point, 20-item (scored 0, 1, or 2) assessment tool entitled the Tool for Assessing Chest Tube Insertion Competency (TACTIC) and studied how PEM physicians and fellows scored when inserting a chest tube into a pork rib model. Participants were scored at baseline and compared to themselves after receiving targeted training using Web-based animations and presentations followed by expert instruction and practice on chest tube insertion task trainers. All insertions were video recorded and reviewed by two blinded reviewers. Eight common videos were reviewed to assess interrater reliability.
Results: The TACTIC demonstrated good interrater reliability with an r
=0.86. Our cohort demonstrated a significant improvement in TACTIC scores by taking part in targeted training (precourse TACTIC=65%, 95% CI 54–76 v. postcourse TACTIC=84%, 95% CI 80–88), highlighting the construct validity of the TACTIC. Individual participants increased their TACTIC scores by an average of 17%.
Conclusions: The TACTIC demonstrates good interrater reliability, content validity, and construct validity in assessing a PEM practitioner’s skill inserting chest tubes in a simulated setting.