Using data from the Computerized Physician Order Entry (CPOE) Evaluation Tool, this study compared hospital performance against fatal orders and nuisance orders. From 2017 to 2018, overall performance increased and fatal order performance improved slightly; there was no significant change in nuisance order performance; however, these results indicate that fatal alerts are not being prioritized and that over-alerting in some cases may be contributing to alert fatigue.