Administrative datasets offer an efficient method of identifying potential adverse events (AE) but only if they accurately represent a patient’s hospitalization. Retrospective chart reviews are a common way to validate administrative datasets, and this review identified 56 such studies. A variety of methods, sampling strategies, and accuracy rates were identified. A consensus approach to definitions and validation strategies is needed.