AI for radiographic COVID-19 detection selects shortcuts over signal.
Artificial intelligence (AI) systems can support diagnostic decision-making. This study evaluates diagnostic “shortcuts” learned by AI systems in detecting COVID-19 in chest radiographs. Results reveal a need for better training data, improved choice in the prediction task, and external validation of the AI system prior to dissemination and implementations in different hospitals.