Providing eight ambiguous clinical vignettes to generalist physician members of the Society to Improve Diagnosis in Medicine, this study found participants did not agree on whether cognitive biases were or were not present. When the outcome of the vignette implied an incorrect diagnosis, respondents reported twice as many biases, suggesting that physician judgments are strongly influenced by hindsight bias.