Making medical reports lexically more similar to reference answers renders them factually less reliable, and lexical overlap metrics may be negatively correlated with factual accuracy.