A woman going away with a woman is not so discreditable a thing, surely!
How did it happen that an Englishman should be in such a discreditable position?
But elsewhere the action, or inaction, of the British forces was discreditable.
The explanation is somewhat recondite, perhaps, but not discreditable.
It is not a credit to do right, but wrongdoing is discreditable.