He did so more because he wished not to pain her than from furtiveness.
Furtiveness—complete disappearance if possible—is the whole point.
It was the furtiveness of it rather than the fact itself that troubled him.
When he left her her once clear, careless glance had a suggestion of furtiveness in it.
My grandmother noticed a furtiveness in his manner when he received them.