Fair Point.
However, in the view of the time traveler MC, he will think that he stole somebody else's wife. While in the current timeline/world, there was no NTR/stealing in the first place.
It is a paradox. Like Schrodinger's Cat.
But let's just call it the Schrodinger's NTR.