Yes of course after some time you will recognize it.
You are thinking of it as a player that knows stuff inside out. Then it doesn't make much of a difference I agree.
But take perspective of a new player.
Seeing a POI for the second or third time, you barely recognize "Have I been here before? Oh yeah right I remember, here I think I have to take the left...yes..."
But that same POI mirrored, it would be more like "hey I remember this place, wasn't it a left turn here...no wait...hmmm...must be a different one"
Of course that doesn't work infinitely,
and maybe for a guy with a really good memory it even comes clear immediately that it's just a "trick", and of course that guy may even be like "oh how lame that is just a mirrored version of that one from the last session yesterday, how stupid do they think I am"
No pun intended, congrat you for your really big brain
edit:
I once played a racing game for weeks without noticing that figure 8 race track was a mirrored one