I blushingly admit I've been guilty of this. Accidentally of course.
I once walked into the sailor's toilets on HMS Fearless.
(at Navy Days in Plymouth). I came out very fast after various comments from the sailors.
My friend Mary and I walked into the Gents at the Dover Ferry Port. Again, a fast exit was necessary!
And, more recently, I was amazed when a man walked into what I thought was the Ladies in our local Sainsbury's.
It turned out it was me that was wrong, - I was in the Gents.
Yes, I am short-sighted. And yes, I am bonkers.