Yeah, I don't understand why people connect your current gender and the one you play as. I quite enjoy playing the female characters in games, even as a male.
The only thing that bothers me is when the world is inconsistent about how it applies its rules. But all of that is far less important than the gameplay itself.
Because I like to play games as if it were me in that characters shoes, and make decisions that I would make in that situation (I always end up being some kind of neutral character as a result).
I find this much easier when choosing male characters. I'll still play as female characters without issue in games where you're supposed to beplaying as a particular character with a backstory and such, like Mirror's Edge or Tomb Raider or something.
The only thing that bothers me is when the world is inconsistent about how it applies its rules. But all of that is far less important than the gameplay itself.