There's something to be said for societal brainwashing when someone who relates to females and is in touch with there feminine side feels like they're not "manly" or "one of the guys".
Being in touch with one's feminine side is nothing to be ashamed of, nor does it make you any less of a "man". If you feel like you're male and you identify as male, that's really all there is to it.
There are plenty of people who like pink frilly things and relate to women more that don't consider themselves less of a man. For a (bad) example, consider your stereotypical flamboyant gay guy. Or, for a better example: drag queens. They're not any less of men, they can just have very stereotypically feminine interests.
I think gender confusion really comes into play when you start questioning your brain/body alignment, and how you want people/society to perceive you. Would you rather go out to a restaurant and have them ask you "What may I get for you, sir?" or "What may I get for you, ma'am?"
Something to think about.