No. What would you consider guys clothing anyway? Jeans, shorts, hoodies? Maybe the suit/tuxedo? It seems that most 'guy clothes' already have female equivalents so it doesn't really seem weird when they're worn by the opposite gender. In a world where skinny jeans exist you can wear ladies' jeans quite discreetly. However there aren't really any male equivalents of skirts/dresses/etc. Kilts? Only in early 20th century Scotland or whatever. That, presumably, is when you start to get the weird looks on the street.