This has always been a sensitive topic. It can't be decided simply telling "yes, you can wear them" or "no, it's stupid". The answer depends on viewpoints, if you are asking about wearing them public, and you are a guy, most of the crowd would not accept that, because longer socks are for women in the currently accepted trend. Girls/woman can wear them always. Man can put on longer socks when it's really cold and only under their trousers. Wearing them if it's not necessary, just for "I like them", even if it cannot be seen is not accepted. Sometimes even the other viewpoint is not accepted that someone is wearing them at home.
That was the cruel world's stuff. Personally, I'd not judge anyone male/female wearing any cloth if it makes him/her feel good, so if you ask me, yes, you can wear them any time, anywhere how you like.