I used to be a closet brony because I was afraid of haters, real life and online. I eventually told some of my buddies online and they didn't seem to mind, and that gave me confidence to tell my real buddies offline.
I say just ignore the haters. Most of them are trolls anyway. The just wanna push your buttons.