One must always channel their inner Worf when confronting the naysayers (as opposed to the "neigh" sayers, which I suppose would be the ponies). Worf is a badass, and he doesn't take any smeg from anybody!
I'm a pretty open person, though, so I have no problem telling people about my love of ponies. If they don't like it, oh well. If they don't like me, that sucks for them, because I'm a pretty cool dude. Their loss.