I didn't read all the topic, only the first post, and I say, yes. I had this feeling before, but with sometime, it gone, 'cause I realize that I really don't need to worry about this, because who hate a show and people who like it, really, REALLY don't deserve my atention... Also, this fandom, I can't regret of being part of it, 'cause it literally saved my life (yeah...), and now i'm a complete diferent person then what I was before, and i'm happy, 'cause I feel good with it, and that's what really matter. If you're happy with the fandom, just follow yourself, and don't let any guy who have a so-small brain that makes him hate a TV show stop you enjoying what you like. My life now is kind of composed by the fandom, 'cause everytime that i'm on the PC, there are ponies somewhere (and I pratically just listen to brony music), and I have passed for some descriminations, too, but even that can't hurt me anymore, 'cause this fandom changed me so much that i'm a too-happy person, and to make me sad, you need a loooooot of time... So, don't worry, there are always someone like you, and in that case, there is, probably, a lot.
By the way, to end up this, remember this: Make what you love, and love what you make. I learned this with MandoPony. Hope I helped. :3