"My Little Pony" definitely attaches a powerful stygma to it. I mean, all anybody who isn't a fan of My Little Pony really knows about are the bits like "Pinkie Pie's Lady Bug Jamboree" and things like that...really frilly, girly stuff.
That said, they connect those dots, make that assumption, and pretty much remain set in their belief that only little girls should like the show.