In my mind Fluttershy's family were very mean to her and just plain jerks, this is why Shy is so, shy, of everypony. Also why she prefers the company of animals, they can't treat her badly like other ponies can. I'm really hoping in S5 we get to see more pony parents/family because non of them have gotten the screen time they deserve.