Although some people have already said it, I'll reinforce the "be positive and forget the haters" attitude, although I do see where you're coming from about the questionable peer environment. Honestly if I was in your position, I'd do what I felt comfortable with. If you feel the good will outweigh the bad then go for it!