Because, much like other fandoms, our fandom tends to have some rather... unique individuals in its ranks...
Unless they call you out personally, I wouldn't really bother taking offense to them. Some people just like to spread hate, and the best way to defeat it is to ignore it.