Yeah, height does matter to me, but then again, I'm 5'8", so I'm quite tall for a woman.
I always tend to get looked over for shorter girls by really tall guys. In my area, at least, the guys go for the really short women, but not the taller women.
Still, even if you are short, that doesn't mean you can't be an awesome person. Be a good man and cultivate your unique personality and sooner or later, someone will bite. And if you want, date a girl who's a little taller. Many people are pretty open about dating below their height.