Would we really consider them villains if they couldn't come close? Sure, a villain's goal might not be world domination, but whatever their nefarious plan is, it has to be something within their ability.
Actually, now that I say that I really want to write something with an incompetent, unambitious villain. That sounds kind of fun.