Even though the game isn't cannon and has really bad graphics and is incorrect in many ways, sweet aple acres is portraied as being apart from ponyville, so yes rarity is the only pony born in ponyville. And if you are uncertain to if even rarity lived thier in the cutie mark chronicles rarity's flash back is of her making costumes for her play which is on the same stage as the talent show the crusaders perform on.