The reason I take mild issue with the Crystal Empire fading away lately is that back in S3-4 the writers used it as the backdrop of several pivotal events/episodes, indicating that they were intending to prioritize it as a location, but never exactly followed up on this following S4.