Where to find Instrumental versions

[Harmony in C5 66]

I've seen many covers of MLP songs on youtube where the youtuber doesn't seem to be playing the instrumental part themselves.  Then there's also the My Little Kareoke game that seems to have all the songs' instrumental versions.

 

I was wondering if there was a place or something where I could find the instrumental versions of songs to download for when I decide to do covers of the songs myself, or if at least for listening to them on my own time.