Enforcing the "one per artist" rule is getting a bit tricky. The subreddit seems to have a thing for artists like Arthur Collins and Billy Murray. In fact, the song I originally wanted to feature in this entry had to be changed because it conflicted with my choice for 1911.

That said, this is In the Shade of the Old Apple Tree, by Henry Burr.