Your comments
This is not currently possible (unless you have a special program on your computer that allows you to access all the files on your connected smartphone.) The simple MIDI tunes are mainly intended to just be a reference so users know what the song sounds like.
We appreciate your kind words! We have lots more hymns coming in the near and more distant future.
You must be experiencing a device specific problem. The app is designed to retain downloads until the user deletes them. We are not able to replicate your problem and have no reports of this happening to other users. Try deleting and reinstalling the most recent version of the app.
Customer support service by UserEcho
Quick testing here shows it already working as you desire on iOS, but not Android. Please let us know if you are on Android, and if so, what version. If this affects all Android devices, we will get it fixed. Thanks for pointing it out.