This was annoying to me too but it is pretty easy to fix. Just right click on the .mp3 or whatever file, Get Info and change the default application to your preferred app and then click on "Change all..."
You have to do it once per file type but it's once and done.
You have to do it once per file type but it's once and done.