I've been doing this, and here in Canada https://ca.7digital.com/ is literally the only option I've found that let's you buy normal MP3s, would highly recommend. I've been able to get modern albums without a hitch, but don't know about modern singles. I think in the US Amazon let's you buy MP3s, but not sure there.
For the price of a Spotify subscription, I can usually buy a new album every month! Which is great; and I love slowly growing my album collection.
For the price of a Spotify subscription, I can usually buy a new album every month! Which is great; and I love slowly growing my album collection.