Comment by halirutan

For signals (as opposed to images), you should have a look at "Understanding Digital Signal Processing" by Richard G. Lyons (ISBN-13: 978-0131089891). I enjoyed this very much and if you grasped the contents from it, you should be able to understand audio-specific books easily.