Comment by Ocho-Bits

Install Ubuntu Minimal and just download what you need. You'll get the popularity of Debian (with all those packages) and a fast system (you can install any WM and such).