Comment by wojzaremba

So far as it comes to large datasets unsupervised learning doesn't work ! You better off training initially discriminatively your network on imagenet, and then switch to this cat vs dog training. Rather, than do unsupervised learning.