Comment by kunstmord

Here's a write-up about a Neural Net which was used to win a Kaggle image classification challenge, they did a lot of transformations on the input data to a) prevent overfitting b) provide invariance. Some other cool tricks mentioned there, too. https://benanne.github.io/2015/03/17/plankton.html