Comment by jasonhansel

> So we replaced the Max-Pooling layer with an Average-Pooling layer,

Why not use: https://en.m.wikipedia.org/wiki/Smooth_maximum