Comment by Anm

They only need to store (and occasionally update) the kernel parameters for the trained deep neural net. Very small indeed.