Comment by vkaku

Very true. In fact, there's a lot more under the surface that will come to light once more efficient tiny models come out.

P.S. Building something that proves that you don't need those many params even.

https://github.com/guilt/tinytot