Comment by zaptrem

Afaik this was stated in my Intro to ML course. A kernel machine can do anything when the similarity function has infinite dimensions. Similarly, I think they mentioned an infinitely wide MLP is also all you need.

Also, this all breaks down when you introduce reinforcement learning methods.