Comment by herbps10

Gaussian Processes in particular can be very useful in regression problems when you don't want to make strong assumptions about the functional form of the relationship between variables. (You can still introduce more general assumptions, like that the relationship is "smooth" to some degree or is periodic, by your choice of GP kernel function.)