Comment by skadamat

There's research that shows that in practice, grid search / random search beat most of the alternatives. It's also easier to parallelize thankfully!