Comment by janto

There are other gradient free optimizers (like Powell's method) that are simpler and in my experience work better.