Comment Comment by vinn124 > Many losses which don't seem differentiable can be reformulated as such...agreed, especially with policy gradients.> If the dimensionality is small, second-order methods (or approximations thereof) can do dramatically better yet.i have not seen second order derivatives in practice, presumably due to memory limitations. can you point me to examples? parent vinn124 8 years ago
agreed, especially with policy gradients.
> If the dimensionality is small, second-order methods (or approximations thereof) can do dramatically better yet.
i have not seen second order derivatives in practice, presumably due to memory limitations. can you point me to examples?