Comment

Comment by atschantz

I mean it's difficult to 'observe' gradient descent, there are no characteristic properties that you can identify without specifying the relative objective function. But most of the process theories from computational neuroscience are based on some form of gradient descent. Even if it's only implicit, you'll be able to describe the variables of the system as moving against the gradient of some function.

But yes, it's extremely unlikely that nature implements backpropagation directly, as it relies on non-local gradients.

parent atschantz 8 years ago

No comments yet

Be the first to share your thoughts.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton