maxerize
Joined 15 years ago
Karma
36
Submissions
11
Member since
Apr 22
Joined 15 years ago
2. Where you see fragmentation, we see diversity and a richer ecosystem. Where you see cultural disparities, we see a complex interplay of different cultures over millennia. Homogeneous populations are actually at a disadvantage because they don't have that kind of activity.
Gradient descent is a standard tool for optimizing complex functions iteratively within a computer program. Its goal is: given some arbitrary function, find a minima.
For some small subset of functions - those that are convex - there's just a single minima which also happens to be global. For most realistic functions, there may be many minima, so most minima are local.
Making sure the optimization finds the "best" minima and doesn't get stuck in sub-optimial minima is out of the scope of this article.
Here we'll just be dealing with the core gradient descent algorithm for finding some minima from a given starting point.