Select Page
Life and Gradient Descent

Life and Gradient Descent

Fig. Life Lessons from Gradient Descent

It’s been a long time since I was introduced to the Gradient Descent algorithm. Basically, gradient descent is an algorithm in optimization theory which helps us find out the most optimal solution to a function. It is based on a simple idea, rather than finding out the best solution to a problem immediately, move in the direction that seems to take us to the optimal solution. I have made a small list of philosophical thoughts that compare Gradient Descent to real life struggles.

(more…)