Stochastic Gradient Descent

Overview: Gradient Descent

We’re finally giving gradient descent the full couch-table treatment, because it’s hiding under half the AI stories we keep talking about. We get into the hill-climbing mental model, how loss, parameters, and backpropagation fit together, and why the whole thing is the boring engine that actually makes learning happen.