What is Gradient Descent in Machine Learning?
Gradient descent is an optimization algorithm that updates model parameters by stepping opposite the gradient of a loss function, reducing error over iterations (often on mini-batches).
Variants like SGD, Adam, and AdaGrad change step-size and momentum behavior.
Authority: Wikipedia: Gradient descent