Adaptive Gradient Algorithm (AdaGrad)

What is Adaptive Gradient Algorithm (AdaGrad)?

AdaGrad is an optimization algorithm that adapts each parameter’s learning rate based on the historical sum of squared gradients—effective for sparse features.

Further reading: Wikipedia: AdaGrad.

Get AI security insights in your inbox