Momentum
02 January

A Very Short Introduction of Momentum and Nesterov Momentum

Momentum and Nesterov Momentum are essential optimisation techniques that accelerate machine learning training by smoothing updates and improving accuracy. This blog explores their history, functionality, features, and applications, including their impact in Australian industries like healthcare and environmental forecasting.