mlpack
Public Member Functions | List of all members
SARAHUpdate Class Reference

Vanilla update policy for SARAH. More...

Public Member Functions

bool Update (arma::mat &iterate, arma::mat &v, const arma::mat &gradient, const arma::mat &gradient0, const size_t batchSize, const double stepSize, const double)
 Update step for SARAH. More...

 

Detailed Description

Vanilla update policy for SARAH.

Definition at line 23 of file sarah_update.hpp.

Member Function Documentation

◆ Update()

bool Update ( arma::mat &  iterate,
arma::mat &  v,
const arma::mat &  gradient,
const arma::mat &  gradient0,
const size_t  batchSize,
const double  stepSize,
const double   
)
inline

Update step for SARAH.

The function parameters are updated in the negative direction of the gradient.

Parameters
iterateParameters that minimize the function.
vUnbiased estimator of the gradient.
gradientThe current gradient matrix at time t.
gradient0The old gradient matrix at time t - 1.
batchSizeBatch size to be used for the given iteration.
stepSizeStep size to be used for the given iteration.
vNormThe norm of the full gradient.

Definition at line 38 of file sarah_update.hpp.

The documentation for this class was generated from the following file: