smorms3.hpp File Reference
Include dependency graph for smorms3.hpp:
Go to the source code of this file.
Classes | |
| class | SMORMS3 |
| SMORMS3 is an optimizer that estimates a safe and optimal distance based on curvature and normalizing the stepsize in the parameter space. More... | |
Namespaces | |
| mlpack | |
.hpp | |
| mlpack::optimization | |
Detailed Description
SMORMS3 i.e. squared mean over root mean squared cubed optimizer. It is a hybrid of RMSprop, which estimates a safe and optimal distance based on curvature and Yann LeCun’s method in "No more pesky learning rates".
mlpack is free software; you may redistribute it and/or modify it under the terms of the 3-clause BSD license. You should have received a copy of the 3-clause BSD license along with mlpack. If not, see http://www.opensource.org/licenses/BSD-3-Clause for more information.
Definition in file smorms3.hpp.