Class RMSProp

java.lang.Object
ai.beestream.jitnn.nn.optim.Optimizer
ai.beestream.jitnn.nn.optim.RMSProp

public final class RMSProp extends Optimizer
RMSProp (Hinton), PyTorch's semantics: smoothing alpha, optional momentum and centring, L2 weight decay.
  • Constructor Details

    • RMSProp

      public RMSProp(List<Tensor> params, float lr, float alpha, float eps, float weightDecay, float momentum, boolean centered)
      RMSProp with smoothing alpha, eps, L2 weight decay, momentum (0 for none) and, with centered, the variance estimated around the mean gradient.
  • Method Details

    • step

      public void step()
      Description copied from class: Optimizer
      Records one update of every parameter that has a gradient.
      Specified by:
      step in class Optimizer
    • state

      protected Map<String,Tensor[]> state()
      Description copied from class: Optimizer
      Per-parameter state by slot name, each array indexed like the parameters (null where none).
      Overrides:
      state in class Optimizer