Class Lars


public final class Lars extends Optimizer
LARS (You et al., 2017) with momentum: a per-parameter learning rate eta |p| / (|g| + weightDecay |p|), applied to the decayed gradient and accumulated in a momentum buffer.
  • Constructor Details

    • Lars

      public Lars(List<Tensor> params, float lr, float momentum, float weightDecay, float eta, float eps)
      LARS with the given momentum, weight decay, trust coefficient eta and eps.
  • Method Details

    • step

      public void step()
      Description copied from class: Optimizer
      Records one update of every parameter that has a gradient.
      Specified by:
      step in class Optimizer
    • state

      protected Map<String,Tensor[]> state()
      Description copied from class: Optimizer
      Per-parameter state by slot name, each array indexed like the parameters (null where none).
      Overrides:
      state in class Optimizer