Class AdaMax

java.lang.Object
ai.beestream.jitnn.nn.optim.Optimizer
ai.beestream.jitnn.nn.optim.AdaMax

public final class AdaMax extends Optimizer
AdaMax (Kingma and Ba): Adam with an infinity norm, PyTorch's semantics, L2 weight decay.
  • Constructor Details

    • AdaMax

      public AdaMax(List<Tensor> params, float lr, float beta1, float beta2, float eps, float weightDecay)
      AdaMax with the given betas, eps and L2 weight decay.
  • Method Details

    • step

      public void step()
      Description copied from class: Optimizer
      Records one update of every parameter that has a gradient.
      Specified by:
      step in class Optimizer
    • state

      protected Map<String,Tensor[]> state()
      Description copied from class: Optimizer
      Per-parameter state by slot name, each array indexed like the parameters (null where none).
      Overrides:
      state in class Optimizer