Class NAdam

java.lang.Object
ai.beestream.jitnn.nn.optim.Optimizer
ai.beestream.jitnn.nn.optim.NAdam

public final class NAdam extends Optimizer
NAdam (Dozat), PyTorch's semantics: momentum decay psi (default 0.004), L2 weight decay.
  • Constructor Details

    • NAdam

      public NAdam(List<Tensor> params, float lr, float beta1, float beta2, float eps, float weightDecay, float momentumDecay)
      NAdam with the given betas, eps, L2 weight decay and momentum decay psi.
  • Method Details