Class Lamb
java.lang.Object
ai.beestream.jitnn.nn.optim.Optimizer
ai.beestream.jitnn.nn.optim.Lamb
LAMB (You et al., 2020): Adam's bias-corrected update plus decoupled weight decay, scaled per
parameter by the trust ratio |p| / |update|.
-
Field Summary
-
Constructor Summary
Constructors -
Method Summary
Methods inherited from class Optimizer
clipGradNorm, learningRate, loadScalars, loadStateDict, saveScalars, setLearningRate, stateDict, takeStats, zeroGrad
-
Constructor Details
-
Lamb
-
-
Method Details
-
step
-
state
-