Uses of Class
ai.beestream.jitnn.nn.optim.LRScheduler

Packages that use LRScheduler
Package
Description
Optimisers with PyTorch's semantics (SGD, Adam and AdamW, AdaGrad, RMSProp, AdaDelta, AdaMax, NAdam, LAMB, LARS), learning-rate schedules (LRScheduler) and dynamic loss scaling for FP16 training (GradScaler).
  • Uses of LRScheduler in ai.beestream.jitnn.nn.optim

    Modifier and Type
    Method
    Description
    LRScheduler.cosine(Optimizer optimizer, int tMax, float minLr)
    Cosine annealing from base to minLr over tMax epochs (PyTorch's closed form).
    LRScheduler.multiStep(Optimizer optimizer, int[] milestones, float gamma)
    lr = base * gamma^m where m counts the milestones passed.
    LRScheduler.step(Optimizer optimizer, int stepSize, float gamma)
    lr = base * gamma^(epoch / stepSize).
    LRScheduler.warmupCosine(Optimizer optimizer, int warmup, int total, float minRatio)
    Linear warm-up over warmup steps, then a half-cosine decay to minRatio times the base rate at total steps (Hugging Face's get_cosine_schedule_with_warmup when minRatio is 0).
    LRScheduler.warmupLinear(Optimizer optimizer, int warmup, int total)
    Linear warm-up from 0 to the base rate over warmup steps, then linear decay to 0 at total steps (Hugging Face's get_linear_schedule_with_warmup).