Class RReLU

java.lang.Object
ai.beestream.jitnn.nn.Module
ai.beestream.jitnn.nn.RReLU
All Implemented Interfaces:
AutoCloseable

public final class RReLU extends Module
RReLU: random slopes in [lower, upper) while training (a fresh seed per call, so a replayed step draws new slopes without recompiling), the mean slope in evaluation. PyTorch's defaults are 1/8 and 1/3.
  • Constructor Details

    • RReLU

      public RReLU(float lower, float upper, long seed)
      RReLU with slopes in [lower, upper), drawn from a stream seeded by seed.
  • Method Details