Class RMSNorm

java.lang.Object
ai.beestream.jitnn.nn.Module
ai.beestream.jitnn.nn.RMSNorm
All Implemented Interfaces:
AutoCloseable

public final class RMSNorm extends Module
RMSNorm over the last axis, with weight 1 initially, like PyTorch's nn.RMSNorm.
  • Constructor Details

    • RMSNorm

      public RMSNorm(int features, float eps)
      RMSNorm over features values with the given eps.
  • Method Details

    • weight

      public Tensor weight()
      The scale [features].
    • forward

      public Tensor forward(Tensor x)
      Description copied from class: Module
      Applies the module to x.
      Specified by:
      forward in class Module