Class JitnnEngine

java.lang.Object
ai.djl.engine.Engine
ai.beestream.jitnn.djl.JitnnEngine

public final class JitnnEngine extends ai.djl.engine.Engine
A DJL engine that runs DJL code on jitNN: NDArray operators become lazy jitNN operators, compiled into one TornadoVM plan per step and replayed; DJL's blocks, losses, optimisers and trainers work on top, and Model.load reads ONNX files through jitnn-onnx.

Its rank (0) makes it DJL's default engine when it is on the class path; set ai.djl.default_engine to choose another. Operators jitNN lacks run on the engine named by -Djitnn.djl.fallback (for example PyTorch), when one is given, else throw.

  • Field Details

    • ENGINE_NAME

      public static final String ENGINE_NAME
      The engine's name in DJL: Engine.getEngine("jitNN").
      See Also:
  • Method Details

    • getInstance

      public static JitnnEngine getInstance()
      The engine, created on first use.
    • getAlternativeEngine

      public ai.djl.engine.Engine getAlternativeEngine()
      Specified by:
      getAlternativeEngine in class ai.djl.engine.Engine
    • getEngineName

      public String getEngineName()
      Specified by:
      getEngineName in class ai.djl.engine.Engine
    • getRank

      public int getRank()
      Specified by:
      getRank in class ai.djl.engine.Engine
    • getVersion

      public String getVersion()
      Specified by:
      getVersion in class ai.djl.engine.Engine
    • hasCapability

      public boolean hasCapability(String capability)
      Specified by:
      hasCapability in class ai.djl.engine.Engine
    • defaultDevice

      public ai.djl.Device defaultDevice()
      Overrides:
      defaultDevice in class ai.djl.engine.Engine
    • getGpuCount

      public int getGpuCount()
      Overrides:
      getGpuCount in class ai.djl.engine.Engine
    • newSymbolBlock

      public ai.djl.nn.SymbolBlock newSymbolBlock(ai.djl.ndarray.NDManager manager)
      Overrides:
      newSymbolBlock in class ai.djl.engine.Engine
    • newModel

      public ai.djl.Model newModel(String name, ai.djl.Device device)
      Specified by:
      newModel in class ai.djl.engine.Engine
    • newBaseManager

      public ai.djl.ndarray.NDManager newBaseManager()
      Specified by:
      newBaseManager in class ai.djl.engine.Engine
    • newBaseManager

      public ai.djl.ndarray.NDManager newBaseManager(ai.djl.Device device)
      Specified by:
      newBaseManager in class ai.djl.engine.Engine
    • newGradientCollector

      public ai.djl.training.GradientCollector newGradientCollector()
      Overrides:
      newGradientCollector in class ai.djl.engine.Engine
    • setRandomSeed

      public void setRandomSeed(int seed)
      Overrides:
      setRandomSeed in class ai.djl.engine.Engine
    • toString

      public String toString()
      Overrides:
      toString in class ai.djl.engine.Engine