Class JitnnSymbolBlock

java.lang.Object
ai.djl.nn.AbstractBaseBlock
ai.djl.nn.AbstractSymbolBlock
ai.beestream.jitnn.djl.JitnnSymbolBlock
All Implemented Interfaces:
ai.djl.nn.Block, ai.djl.nn.SymbolBlock

public final class JitnnSymbolBlock extends ai.djl.nn.AbstractSymbolBlock
An ONNX model loaded by jitnn-onnx, as a DJL block. Inputs are matched to the graph's inputs by name when the arrays are named after them, else by position; integer arrays (token ids) go in as INT32. The outputs come back in the graph's order.
  • Field Summary

    Fields inherited from class ai.djl.nn.AbstractBaseBlock

    inputNames, inputShapes, outputDataTypes, version
  • Method Summary

    Modifier and Type
    Method
    Description
    ai.djl.util.PairList<String, ai.djl.ndarray.types.Shape>
     
    protected ai.djl.ndarray.NDList
    forwardInternal(ai.djl.training.ParameterStore parameterStore, ai.djl.ndarray.NDList inputs, boolean training, ai.djl.util.PairList<String,Object> params)
     
    ai.djl.nn.ParameterList
     
    The jitnn-onnx session behind this block.

    Methods inherited from class ai.djl.nn.AbstractSymbolBlock

    getChildren, getOutputShapes

    Methods inherited from class ai.djl.nn.AbstractBaseBlock

    beforeInitialize, cast, clear, forward, forward, forwardInternal, getInputShapes, getOutputDataTypes, getParameters, initialize, initializeChildBlocks, isInitialized, loadMetadata, loadParameters, prepare, readInputShapes, saveInputShapes, saveMetadata, saveParameters, setInitializer, setInitializer, setInitializer, toString

    Methods inherited from class Object

    clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

    Methods inherited from interface ai.djl.nn.Block

    cast, clear, forward, forward, forward, freezeParameters, freezeParameters, getCustomMetadata, getInputShapes, getOutputDataTypes, getOutputShapes, getParameters, initialize, isInitialized, loadParameters, saveParameters, setInitializer, setInitializer, setInitializer

    Methods inherited from interface ai.djl.nn.SymbolBlock

    describeOutput, removeLastBlock
  • Method Details

    • session

      public OnnxSession session()
      The jitnn-onnx session behind this block.
    • forwardInternal

      protected ai.djl.ndarray.NDList forwardInternal(ai.djl.training.ParameterStore parameterStore, ai.djl.ndarray.NDList inputs, boolean training, ai.djl.util.PairList<String,Object> params)
      Specified by:
      forwardInternal in class ai.djl.nn.AbstractBaseBlock
    • getDirectParameters

      public ai.djl.nn.ParameterList getDirectParameters()
    • describeInput

      public ai.djl.util.PairList<String, ai.djl.ndarray.types.Shape> describeInput()
      Specified by:
      describeInput in interface ai.djl.nn.Block
      Overrides:
      describeInput in class ai.djl.nn.AbstractBaseBlock