Class JitnnEngine
java.lang.Object
ai.djl.engine.Engine
ai.beestream.jitnn.djl.JitnnEngine
public final class JitnnEngine
extends ai.djl.engine.Engine
A DJL engine that runs DJL code on jitNN: NDArray operators become lazy jitNN operators,
compiled into one TornadoVM plan per step and replayed; DJL's blocks, losses, optimisers and
trainers work on top, and
Model.load reads ONNX files through jitnn-onnx.
Its rank (0) makes it DJL's default engine when it is on the class path; set
ai.djl.default_engine to choose another. Operators jitNN lacks run on the engine named by
-Djitnn.djl.fallback (for example PyTorch), when one is given, else throw.
-
Field Summary
FieldsModifier and TypeFieldDescriptionstatic final StringThe engine's name in DJL:Engine.getEngine("jitNN"). -
Method Summary
Modifier and TypeMethodDescriptionai.djl.Deviceai.djl.engine.Engineintstatic JitnnEngineThe engine, created on first use.intgetRank()booleanhasCapability(String capability) ai.djl.ndarray.NDManagerai.djl.ndarray.NDManagernewBaseManager(ai.djl.Device device) ai.djl.training.GradientCollectorai.djl.Modelai.djl.nn.SymbolBlocknewSymbolBlock(ai.djl.ndarray.NDManager manager) voidsetRandomSeed(int seed) toString()Methods inherited from class ai.djl.engine.Engine
debugEnvironment, getAllEngines, getDefaultEngineName, getDevices, getDevices, getDjlVersion, getEngine, getSeed, hasEngine, newParameterServer, registerEngine
-
Field Details
-
ENGINE_NAME
The engine's name in DJL:Engine.getEngine("jitNN").- See Also:
-
-
Method Details
-
getInstance
The engine, created on first use. -
getAlternativeEngine
public ai.djl.engine.Engine getAlternativeEngine()- Specified by:
getAlternativeEnginein classai.djl.engine.Engine
-
getEngineName
- Specified by:
getEngineNamein classai.djl.engine.Engine
-
getRank
public int getRank()- Specified by:
getRankin classai.djl.engine.Engine
-
getVersion
- Specified by:
getVersionin classai.djl.engine.Engine
-
hasCapability
- Specified by:
hasCapabilityin classai.djl.engine.Engine
-
defaultDevice
public ai.djl.Device defaultDevice()- Overrides:
defaultDevicein classai.djl.engine.Engine
-
getGpuCount
public int getGpuCount()- Overrides:
getGpuCountin classai.djl.engine.Engine
-
newSymbolBlock
public ai.djl.nn.SymbolBlock newSymbolBlock(ai.djl.ndarray.NDManager manager) - Overrides:
newSymbolBlockin classai.djl.engine.Engine
-
newModel
- Specified by:
newModelin classai.djl.engine.Engine
-
newBaseManager
public ai.djl.ndarray.NDManager newBaseManager()- Specified by:
newBaseManagerin classai.djl.engine.Engine
-
newBaseManager
public ai.djl.ndarray.NDManager newBaseManager(ai.djl.Device device) - Specified by:
newBaseManagerin classai.djl.engine.Engine
-
newGradientCollector
public ai.djl.training.GradientCollector newGradientCollector()- Overrides:
newGradientCollectorin classai.djl.engine.Engine
-
setRandomSeed
public void setRandomSeed(int seed) - Overrides:
setRandomSeedin classai.djl.engine.Engine
-
toString
- Overrides:
toStringin classai.djl.engine.Engine
-