Uses of Class
ai.beestream.jitnn.onnx.OnnxSession
Packages that use OnnxSession
Package
Description
A Deep Java Library engine named
jitNN: DJL's NDArrays, blocks, Trainer and
Predictor run on jitNN (JitnnEngine).The ONNX importer:
OnnxSession loads an ONNX file and runs it on
jitNN's operators.The TensorFlow importer:
TfModel loads SavedModels and frozen GraphDefs,
translating them into ONNX graphs that the ONNX importer runs on jitNN.-
Uses of OnnxSession in ai.beestream.jitnn.djl
Methods in ai.beestream.jitnn.djl that return OnnxSessionModifier and TypeMethodDescriptionJitnnSymbolBlock.session()The jitnn-onnx session behind this block. -
Uses of OnnxSession in ai.beestream.jitnn.onnx
Methods in ai.beestream.jitnn.onnx that return OnnxSessionModifier and TypeMethodDescriptionstatic OnnxSessionLoads an ONNX file and prepares it to run in FP32; external data files next to it are memory-mapped.static OnnxSessionWithhalfPrecision, activations stay FP16 between operators (products accumulate in FP32) and the linear layers' weights are stored in FP16; outputs are FP32.static OnnxSessionA session over a model built in memory (seeOnnxModel.of(OnnxModel.Graph, Map));halfPrecisionas inOnnxSession.load(Path, boolean).OnnxSession.withBuckets(int... sizes) Pads the model's symbolic dimensions to the smallest ofsizesthat holds them (a size beyond the largest is run as it is), so a server compiles one plan per bucket instead of one per request shape. -
Uses of OnnxSession in ai.beestream.jitnn.tf
Methods in ai.beestream.jitnn.tf that return OnnxSessionModifier and TypeMethodDescriptionTfModel.session()The jitnn-onnx session the model was translated to.