Uses of Package
ai.beestream.jitnn
Packages that use ai.beestream.jitnn
Package
Description
The jitNN API:
Tensor (n-dimensional arrays, lazy on TornadoVM
devices), reverse-mode differentiation (Tensor.backward(), Grad),
the functional operators of F, linear algebra (Linalg),
Fourier transforms (Fft), sparse matrices (SparseMatrix),
mixed precision (Autocast) and user-defined operators
(CustomOp).Datasets: MNIST and CIFAR-10 readers, a byte-level text corpus, and synthetic data, held in memory as
a
Dataset.Several devices: collectives (all-reduce, broadcast, reduce-scatter, all-gather) among ranks,
staged through the host (
HostCollective) or run by NCCL on NVIDIA GPUs
(NcclCollective), and ProcessGroup, which
runs one rank per device.A Deep Java Library engine named
jitNN: DJL's NDArrays, blocks, Trainer and
Predictor run on jitNN (JitnnEngine).The execution engine, which records operators in a per-thread trace and, at a sync point, compiles
the trace into one TornadoVM task graph, cached by structure and replayed, or runs it on the host
with the double-precision reference.
The GGUF reader (llama.cpp's model format):
GgufFile gives a file's
metadata and its tensors, memory-mapped without a copy, in their quantised blocks or as F32, F16
and BF16.Checkpoints: named tensors and values (
StateDict) saved and loaded in
Hugging Face's safetensors format (SafeTensors).Classical machine learning after scikit-learn, run on the device: k-means, k-nearest neighbours,
PCA, linear and logistic regression, linear SVM, naive Bayes, decision trees, random forests,
gradient boosting and t-SNE.
Neural-network modules after PyTorch's
torch.nn: Module and
Sequential, linear and convolution layers, pooling, normalisation,
attention, embeddings, recurrent layers (LSTM, GRU), graph convolution, activations, and data-parallel
training (DataParallel).Complete models: ResNet, MobileNetV2, GPT-2, a Llama-style decoder, BERT, a VAE, DCGAN, U-Net and
character RNNs, and the embedding models word2vec, doc2vec and GloVe.
Optimisers with PyTorch's semantics (SGD, Adam and AdamW, AdaGrad, RMSProp, AdaDelta, AdaMax,
NAdam, LAMB, LARS), learning-rate schedules (
LRScheduler) and dynamic
loss scaling for FP16 training (GradScaler).Vocabularies and training examples for the embedding models in
ai.beestream.jitnn.nn.models.The ONNX importer:
OnnxSession loads an ONNX file and runs it on
jitNN's operators.The TensorFlow importer:
TfModel loads SavedModels and frozen GraphDefs,
translating them into ONNX graphs that the ONNX importer runs on jitNN.-
Classes in ai.beestream.jitnn used by ai.beestream.jitnnClassDescriptionWhere operators run.A fixed set of sizes that a changing dimension (batch, sequence length) is rounded up to, so requests of many shapes run a few compiled plans instead of compiling one per shape, as TensorRT's optimization profiles or vLLM's CUDA-graph batch sizes do.An operator defined outside jitNN: a kernel written in plain Java with TornadoVM's
KernelContext, an optional host reference and an optional gradient.Gradients with respect to each input (null where none is needed), given the gradient of the first output.The gradients of an element-wise binary operator y = f(a, b): [dL/da, dL/db] from a, b, y and dL/dy.Defines a custom operator step by step;CustomOp.Builder.build()registers its name.Adds the operator's device tasks fornodeto the plan being built.The shape of an output, from the inputs and the integer attributes of the call.Computesnodeon the host: inputs are readable, outputs are allocated.The gradient of an element-wise unary operator y = f(x): dL/dx from x, y and dL/dy.Element type of a tensor: FP32 data, INT32 labels and indices, and the half-precision storage types for mixed precision, IEEE FP16 and bfloat16 (the top 16 bits of an FP32), and Q8_0, GGUF's 8-bit blocks (per 32 consecutive values an FP16 scale and 32 signed bytes, 34 bytes), and the OCP 8-bit floats FP8 E4M3 and E5M2, one byte per value, stored without their scale (seeFp8).HowF.embeddingBag(Tensor, int[], Tensor, F.BagMode)andF.segmentReduce(Tensor, int[], F.BagMode)combine the rows of a bag.HowF.pad(Tensor, int[], int[], F.PadMode, float)fills: a constant, the reflection without the edge, or the edge replicated.HowF.pool(Tensor, F.PoolMode, int[], int[], int[], int[], boolean, boolean, float)combines a window.How a loss reduces its per-element values.Scaling, torch'snorm: BACKWARD scales the inverse by 1/n, ORTHO both by 1/sqrt(n), FORWARD the forward by 1/n.A try-with-resources scope that restores the previous gradient mode.jitNN's options, in one immutable object.Builds a configuration option by option.One option: its key, type, default and description.The groups options are listed in.A rescaling of the rotary position embedding's frequencies, as Hugging Face'srope_scaling.An immutable, row-major tensor shape.The structure of a sparse matrix (which entries are stored), built once on the host from coordinate lists; the values are a separate tensor, in the order the coordinates were given, so they can be learned.A structure with fixed values.An n-dimensional array. -
Classes in ai.beestream.jitnn used by ai.beestream.jitnn.data
-
Classes in ai.beestream.jitnn used by ai.beestream.jitnn.dist
-
Classes in ai.beestream.jitnn used by ai.beestream.jitnn.djl
-
Classes in ai.beestream.jitnn used by ai.beestream.jitnn.engine
-
Classes in ai.beestream.jitnn used by ai.beestream.jitnn.ggufClassDescriptionElement type of a tensor: FP32 data, INT32 labels and indices, and the half-precision storage types for mixed precision, IEEE FP16 and bfloat16 (the top 16 bits of an FP32), and Q8_0, GGUF's 8-bit blocks (per 32 consecutive values an FP16 scale and 32 signed bytes, 34 bytes), and the OCP 8-bit floats FP8 E4M3 and E5M2, one byte per value, stored without their scale (see
Fp8).An n-dimensional array. -
Classes in ai.beestream.jitnn used by ai.beestream.jitnn.ioClassDescriptionElement type of a tensor: FP32 data, INT32 labels and indices, and the half-precision storage types for mixed precision, IEEE FP16 and bfloat16 (the top 16 bits of an FP32), and Q8_0, GGUF's 8-bit blocks (per 32 consecutive values an FP16 scale and 32 signed bytes, 34 bytes), and the OCP 8-bit floats FP8 E4M3 and E5M2, one byte per value, stored without their scale (see
Fp8).An n-dimensional array. -
Classes in ai.beestream.jitnn used by ai.beestream.jitnn.ml
-
Classes in ai.beestream.jitnn used by ai.beestream.jitnn.nnClassDescriptionA fixed set of sizes that a changing dimension (batch, sequence length) is rounded up to, so requests of many shapes run a few compiled plans instead of compiling one per shape, as TensorRT's optimization profiles or vLLM's CUDA-graph batch sizes do.How
F.embeddingBag(Tensor, int[], Tensor, F.BagMode)andF.segmentReduce(Tensor, int[], F.BagMode)combine the rows of a bag.HowF.pad(Tensor, int[], int[], F.PadMode, float)fills: a constant, the reflection without the edge, or the edge replicated.A structure with fixed values.An n-dimensional array. -
Classes in ai.beestream.jitnn used by ai.beestream.jitnn.nn.modelsClassDescriptionA rescaling of the rotary position embedding's frequencies, as Hugging Face's
rope_scaling.An n-dimensional array. -
Classes in ai.beestream.jitnn used by ai.beestream.jitnn.nn.optim
-
Classes in ai.beestream.jitnn used by ai.beestream.jitnn.nn.text
-
Classes in ai.beestream.jitnn used by ai.beestream.jitnn.onnx
-
Classes in ai.beestream.jitnn used by ai.beestream.jitnn.tf