Uses of Class
ai.beestream.jitnn.Buckets
Packages that use Buckets
Package
Description
The jitNN API:
Tensor (n-dimensional arrays, lazy on TornadoVM
devices), reverse-mode differentiation (Tensor.backward(), Grad),
the functional operators of F, linear algebra (Linalg),
Fourier transforms (Fft), sparse matrices (SparseMatrix),
mixed precision (Autocast) and user-defined operators
(CustomOp).Neural-network modules after PyTorch's
torch.nn: Module and
Sequential, linear and convolution layers, pooling, normalisation,
attention, embeddings, recurrent layers (LSTM, GRU), graph convolution, activations, and data-parallel
training (DataParallel).-
Uses of Buckets in ai.beestream.jitnn
Methods in ai.beestream.jitnn that return BucketsModifier and TypeMethodDescriptionstatic BucketsBuckets.multiplesOf(int step, int max) The multiples ofstepup to and includingmax(rounded up to a multiple).static BucketsBuckets.of(int... sizes) These sizes.static BucketsBuckets.powersOfTwo(int min, int max) The powers of two fromminup to and includingmax(both rounded up to a power of two). -
Uses of Buckets in ai.beestream.jitnn.nn
Methods in ai.beestream.jitnn.nn with parameters of type BucketsModifier and TypeMethodDescriptionstatic TensorA causal token model (GPT-2, Llama) over INT32 tokens [B, T]: rows padded to abatchsize, positions padded at the end to aseqsize withpadToken, which the real positions never attend to; the result [B, T, ...] for the real rows and positions.static TensorBucketing.masked(Buckets batch, Buckets seq, Tensor idx, Tensor mask, int padToken, BinaryOperator<Tensor> model) An encoder with an additive attention mask (BERT):modeltakes tokens [B, T] and a mask [B, 1, 1, T] or [B, 1, T, T] (masknull for none).static TensorBucketing.rows(Buckets batch, Tensor x, UnaryOperator<Tensor> model) modeloverx[N, ...] with N padded to abatchsize by zero rows; the result's first N rows.