Uses of Record Class
ai.beestream.jitnn.nn.text.Tokenizer.Encoding
Packages that use Tokenizer.Encoding
Package
Description
Vocabularies and training examples for the embedding models in
ai.beestream.jitnn.nn.models.-
Uses of Tokenizer.Encoding in ai.beestream.jitnn.nn.text
Methods in ai.beestream.jitnn.nn.text that return Tokenizer.EncodingModifier and TypeMethodDescriptionEncodes one text, with the post-processor's special tokens.Encodes a pair of texts (sentence A, sentence B).Encodesa(andbwhen not null) into at mostmaxLengthids, special tokens included, cutting the longer sequence first as Hugging Face's longest-first truncation.