Uses of Class
ai.beestream.jitnn.nn.models.Bert
Packages that use Bert
Package
Description
Complete models: ResNet, MobileNetV2, GPT-2, a Llama-style decoder, BERT, a VAE, DCGAN, U-Net and
character RNNs, and the embedding models word2vec, doc2vec and GloVe.
-
Uses of Bert in ai.beestream.jitnn.nn.models
Methods in ai.beestream.jitnn.nn.models that return BertModifier and TypeMethodDescriptionBert.checkpointing(boolean on) Withon, training keeps no activations inside the blocks: each block runs again in the backward pass (Grad.checkpoint(Function, Tensor...)), for less memory and about a third more compute.static BertBert.fromHuggingFace(Path dir) A BERT-family encoder from a Hugging Face model directory: config.json and safetensors weights, bymodel_type:bert(bert-base-uncasedand other BERT checkpoints, asBertModel,BertForMaskedLMorBertForPreTraining);roberta(roberta-baseand the like): positions counted from the padding index + 1, skipping padding, as RoBERTa does; LayerNorm epsilon 1e-5;distilbert: no token types, no pooler. The MLM head is loaded when the checkpoint has it; otherwise it keeps its initial values.