Uses of Class
ai.beestream.jitnn.nn.models.Llama
Packages that use Llama
Package
Description
Complete models: ResNet, MobileNetV2, GPT-2, a Llama-style decoder, BERT, a VAE, DCGAN, U-Net and
character RNNs, and the embedding models word2vec, doc2vec and GloVe.
-
Uses of Llama in ai.beestream.jitnn.nn.models
Methods in ai.beestream.jitnn.nn.models that return LlamaModifier and TypeMethodDescriptionLlama.checkpointing(boolean on) Withon, training keeps no activations inside the blocks: each block runs again in the backward pass (Grad.checkpoint(Function, Tensor...)), for less memory and about a third more compute.static LlamaLlama.fromHuggingFace(Path dir) A Llama from a Hugging Face checkpoint directory (config.json and safetensors, asHfCheckpoint): model_type llama (or mistral without a sliding window, qwen2 with its q, k, v biases), grouped-query attention, tied or separate output weights, and linear or Llama 3.1 RoPE scaling.Llama.ropeScaling(RopeScaling scaling) Rescales the RoPE frequencies of every block (Llama 3.1's rope_scaling); null for none.