Package ai.beestream.jitnn.gguf


package ai.beestream.jitnn.gguf
The GGUF reader (llama.cpp's model format): GgufFile gives a file's metadata and its tensors, memory-mapped without a copy, in their quantised blocks or as F32, F16 and BF16.
  • Class
    Description
    The tensor element types a GGUF file can hold (ggml's ggml_type), with their ids, block sizes and the jitNN DType each one loads as.
    A GGUF file (llama.cpp's model format, versions 2 and 3): its metadata and its tensors, which load as persistent jitNN tensors.
    One tensor listed in a GGUF file.