Package ai.beestream.jitnn.gguf
package ai.beestream.jitnn.gguf
The GGUF reader (llama.cpp's model format):
GgufFile gives a file's
metadata and its tensors, memory-mapped without a copy, in their quantised blocks or as F32, F16
and BF16.-
ClassDescriptionThe tensor element types a GGUF file can hold (ggml's
ggml_type), with their ids, block sizes and the jitNNDTypeeach one loads as.A GGUF file (llama.cpp's model format, versions 2 and 3): its metadata and its tensors, which load as persistent jitNN tensors.One tensor listed in a GGUF file.