Package ai.beestream.jitnn.data


package ai.beestream.jitnn.data
Datasets: MNIST and CIFAR-10 readers, a byte-level text corpus, and synthetic data, held in memory as a Dataset.
  • Class
    Description
    A synthetic classification set: classes Gaussian clusters in dims dimensions.
    CIFAR-10 from the binary distribution (cifar-10-batches-bin: data_batch_1..5.bin and test_batch.bin, each record a label byte and 3072 pixel bytes in CHW order).
    Batches of a Dataset for training, as PyTorch's DataLoader: shuffled per epoch from a seed, optional per-sample transforms (augmentation), the last short batch kept or dropped, and batches assembled ahead by worker threads while the device computes.
    One batch: samples [size, ...sampleShape] and labels [size], host tensors.
    Options of a DataLoader: shuffling, worker threads, prefetching.
    An in-memory labelled dataset of fixed-shape samples (CHW images or flat vectors).
    Reads the MNIST IDX files (train-images-idx3-ubyte[.gz] and friends) from a directory.
    A byte-level text corpus for language-model gates: every byte is a token (vocabulary 256).
    Per-sample transforms for DataLoader, applied in place to one CHW sample on the host: the usual image augmentations and normalisation.
    Transforms one sample of shape at x[at ..] in place.