Package ai.beestream.jitnn.data
package ai.beestream.jitnn.data
Datasets: MNIST and CIFAR-10 readers, a byte-level text corpus, and synthetic data, held in memory as
a
Dataset.-
ClassDescriptionA synthetic classification set:
classesGaussian clusters indimsdimensions.CIFAR-10 from the binary distribution (cifar-10-batches-bin: data_batch_1..5.bin and test_batch.bin, each record a label byte and 3072 pixel bytes in CHW order).Batches of aDatasetfor training, as PyTorch'sDataLoader: shuffled per epoch from a seed, optional per-sample transforms (augmentation), the last short batch kept or dropped, and batches assembled ahead by worker threads while the device computes.One batch: samples [size, ...sampleShape] and labels [size], host tensors.Options of aDataLoader: shuffling, worker threads, prefetching.An in-memory labelled dataset of fixed-shape samples (CHW images or flat vectors).Reads the MNIST IDX files (train-images-idx3-ubyte[.gz]and friends) from a directory.A byte-level text corpus for language-model gates: every byte is a token (vocabulary 256).Per-sample transforms forDataLoader, applied in place to one CHW sample on the host: the usual image augmentations and normalisation.Transforms one sample ofshapeatx[at ..]in place.