cyreal

Jittable dataset utilities for JAX.

We use a producer and transform model. Sources stream data from datasets and Transforms transform the data stream. The DataLoader class composes sources and transforms into jittable data pipelines.

  • cyreal.datasets contains datasets such as MNIST, CIFAR-10, etc and associated utilities.
  • cyreal.loader contains the DataLoader class for building jittable data pipelines.
  • cyreal.sources contains data sources such as ArraySource and GymnaxSource.
  • cyreal.transforms contains data transforms such as BatchTransform.
  • cyreal.rl contains some RL-specific utilities for the DataLoader.
 1"""Jittable dataset utilities for JAX.
 2
 3We use a producer and transform model. Sources stream data from datasets and Transforms transform the data stream. The DataLoader class composes sources and transforms into jittable data pipelines.
 4
 5
 6- `cyreal.datasets` contains datasets such as MNIST, CIFAR-10, etc and associated utilities.
 7- `cyreal.loader` contains the `DataLoader` class for building jittable data pipelines.
 8- `cyreal.sources` contains data sources such as `ArraySource` and `GymnaxSource`.
 9- `cyreal.transforms` contains data transforms such as `BatchTransform`.
10- `cyreal.rl` contains some RL-specific utilities for the DataLoader.
11"""