Fast MNIST batch loading for Python via Rust + PyO3. The pipeline uses mmap for IDX files, multi-threaded batch construction, and a bounded prefetch queue. The core batching logic is generalized in ...
Need for superfast loading of large JSON files and other configs across processes/workers in AI workflow orchestrators. uv package manager, which uses rkyv to deserialize cached data without copying.