2 results found Sort:

webdataset
webdataset webdataset
189
2.3k
bsd-3-clause
23
A high-performance Python-based I/O system for large (and small) deep learning problems, with strong support for PyTorch.
pytorch webdataset deep-learning data-augmentation webdataset-format
Created 2019-08-07
1,046 commits to main branch, last one about a month ago
huggingface
chug huggingface
10
151
apache-2.0
11
Minimal sharded dataset loaders, decoders, and utils for multi-modal document, image, and text datasets.
datasets webdataset dataloading pdf-document computer-vision distributed-training multi-modal-learning document-understanding
Created 2023-06-06
36 commits to main branch, last one 7 months ago