2 results found Sort:

webdataset
webdataset webdataset
192
2.4k
bsd-3-clause
23
A high-performance Python-based I/O system for large (and small) deep learning problems, with strong support for PyTorch.
pytorch webdataset deep-learning data-augmentation webdataset-format
Created 2019-08-07
1,055 commits to main branch, last one 10 days ago
huggingface
chug huggingface
11
153
apache-2.0
11
Minimal sharded dataset loaders, decoders, and utils for multi-modal document, image, and text datasets.
datasets webdataset dataloading pdf-document computer-vision distributed-training multi-modal-learning document-understanding
Created 2023-06-06
36 commits to main branch, last one 8 months ago