2 results found Sort:

NVIDIA
NeMo-Curator NVIDIA
83
617
apache-2.0
14
Scalable data pre processing and curation toolkit for LLMs
llm data python llmapps data-prep datarecipes fine-tuning data-quality datacuration data-curation deduplication data-processing data-preparation llm-data-quality fast-data-processing large-language-models semantic-deduplication data-processing-pipelines large-scale-data-processing
Created 2024-03-14
205 commits to main branch, last one 15 hours ago
westandskif
convtools westandskif
9
39
mit
2
convtools is a specialized Python library for dynamic, declarative data transformations with automatic code generation
csv python parsing conversions csv-converter data-analysis code-generation transformations data-processing-pipelines
Created 2021-05-14
397 commits to master branch, last one about a month ago