Search Results - RepositoryStats

91

684

apache-2.0

14

Scalable data pre processing and curation toolkit for LLMs

llm data python llmapps data-prep datarecipes fine-tuning data-quality datacuration data-curation deduplication data-processing data-preparation llm-data-quality fast-data-processing large-language-models semantic-deduplication data-processing-pipelines large-scale-data-processing

Created 2024-03-14

234 commits to main branch, last one 22 hours ago

9

39

mit

2

convtools is a specialized Python library for dynamic, declarative data transformations with automatic code generation

csv python parsing conversions csv-converter data-analysis code-generation transformations data-processing-pipelines

Created 2021-05-14

397 commits to master branch, last one 2 months ago

1

25

mit

2

The framework for AI-driven data pipelines. Build interactive, highly efficient data pipelines with PyTorch. ⭐ Leave a star to support us!

ai ml pytorch research workflow framework data-science data-processing machine-learning data-processing-pipelines

Created 2024-04-18

156 commits to main branch, last one 18 hours ago