Search Results - RepositoryStats

116

851

apache-2.0

12

Scalable data pre processing and curation toolkit for LLMs

llm data python llmapps data-prep datarecipes fine-tuning data-quality datacuration data-curation deduplication data-processing data-preparation llm-data-quality fast-data-processing large-language-models semantic-deduplication data-processing-pipelines large-scale-data-processing

Created 2024-03-14

317 commits to main branch, last one a day ago

convtools westandskif

9

40

mit

2

convtools is a specialized Python library for dynamic, declarative data transformations with automatic code generation

csv python parsing conversions csv-converter data-analysis code-generation transformations data-processing-pipelines

Created 2021-05-14

400 commits to master branch, last one 9 days ago

graphbook graphbookai

2

28

mit

2

Visual AI development framework for training and inference of ML models, scaling pipelines, and automating workflows with Python.⭐ Leave a star to support us!

ai ml pytorch research workflow framework data-science data-processing machine-learning data-processing-pipelines

Created 2024-04-18

207 commits to main branch, last one a day ago