Search Results - RepositoryStats

91

682

apache-2.0

14

Scalable data pre processing and curation toolkit for LLMs

llm data python llmapps data-prep datarecipes fine-tuning data-quality datacuration data-curation deduplication data-processing data-preparation llm-data-quality fast-data-processing large-language-models semantic-deduplication data-processing-pipelines large-scale-data-processing

Created 2024-03-14

232 commits to main branch, last one a day ago

143

370

apache-2.0

18

Open source project for data preparation of LLM application builders

llm ray data spark python llmapps malware data-prep finetuning datarecipes code-quality datacuration deduplication data-preparation data-preprocessing large-language-models large-scale-data-processing data-preprocessing-pipelines

Created 2024-04-08

4,269 commits to dev branch, last one a day ago

56

89

apache-2.0

9

Wrangler Transform: A DMD system for transforming Big Data

avro cdap parsing project wrangle big-data data-prep transform cdap-plugin preparation data-science data-cleansing data-transform transform-data manipulate-data data-transformation

Created 2016-11-27

1,525 commits to develop branch, last one 5 days ago

6

36

mit

2

GWAS summary statistics files QC tool

gwas compbio sumstats data-prep gwas-pipeline bioinformatics data-preparation data-preprocessing summary-statistics bioinformatics-tool computational-biology gwas-summary-statistics

Created 2021-09-22

63 commits to master branch, last one 2 years ago