4 results found Sort:

NVIDIA
NeMo-Curator NVIDIA
125
889
apache-2.0
14
Scalable data pre processing and curation toolkit for LLMs
llm data python llmapps data-prep datarecipes fine-tuning data-quality datacuration data-curation deduplication data-processing data-preparation llm-data-quality fast-data-processing large-language-models semantic-deduplication data-processing-pipelines large-scale-data-processing
Created 2024-03-14
347 commits to main branch, last one 8 hours ago
data-prep-kit
data-prep-kit data-prep-kit
195
630
apache-2.0
19
Open source project for data preparation of LLM application builders
llm ray data spark python llmapps malware data-prep finetuning datarecipes code-quality datacuration deduplication data-preparation data-preprocessing large-language-models large-scale-data-processing data-preprocessing-pipelines
Created 2024-04-08
5,278 commits to dev branch, last one 6 hours ago
chapmanjacobd
library chapmanjacobd
13
425
bsd-3-clause
8
99+ CLI tools to build, browse, and blend your media library
cli mpv files media music ffmpeg sqlite videos yt-dlp ffprobe folders curation playlist gallery-dl command-line datacuration broadcatching datasette-tool data-collection qbittorrent-nox
Created 2021-12-05
2,333 commits to main branch, last one 3 days ago
WDscholia
scholia WDscholia
82
234
gpl-3.0
15
Wikidata-based scholarly profiles
latex bibtex sparql dataviz code4lib fairdata wikicite wikidata citations literature bibliography datacuration bibliometrics hacktoberfest scientometrics linked-open-data
Created 2016-10-09
3,618 commits to main branch, last one a day ago