15 results found Sort:

cleanlab
cleanlab cleanlab
800
10.2k
agpl-3.0
86
The standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.
llms dataops datasets labeling annotation dataquality data-quality data-science noisy-labels data-cleaning data-curation data-labeling data-profiling active-learning data-centric-ai data-validation weak-supervision outlier-detection exploratory-data-analysis out-of-distribution-detection
Created 2018-05-11
1,770 commits to master branch, last one 4 days ago
voxel51
fiftyone voxel51
606
9.3k
apache-2.0
65
Refine high-quality datasets and visual AI models
python data-quality data-science data-cleaning data-curation deep-learning vector-search visualization active-learning computer-vision data-centric-ai developer-tools machine-learning object-detection unstructured-data image-classification artificial-intelligence
Created 2020-04-22
22,938 commits to develop branch, last one 2 days ago
Docta-ai
docta Docta-ai
215
2.8k
other
128
A Doctor for your data
data rlhf data-curation data-diagnosis language-model data-centric-ai data-centric-machine-learning
Created 2023-05-02
33 commits to master branch, last one 2 months ago
visual-layer
fastdup visual-layer
79
1.7k
other
23
fastdup is a powerful, free tool designed to rapidly generate valuable insights from image and video datasets. It helps enhance the quality of both images and labels, while significantly reducing data...
image python dataset data-curation deep-learning visual-search visualization image-analysis image-processing image-similarity machine-learning object-detection data-augmentation novelty-detection outlier-detection image-classfication visualization-tools image-classification image-duplicate-detection
Created 2022-05-11
1,346 commits to main branch, last one 2 months ago
Renumics
spotlight Renumics
85
1.2k
mit
18
Interactively explore unstructured datasets from your dataframe.
audio video images meshes timeseries data-curation hacktoberfest computer-vision data-centric-ai machine-learning unstructured-data data-visualization exploratory-data-analysis
Created 2023-01-29
1,527 commits to main branch, last one 3 months ago
daochenzha
data-centric-AI daochenzha
78
1.1k
unknown
20
A curated, but incomplete, list of data-centric AI resources.
ai data-centric data-quality data-science data-curation data-centric-ai data-engineering machine-learning artificial-intelligence data-centric-machine-learning
Created 2023-03-07
69 commits to main branch, last one 8 months ago
NVIDIA
NeMo-Curator NVIDIA
113
822
apache-2.0
12
Scalable data pre processing and curation toolkit for LLMs
llm data python llmapps data-prep datarecipes fine-tuning data-quality datacuration data-curation deduplication data-processing data-preparation llm-data-quality fast-data-processing large-language-models semantic-deduplication data-processing-pipelines large-scale-data-processing
Created 2024-03-14
307 commits to main branch, last one a day ago
Renumics
awesome-open-data-centric-ai Renumics
35
712
cc-by-4.0
20
Curated list of open source tooling for data-centric AI on unstructured data.
nlp data-drift awesome-list noisy-labels data-curation deep-learning bias-detection explainable-ai feature-vector synthetic-data active-learning computer-vision data-centric-ai data-versioning machine-learning outlier-detection data-visualization documentation-only uncertainty-estimation robust-machine-learning
Created 2023-02-27
34 commits to main branch, last one about a year ago
getmetamapper
metamapper getmetamapper
6
79
bsd-2-clause
5
Metamapper is a data discovery and documentation platform for improving how teams understand and interact with their data.
django python metadata metamapper data-catalog data-curation data-discovery data-warehouse schema-inspection
Created 2020-06-10
201 commits to master branch, last one 2 years ago
Renumics
sliceguard Renumics
3
64
mit
5
A library for detecting problematic data segments in structured and unstructured data with few lines of code.
eda python data-science data-analysis data-cleaning data-curation deep-learning visualization data-exploration machine-learning data-visualization exploratory-data-analysis
Created 2023-06-14
404 commits to main branch, last one about a year ago
LaureBerti
Learn2Clean LaureBerti
19
51
bsd-3-clause
2
Learn2Clean: Optimizing the Sequence of Tasks for Data Preparation and Cleaning
automated data-cleaning data-curation data-preprocessing data-cleaning-pipeline reinforcement-learning
Created 2019-03-29
96 commits to master branch, last one 4 years ago
UCSC-REAL
DS2 UCSC-REAL
5
48
apache-2.0
3
[ICLR 2025] Improving Data Efficiency via Curating LLM-Driven Rating Systems
data-curation data-efficiency instruction-tuning large-language-models
Created 2025-02-11
110 commits to main branch, last one 2 days ago
x-CK-x
Dataset-Curation-Tool x-CK-x
7
37
gpl-3.0
2
A tool for downloading from public image boards (which allow scraping) / preview your images & tags / edit your images & tags. Additional tabs for downloading other desired code repositories as well a...
tagging downloader auto-tagger data-curation dataset-manager captioning-images captioning-videos imageboard-grabber
Created 2023-05-08
250 commits to main branch, last one about a month ago
iwangjian
TopDial iwangjian
1
30
apache-2.0
3
Target-oriented Proactive Dialogue Systems with Personalization: Problem Formulation and Dataset Curation (EMNLP 2023)
data-curation personalization dialogue-systems
Created 2023-07-03
15 commits to main branch, last one 10 months ago
Digital-Dermatology
SelfClean Digital-Dermatology
1
30
other
4
🧼🔎 A holistic self-supervised data cleaning strategy to detect irrelevant samples, near duplicates and label errors (NeurIPS'24).
neurips-2024 data-cleaning data-curation deep-learning data-centric-ai machine-learning self-supervised-learning
Created 2024-02-14
111 commits to main branch, last one 3 days ago