20 results found Sort:

great-expectations
great_expectations great-expectations
1.5k
10.0k
apache-2.0
84
Always know what to expect from your data.
eda mlops pipeline cleandata datacleaner dataquality data-quality data-science datacleaning dataunittest pipeline-debt data-profilers data-profiling pipeline-tests data-unit-tests data-engineering pipeline-testing exploratory-analysis exploratorydataanalysis exploratory-data-analysis
Created 2017-09-11
12,817 commits to develop branch, last one a day ago
cleanlab
cleanlab cleanlab
751
9.8k
agpl-3.0
90
The standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.
llms dataops datasets labeling annotation dataquality data-quality data-science noisy-labels data-cleaning data-curation data-labeling data-profiling active-learning data-centric-ai data-validation weak-supervision outlier-detection exploratory-data-analysis out-of-distribution-detection
Created 2018-05-11
1,743 commits to master branch, last one 28 days ago
open-metadata
OpenMetadata open-metadata
1.1k
5.6k
apache-2.0
48
OpenMetadata is a unified metadata platform for data discovery, data observability, and data governance powered by a central metadata repository, in-depth column level lineage, and seamless team colla...
dbt metadata snowflake dataquality data-catalog data-lineage data-quality data-science datadiscovery hacktoberfest data-contracts data-discovery data-profiling data-governance data-validation dataengineering data-collaboration data-observability data-quality-checks metadata-management
Created 2021-08-01
10,941 commits to main branch, last one 17 hours ago
awslabs
deequ awslabs
539
3.3k
apache-2.0
81
Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.
scala spark dataquality unit-testing
Created 2018-08-07
267 commits to master branch, last one about a month ago
datafold
data-diff datafold
271
2.9k
mit
21
Compare tables within or across databases
dbt sql data mysql rdbms trino python database postgres snowflake postgresql dataquality data-diffing data-quality data-science databricks-sql dataengineering oracle-database data-engineering data-quality-monitoring
This repository has been archived (exclude archived)
Created 2022-03-07
1,932 commits to master branch, last one 6 months ago
sodadata
soda-core sodadata
209
1.9k
apache-2.0
12
:zap: Data quality testing for the modern data stack (SQL, Spark, and Pandas) https://www.soda.io
dbt python snowflake dataquality datatesting data-quality data-testing data-contracts data-profiling data-governance data-monitoring data-unit-tests data-validation data-engineering data-reliability pipeline-testing data-observability data-quality-checks data-quality-testing data-quality-monitoring
Created 2020-12-14
759 commits to main branch, last one 6 days ago
re-data
re-data re-data
121
1.6k
other
23
re_data - fix data issues before your users & CEO would discover them 😊
dbt dataquality data-quality data-testing dbt-packages data-analysis data-monitoring data-reliability data-observability data-quality-checks open-source-tooling data-quality-monitoring
Created 2020-11-02
503 commits to master branch, last one 6 months ago
zinggAI
zingg zinggAI
120
959
agpl-3.0
16
Scalable identity resolution, entity resolution, data mastering and deduplication using ML
ml etl spark dedupe datalake identity analytics fuzzymatch masterdata dataquality data-science deduplication fuzzy-matching dataengineering entity-resolution modern-data-stack data-transformation identity-resolution data-transformations analytics-engineering
Created 2021-08-25
2,218 commits to main branch, last one 19 hours ago
chaos-genius
chaos_genius chaos-genius
83
737
mit
11
ML powered analytics engine for outlier detection and root cause analysis.
ai ml alert python analytics monitoring dataquality seasonality time-series deep-learning hacktoberfest observability alert-messages monitoring-tool machine-learning anomaly-detection outlier-detection rootcauseanalysis data-visualization business-intelligence
This repository has been archived (exclude archived)
Created 2021-05-27
3,308 commits to main branch, last one 2 months ago
datacleaner
DataCleaner datacleaner
181
598
lgpl-3.0
63
The premier open source Data Quality solution
etl mdm data desktop database profiling datacleaner dataquality data-science data-analysis
Created 2014-02-20
6,796 commits to main branch, last one 4 days ago
datavane
datavines datavane
160
526
apache-2.0
13
Know your data better！Datavines is Next-gen Data Observability Platform, support metadata manage and data quality.
doris spark metadata dataprofile dataquality datascience dataobservability
Created 2022-04-02
356 commits to dev branch, last one 19 days ago
IBM
lale IBM
82
333
apache-2.0
23
Library for Semi-Automated Data Science
automl python dataquality data-science ibm-research scikit-learn pipeline-tests ibm-research-ai interoperability machine-learning pipeline-testing hyperparameter-search hyperparameter-tuning artificial-intelligence automated-machine-learning hyperparameter-optimization
Created 2019-08-06
1,492 commits to master branch, last one 2 months ago
canimus
cuallee canimus
20
174
apache-2.0
8
Possibly the fastest DataFrame-agnostic quality check library in town.
pandas bigdata pydeequ pyspark python3 snowpark dataquality data-quality unit-testing data-quality-checks performance-metrics
Created 2021-10-05
581 commits to main branch, last one a day ago
datachecks
dcs-core datachecks
20
144
apache-2.0
2
Open Source Data Quality Monitoring.
etl sql mlops mysql python dataops metrics data-ops database postgres monitoring postgresql dataquality elasticsearch data-governance data-validation data-engineering data-observability data-quality-monitor data-quality-monitoring
Created 2023-07-15
174 commits to main branch, last one 6 days ago
AutoViML
pandas_dq AutoViML
11
127
apache-2.0
5
Find data quality issues and clean your data in a single line of code with a Scikit-Learn compatible Transformer.
data pandas python dataquality data-science scikit-learn dataqualitycheck machine-learning
Created 2023-04-02
30 commits to main branch, last one 11 months ago
OSMCha
osmcha-frontend OSMCha
38
124
isc
102
Frontend for the osmcha-django REST API
qa osm osmcha dataquality openstreetmap
Created 2017-04-04
1,116 commits to main branch, last one 14 days ago
DataKitchen
data-observability-installer DataKitchen
7
88
apache-2.0
4
Installer for DataKitchen's Open Source Data Observability Products. Data breaks. Servers break. Your toolchain breaks. Ensure your team is the first to know and the first to solve with visibility acr...
data mssql dataops redshift snowflake postgresql datachecker datacleaner dataquality datatesting self-hosted data-quality data-science datacleaning data-profiling datavalidation pipeline-tests data-engineering data-reliability data-observability
Created 2024-04-18
80 commits to main branch, last one 7 days ago
schic
DQCS schic
30
46
lgpl-3.0
6
数据质量控制系统
etl data database dataquality
Created 2019-09-16
190 commits to master branch, last one 3 years ago
DataKitchen
dataops-testgen DataKitchen
2
44
apache-2.0
2
DataOps Data Quality TestGen is part of DataKitchen's Open Source Data Observability. DataOps TestGen delivers simple, fast data quality test generation and execution by data profiling,  new dataset...
data mssql python dataops redshift snowflake postgresql datachecker dataquality self-hosted data-quality data-science data-testing dataprofiling datavalidation data-engineering data-observability
Created 2024-04-17
249 commits to main branch, last one about a month ago
infinitelambda
dq-tools infinitelambda
10
40
apache-2.0
2
Make simple storing test results and visualisation of these in a BI dashboard
dbt package dataquality
Created 2023-01-12
49 commits to main branch, last one 6 days ago