56 results found Sort:

684
8.9k
agpl-3.0
85
The standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.
Created 2018-05-11
1,629 commits to master branch, last one 7 days ago
539
5.1k
apache-2.0
260
Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.
Created 2019-10-21
4,190 commits to master branch, last one a day ago
332
3.6k
unknown
45
Redpanda Console is a developer-friendly UI for managing your Kafka/Redpanda workloads. Console gives you a simple, interactive approach for gaining visibility into your topics, masking data, managing...
Created 2019-09-29
3,770 commits to master branch, last one 16 hours ago
175
3.4k
apache-2.0
38
Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckD...
Created 2022-07-07
1,593 commits to main branch, last one 12 hours ago
118
2.6k
apache-2.0
32
An open-source data logging library for machine learning models and data pipelines. 📚 Provides visibility into data quality & model performance over time. 🛡️ Supports privacy-preserving data collect...
Created 2020-08-14
882 commits to mainline branch, last one 2 days ago
328
2.0k
apache-2.0
50
Kafka Docker for development. Kafka, Zookeeper, Schema Registry, Kafka-Connect, Landoop Tools, 20+ connectors
Created 2016-08-19
570 commits to fdd/main branch, last one 17 days ago
146
1.8k
apache-2.0
9
The dbt-native data observability solution for data & analytics engineers. Monitor your data pipelines in minutes. Available as self-hosted or cloud service with premium features.
Created 2021-08-30
4,869 commits to master branch, last one 2 days ago
385
1.7k
apache-2.0
53
Cloud Native DataOps & AIOps Platform | 云原生数智运维平台
Created 2022-03-16
1,466 commits to main branch, last one 8 months ago
145
1.6k
mit
14
Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.
Created 2021-06-21
11,367 commits to main branch, last one 15 hours ago
111
1.4k
apache-2.0
18
Efficient data transformation and modeling framework that is backwards compatible with dbt.
Created 2022-09-23
2,456 commits to main branch, last one 17 hours ago
204
913
apache-2.0
42
Support agile DataOps Based on Flink, DataX and Flink-CDC, Chunjun with Web-UI
Created 2019-01-23
1,063 commits to master branch, last one 3 days ago
153
737
apache-2.0
18
Optimus is an easy-to-use, reliable, and performant workflow orchestrator for data transformation, data modeling, pipelines, and data quality management.
Created 2021-03-22
487 commits to main branch, last one 10 months ago
85
619
bsd-3-clause
35
Open source security data pipelines.
Created 2010-09-23
20,926 commits to main branch, last one 18 hours ago
📙 Awesome Data Catalogs and Observability Platforms.
Created 2021-07-14
90 commits to main branch, last one 8 months ago
A list of tools for annotating data, managing annotations, etc.
Created 2018-11-08
87 commits to master branch, last one about a year ago
DataOps for the Modern Data Warehouse on Microsoft Azure. https://aka.ms/mdw-dataops.
Created 2019-12-06
437 commits to main branch, last one 8 days ago
43
493
apache-2.0
14
Engine for ML/Data tracking, visualization, explainability, drift detection, and dashboards for Polyaxon.
Created 2016-03-25
9,955 commits to master branch, last one 15 days ago
54
413
apache-2.0
16
One framework to develop, deploy and operate data workflows with Python and SQL.
Created 2021-07-20
2,131 commits to main branch, last one a day ago
98
341
apache-2.0
10
Open data platform based on Kubernetes. Scaleph supports SeaTunnel、Flink and Doris backended by SeaTunnel on Flink engine、Flink Kubernetes Operator and Doris operator.
Created 2022-04-23
864 commits to dev branch, last one 2 days ago
52
313
apache-2.0
15
Firehose is an extensible, no-code, and cloud-native service to load real-time streaming data from Kafka to data stores, data lakes, and analytical storage systems.
Created 2021-01-29
529 commits to main branch, last one 10 months ago
Power BI DevOps & Source Control Tool
Created 2020-05-31
615 commits to main branch, last one 4 months ago
15
288
apache-2.0
9
Snowflake infrastructure-as-code. Provision environments, automate deploys, CI/CD. Manage RBAC, users, roles, and data access. Declarative Python Resource API. Change Management tool for the Snowflake...
Created 2023-05-13
112 commits to main branch, last one 23 days ago
A Python library that enables ML teams to share, load, and transform data in a collaborative, flexible, and efficient way :chestnut:
Created 2022-02-11
128 commits to main branch, last one 23 days ago
41
257
apache-2.0
16
Dagger is an easy-to-use, configuration over code, cloud-native framework built on top of Apache Flink for stateful processing of real-time streaming data.
Created 2021-03-22
825 commits to main branch, last one 10 months ago
20
247
apache-2.0
9
An open source development framework to help you build data workflows and modern data architecture on AWS.
Created 2022-02-16
527 commits to main branch, last one 3 days ago
30
236
apache-2.0
14
Frontier is an all-in-one user management platform that provides identity, access and billing management to help organizations secure their systems and data. (Open source alternative to Clerk)
Created 2021-02-26
856 commits to main branch, last one 2 days ago
41
215
apache-2.0
32
Stencil is a schema registry that provides schema management and validation dynamically, efficiently, and reliably to ensure data compatibility across applications.
Created 2019-02-16
311 commits to main branch, last one 2 months ago
29
187
apache-2.0
14
Raccoon is a high-throughput, low-latency service to collect events in real-time from your web, mobile apps, and services using multiple network protocols.
Created 2021-03-22
189 commits to main branch, last one 8 days ago
38
172
apache-2.0
9
Meteor is an easy-to-use, plugin-driven metadata collection framework to extract data from different sources and sink to any data catalog.
Created 2021-03-22
354 commits to main branch, last one 2 days ago
Resources for video demonstrations and blog posts related to DataOps on AWS
Created 2021-11-07
107 commits to main branch, last one 2 years ago