6 results found Sort:

iusztinpaul
energy-forecasting iusztinpaul
187
809
mit
14
🌀 𝗧𝗵𝗲 𝗙𝘂𝗹𝗹 𝗦𝘁𝗮𝗰𝗸 𝟳-𝗦𝘁𝗲𝗽𝘀 𝗠𝗟𝗢𝗽𝘀 𝗙𝗿𝗮𝗺𝗲𝘄𝗼𝗿𝗸 | 𝗟𝗲𝗮𝗿𝗻 𝗠𝗟𝗘 & 𝗠𝗟𝗢𝗽𝘀 for free by designing, building and deploying an end-to-end ML batch system ~ 𝘴𝘰𝘶𝘳𝘤𝘦 𝘤...
gcp cicd mlops docker poetry python sktime airflow fastapi hopsworks streamlit feature-store ml-monitoring github-actions model-registry data-versioning batch-processing 3-pipeline-design great-expectations weights-and-biases
Created 2023-02-04
391 commits to main branch, last one 2 months ago
adidas
lakehouse-engine adidas
36
196
apache-2.0
18
The Lakehouse Engine is a configuration driven Spark framework, written in Python, serving as a scalable and distributed engine for several lakehouse algorithms, data flows and utilities for Data Prod...
spark big-data framework lakehouse databricks delta-lake data-quality data-engineering great-expectations configuration-driven
Created 2022-11-11
13 commits to master branch, last one 12 days ago
josephmachado
data_engineering_best_practices josephmachado
21
142
unknown
6
Sample project to demonstrate data engineering best practices
etl minio spark pyspark delta-lake data-engineering great-expectations
Created 2023-08-04
16 commits to main branch, last one 4 months ago
GokuMohandas
testing-ml GokuMohandas
12
76
unknown
2
Learn how to create reliable ML systems by testing code, data and models.
mlops pytest testing machine-learning great-expectations
Created 2022-08-01
5 commits to main branch, last one about a year ago
provectus
data-quality-gate provectus
3
55
apache-2.0
9
Data Quality Gate based on AWS
s3 aws athena redshift terraform aws-lambda data-quality data-governance great-expectations
Created 2022-05-31
342 commits to main branch, last one 9 months ago
NatanMish
data_validation NatanMish
11
31
unknown
2
Tutorial for implementing data validation in data science pipelines
python pandera pydantic data-science data-validation machine-learning great-expectations
Created 2022-05-14
39 commits to main branch, last one about a year ago