Trending repositories for topic airflow

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Apache DolphinScheduler is the modern data orchestration platform. Agile to create high performance workflow with low-code

Workflow Engine for Kubernetes

Run your dbt Core projects as Apache Airflow DAGs and Task Groups with a few lines of code

Build data pipelines, the easy way 🛠️

User friendly and open source platform for workflow creation and monitoring

A CLI tool to streamline getting started with Apache Airflow™ and managing multiple Airflow projects

Making DAG construction easier

Astro SDK allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.

User friendly and open source platform for workflow creation and monitoring

A CLI tool to streamline getting started with Apache Airflow™ and managing multiple Airflow projects

Run your dbt Core projects as Apache Airflow DAGs and Task Groups with a few lines of code

Making DAG construction easier

Astro SDK allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Apache DolphinScheduler is the modern data orchestration platform. Agile to create high performance workflow with low-code

Build data pipelines, the easy way 🛠️

Workflow Engine for Kubernetes

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Apache DolphinScheduler is the modern data orchestration platform. Agile to create high performance workflow with low-code

Workflow Engine for Kubernetes

Run your dbt Core projects as Apache Airflow DAGs and Task Groups with a few lines of code

A series of DAGs/Workflows to help maintain the operation of Airflow

Source code of the Apache Airflow Tutorial for Beginners on YouTube Channel Coder2j (https://www.youtube.com/c/coder2j)

Data Foundation - Google Cloud Cortex Framework

A CLI tool to streamline getting started with Apache Airflow™ and managing multiple Airflow projects

Personal Data Engineering Projects

Example end to end data engineering project.

Few projects related to Data Engineering including Data Modeling, Infrastructure setup on cloud, Data Warehousing and Data Lake development.

Elyra extends JupyterLab with an AI centric approach.

基于 Apache Airflow 的微信智能应用编排框架，通过可视化工作流驱动 AI 与数据自动化任务。支持 智能客服（多轮对话/知识库）、AI 图文/短视频生成、智能提醒等应用，灵活扩展多模态交互与大模型能力。

react-flow中文文档.

사용자가 채팅웹을 통해 자신이 처한 법률적 상황을 제시하면, 입력에 대한 문맥을 모델이 이해하여 가이드라인을 제시하고, 유사한 상황의 판례를 제공하는 웹 서비스입니다. (2023.08.18 서비스 종료)

This is a repository to demonstrate my details, skills, projects and to keep track of my progression in Data Analytics and Data Science topics.

Projects done in the Data Engineer Nanodegree Program by Udacity.com

User friendly and open source platform for workflow creation and monitoring

Making DAG construction easier

Astro SDK allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.

基于 Apache Airflow 的微信智能应用编排框架，通过可视化工作流驱动 AI 与数据自动化任务。支持 智能客服（多轮对话/知识库）、AI 图文/短视频生成、智能提醒等应用，灵活扩展多模态交互与大模型能力。

react-flow中文文档.

사용자가 채팅웹을 통해 자신이 처한 법률적 상황을 제시하면, 입력에 대한 문맥을 모델이 이해하여 가이드라인을 제시하고, 유사한 상황의 판례를 제공하는 웹 서비스입니다. (2023.08.18 서비스 종료)

Data Foundation - Google Cloud Cortex Framework

Source code of the Apache Airflow Tutorial for Beginners on YouTube Channel Coder2j (https://www.youtube.com/c/coder2j)

This is a repository to demonstrate my details, skills, projects and to keep track of my progression in Data Analytics and Data Science topics.

A CLI tool to streamline getting started with Apache Airflow™ and managing multiple Airflow projects

Projects done in the Data Engineer Nanodegree Program by Udacity.com

User friendly and open source platform for workflow creation and monitoring

Run your dbt Core projects as Apache Airflow DAGs and Task Groups with a few lines of code

Making DAG construction easier

Astro SDK allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.

Apache Airflow - OpenApi Client for Python

A series of DAGs/Workflows to help maintain the operation of Airflow

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Personal Data Engineering Projects

Example end to end data engineering project.

Apache DolphinScheduler is the modern data orchestration platform. Agile to create high performance workflow with low-code

Few projects related to Data Engineering including Data Modeling, Infrastructure setup on cloud, Data Warehousing and Data Lake development.

Elyra extends JupyterLab with an AI centric approach.

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Workflow Engine for Kubernetes

Apache DolphinScheduler is the modern data orchestration platform. Agile to create high performance workflow with low-code

Run your dbt Core projects as Apache Airflow DAGs and Task Groups with a few lines of code

More than 2000+ Data engineer interview questions.

Few projects related to Data Engineering including Data Modeling, Infrastructure setup on cloud, Data Warehousing and Data Lake development.

Example end to end data engineering project.

Curated list of resources about Apache Airflow

DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualizati...

基于 Apache Airflow 的微信智能应用编排框架，通过可视化工作流驱动 AI 与数据自动化任务。支持 智能客服（多轮对话/知识库）、AI 图文/短视频生成、智能提醒等应用，灵活扩展多模态交互与大模型能力。

Personal Data Engineering Projects

Elyra extends JupyterLab with an AI centric approach.

This is a repository to demonstrate my details, skills, projects and to keep track of my progression in Data Analytics and Data Science topics.

Projects done in the Data Engineer Nanodegree Program by Udacity.com

Dynamically generate Apache Airflow DAGs from YAML configuration files

Source code of the Apache Airflow Tutorial for Beginners on YouTube Channel Coder2j (https://www.youtube.com/c/coder2j)

A series of DAGs/Workflows to help maintain the operation of Airflow

TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and support for E2E production ML pipelines when you're ready.

User friendly and open source platform for workflow creation and monitoring

A CLI tool to streamline getting started with Apache Airflow™ and managing multiple Airflow projects

基于 Apache Airflow 的微信智能应用编排框架，通过可视化工作流驱动 AI 与数据自动化任务。支持 智能客服（多轮对话/知识库）、AI 图文/短视频生成、智能提醒等应用，灵活扩展多模态交互与大模型能力。

📈 A scalable, production-ready data pipeline for real-time streaming & batch processing, integrating Kafka, Spark, Airflow, AWS, Kubernetes, and MLflow. Supports end-to-end data ingestion, transforma...

This is a repository to demonstrate my details, skills, projects and to keep track of my progression in Data Analytics and Data Science topics.

Detailed notes and homeworks from 2025 Data Engineering Zoomcamp by Datatalks.Club

Produce Kafka messages, consume them and upload into Cassandra, MongoDB.

Projects done in the Data Engineer Nanodegree Program by Udacity.com

This repository contains code snippets, steps and other artifacts used in the youtube videos in the demo. You can use this to get access to the code or artifacts.

react-flow中文文档.

Nyc_Taxi_Data_Pipeline - DE Project

User friendly and open source platform for workflow creation and monitoring

End-to-end data platform: A PoC Data Platform project utilizing modern data stack (Spark, Airflow, DBT, Trino, Lightdash, Hive metastore, Minio, Postgres)

Run your dbt Core projects as Apache Airflow DAGs and Task Groups with a few lines of code

Data Foundation - Google Cloud Cortex Framework

A CLI tool to streamline getting started with Apache Airflow™ and managing multiple Airflow projects

Source code of the Apache Airflow Tutorial for Beginners on YouTube Channel Coder2j (https://www.youtube.com/c/coder2j)

An end-to-end LLM reference implementation providing a Q&A interface for Airflow and Astronomer

More than 2000+ Data engineer interview questions.

TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and support for E2E production ML pipelines when you're ready.

사용자가 채팅웹을 통해 자신이 처한 법률적 상황을 제시하면, 입력에 대한 문맥을 모델이 이해하여 가이드라인을 제시하고, 유사한 상황의 판례를 제공하는 웹 서비스입니다. (2023.08.18 서비스 종료)

Playground for Lakehouse (Iceberg, Hudi, Spark, Flink, Trino, DBT, Airflow, Kafka, Debezium CDC)

Nyc_Taxi_Data_Pipeline - DE Project

Arquitetura CRM de Baixo Custo com Gen AI, projetada para startups que precisam processar e analisar dados de vendas de forma eficiente.

react-flow中文文档.

Detailed notes and homeworks from 2025 Data Engineering Zoomcamp by Datatalks.Club

基于 Apache Airflow 的微信智能应用编排框架，通过可视化工作流驱动 AI 与数据自动化任务。支持 智能客服（多轮对话/知识库）、AI 图文/短视频生成、智能提醒等应用，灵活扩展多模态交互与大模型能力。

End-to-end data platform: A PoC Data Platform project utilizing modern data stack (Spark, Airflow, DBT, Trino, Lightdash, Hive metastore, Minio, Postgres)

Integrating Airbyte, Kafka, Airflow and MLflow on Azure Linux VMs within private network to continuously retrain LSTM Attention model with 1-minute stock prices and redeploy it on Azure ML AKS real-ti...

📈 A scalable, production-ready data pipeline for real-time streaming & batch processing, integrating Kafka, Spark, Airflow, AWS, Kubernetes, and MLflow. Supports end-to-end data ingestion, transforma...

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Apache DolphinScheduler is the modern data orchestration platform. Agile to create high performance workflow with low-code

Workflow Engine for Kubernetes

More than 2000+ Data engineer interview questions.

Run your dbt Core projects as Apache Airflow DAGs and Task Groups with a few lines of code

Few projects related to Data Engineering including Data Modeling, Infrastructure setup on cloud, Data Warehousing and Data Lake development.

Example end to end data engineering project.

A data engineering project with Kafka, Spark Streaming, dbt, Docker, Airflow, Terraform, GCP and much more!

Curated list of resources about Apache Airflow

DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualizati...

Personal Data Engineering Projects

Dynamically generate Apache Airflow DAGs from YAML configuration files

Simple but powerful DAG scheduler and dashboard

An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.

Elyra extends JupyterLab with an AI centric approach.

Beginner data engineering project - batch edition

A series of DAGs/Workflows to help maintain the operation of Airflow

🌀 𝗧𝗵𝗲 𝗙𝘂𝗹𝗹 𝗦𝘁𝗮𝗰𝗸 𝟳-𝗦𝘁𝗲𝗽𝘀 𝗠𝗟𝗢𝗽𝘀 𝗙𝗿𝗮𝗺𝗲𝘄𝗼𝗿𝗸 | 𝗟𝗲𝗮𝗿𝗻 𝗠𝗟𝗘 & 𝗠𝗟𝗢𝗽𝘀 for free by designing, building and deploying an end-to-end ML batch system ~ 𝘴𝘰𝘶𝘳𝘤𝘦 𝘤...

Nyc_Taxi_Data_Pipeline - DE Project

Build data pipelines, the easy way 🛠️

This is a repository to demonstrate my details, skills, projects and to keep track of my progression in Data Analytics and Data Science topics.

A Practical Guide to a Simple Data Stack.

react-flow中文文档.

A portable Datamart and Business Intelligence suite built with Docker, Airflow, dbt, PostgreSQL and Superset

A Python package that creates fine-grained dbt tasks on Apache Airflow

🪐 1-click Kubeflow using ArgoCD

Full-stack Highly Scalable Cloud-native Machine Learning system for demand forecasting with realtime data streaming, inference, retraining loop, and more

Dockerized monitoring stack for Apache Airflow

This repository serves as a comprehensive guide to effective data modeling and robust data quality assurance using popular open-source tools

End-to-end data platform leveraging the Modern data stack

User friendly and open source platform for workflow creation and monitoring

Run your dbt Core projects as Apache Airflow DAGs and Task Groups with a few lines of code

Playground for Lakehouse (Iceberg, Hudi, Spark, Flink, Trino, DBT, Airflow, Kafka, Debezium CDC)

Projects done in the Data Engineer Nanodegree Program by Udacity.com

Sync DAG changes from Git to Airflow

Arquitetura CRM de Baixo Custo com Gen AI, projetada para startups que precisam processar e analisar dados de vendas de forma eficiente.

HashiQube - The Ultimate Hands on DevOps Lab running All the HashiCorp Products in a Github Codespace or a Docker Container using Vagrant or Docker Compose

Built a real-time streaming pipeline to extract stock data, using Apache Nifi, Debezium, Kafka, and Spark Streaming. Loaded the transformed data into Glue database and created real-time dashboards usi...

📈 A scalable, production-ready data pipeline for real-time streaming & batch processing, integrating Kafka, Spark, Airflow, AWS, Kubernetes, and MLflow. Supports end-to-end data ingestion, transforma...

Distributed run of dbt models using Airflow