54 results found Sort:
- Filter by Primary Language:
- Python (29)
- Jupyter Notebook (5)
- Go (3)
- TypeScript (2)
- HTML (2)
- JavaScript (2)
- Rust (2)
- Scala (2)
- TSQL (1)
- Clojure (1)
- Shell (1)
- Java (1)
- Ruby (1)
- +
No-code LLM Platform to launch APIs and ETL Pipelines to structure unstructured documents
Created
2024-02-21
977 commits to main branch, last one a day ago
Build data pipelines, the easy way 🛠️
Created
2020-05-21
9,688 commits to master branch, last one about a year ago
Make stream processing easier! Easy-to-use streaming application development framework and operation platform.
Created
2019-05-27
1,991 commits to dev branch, last one 3 days ago
Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.
Created
2023-02-23
1,748 commits to main branch, last one 4 days ago
Implementing best practices for PySpark ETL jobs and applications.
Created
2017-12-28
36 commits to master branch, last one 3 years ago
Few projects related to Data Engineering including Data Modeling, Infrastructure setup on cloud, Data Warehousing and Data Lake development.
Created
2020-01-20
80 commits to master branch, last one 5 years ago
An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.
Created
2020-02-13
50 commits to master branch, last one 5 years ago
A scalable general purpose micro-framework for defining dataflows. THIS REPOSITORY HAS BEEN MOVED TO www.github.com/dagworks-inc/hamilton
This repository has been archived
(exclude archived)
Created
2020-05-26
516 commits to main branch, last one about a year ago
Enterprise-grade and API-first LLM workspace for unstructured documents, including data extraction, redaction, rights management, prompt playground, and more!
Created
2022-10-24
1,243 commits to main branch, last one a day ago
A Clojure high performance data processing system
Created
2019-02-14
1,758 commits to master branch, last one 14 days ago
A blazingly fast general purpose blockchain analytics engine specialized in systematic mev detection
Created
2023-07-11
5,096 commits to main branch, last one about a month ago
Integrate LLM in any pipeline - fit/predict pattern, JSON driven flows, and built in concurency support.
Created
2025-01-16
162 commits to main branch, last one 24 days ago
A simplified, lightweight ETL Framework based on Apache Spark
Created
2017-10-10
658 commits to master branch, last one 2 years ago
Pythonic Stream-like manipulation of iterables
Created
2023-07-23
675 commits to main branch, last one 2 days ago
An end-to-end data engineering pipeline that orchestrates data ingestion, processing, and storage using Apache Airflow, Python, Apache Kafka, Apache Zookeeper, Apache Spark, and Cassandra. All compone...
Created
2023-09-06
5 commits to main branch, last one about a month ago
A simple Spark-powered ETL framework that just works 🍺
Created
2019-12-20
627 commits to master branch, last one 2 years ago
Jayvee is a domain-specific language and runtime for automated processing of data pipelines
Created
2022-10-06
2,235 commits to main branch, last one 23 days ago
This is a template you can use for your next data engineering portfolio project.
Created
2021-09-10
3 commits to main branch, last one 3 years ago
Service for bulk-loading data to databases with automatic schema management (Redshift, Snowflake, BigQuery, ClickHouse, Postgres, MySQL)
Created
2022-06-22
765 commits to main branch, last one 23 hours ago
The goal of this project is to track the expenses of Uber Rides and Uber Eats through data Engineering processes using technologies such as Apache Airflow, AWS Redshift and Power BI.
Created
2021-04-15
247 commits to main branch, last one 2 years ago
Regular practice on Data Science, Machien Learning, Deep Learning, Solving ML Project problem, Analytical Issue. Regular boost up my knowledge. The goal is to help learner with learning resource on Da...
Created
2020-09-06
206 commits to master branch, last one 2 years ago
Data pipelines from re-usable components
Created
2020-05-19
253 commits to master branch, last one 2 years ago
Move your data with ease.
Created
2023-06-19
561 commits to main branch, last one 6 months ago
A comprehensive guide to building a modern data warehouse with SQL Server, including ETL processes, data modeling, and analytics.
Created
2024-12-30
74 commits to main branch, last one 2 days ago
an app engine for your business. Seamlessly implement business logic with a powerful API. Out of the box CMS, blog, forum and email functionality. Developer friendly & easily extendable for your next ...
Created
2021-04-03
1,082 commits to master branch, last one 4 months ago
This repository will help you to learn about databricks concept with the help of examples. It will include all the important topics which we need in our real life experience as a data engineer. We wil...
Created
2022-05-10
45 commits to master branch, last one 2 years ago
SEO dashboard from Search console Data using the Google Search API, Mysql database , NodeJS RESTAPI( ExpressJS) and reactJs Dashboard
Created
2019-05-27
61 commits to master branch, last one 2 years ago
Watchmen Platform is a low code data platform for data pipeline, meta data management , analysis, and quality management
Created
2020-08-27
1,092 commits to master branch, last one 2 years ago
Build super simple end-to-end data & ETL pipelines for your vector databases and Generative AI applications
Created
2024-07-29
64 commits to main branch, last one 5 months ago
Prism is the easiest way to develop, orchestrate, and execute data pipelines in Python.
Created
2022-07-21
673 commits to main branch, last one about a year ago