5 results found Sort:

AlexIoannides
pyspark-example-project AlexIoannides
712
1.7k
unknown
54
Implementing best practices for PySpark ETL jobs and applications.
etl spark python etl-job pyspark data-science etl-pipeline data-engineering
Created 2017-12-28
36 commits to master branch, last one 3 years ago
san089
goodreads_etl_pipeline san089
214
1.3k
mit
25
An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.
s3 livy spark python airflow etl-job redshift data-lake scheduler warehouse airflow-dag emr-cluster apache-spark etl-pipeline etl-framework apache-airflow data-migration data-engineering goodreads-data-pipeline data-engineering-pipeline
Created 2020-02-13
50 commits to master branch, last one 4 years ago
paillave
Etl.Net paillave
96
690
mit
16
Mass processing data with a complete ETL for .net developers
csv etl load sftp dotnet etl-job extract transform csv-parser csv-reader csv-writer dotnet-core dotnet-standard entity-framework business-intelligence
Created 2018-06-23
904 commits to master branch, last one 23 hours ago
jbogard
bulk-writer jbogard
37
239
mit
37
Provides guidance for fast ETL jobs, an IDataReader implementation for SqlBulkCopy (or the MySql or Oracle equivalents) that wraps an IEnumerable, and libraries for mapping entites to table columns.
etl sql etl-job pipeline bulk-writer sqlbulkcopy stream-data pipeline-stage
Created 2014-03-02
245 commits to master branch, last one 6 months ago
visiologyofficial
vixtract visiologyofficial
13
44
bsd-3-clause
8
This repository has no description...
etl etl-job etl-pipeline etl-framework etl-automation etl-components
Created 2020-07-03
86 commits to master branch, last one about a month ago