83 results found Sort:

1.6k
3.0k
apache-2.0
108
Apache Avro is a data serialization system.
Created 2009-05-21
4,564 commits to main branch, last one a day ago
57
2.3k
apache-2.0
21
Record Query - A tool for doing record analysis and transformation
Created 2016-02-20
564 commits to master branch, last one about a year ago
Confluent Schema Registry for Kafka
Created 2014-12-09
15,158 commits to master branch, last one a day ago
1.1k
1.9k
apache-2.0
242
Apache Kafka and Confluent Platform examples and demos
Created 2018-04-17
10,523 commits to 7.5.0-post branch, last one 2 months ago
162
1.4k
apache-2.0
21
What's in your data? Extract schema, statistics and entities from datasets
Created 2020-11-09
601 commits to main branch, last one 5 months ago
148
1.3k
mit
30
Avro for JavaScript :zap:
Created 2015-09-12
957 commits to master branch, last one about a month ago
More than 2000+ Data engineer interview questions.
Created 2021-08-08
18 commits to master branch, last one 3 months ago
264
1.1k
other
63
pmacct is a small set of multi-purpose passive network monitoring tools [NetFlow IPFIX sFlow libpcap BGP BMP RPKI IGP Streaming Telemetry].
Created 2015-12-13
5,311 commits to master branch, last one 6 hours ago
308
1.0k
apache-2.0
99
ADAM is a genomics analysis platform with specialized file formats built using Apache Avro, Apache Spark, and Apache Parquet. Apache 2 licensed.
Created 2013-11-19
2,033 commits to master branch, last one 29 days ago
79
829
apache-2.0
24
Command Line Tool for managing Apache Kafka
Created 2018-12-10
566 commits to main branch, last one 3 months ago
135
802
mit
49
ETL framework for .NET (Parser / Writer for CSV, Flat, Xml, JSON, Key-Value, Parquet, Yaml, Avro formatted files)
Created 2016-10-19
1,019 commits to master branch, last one 7 days ago
80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Functions, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML...
Created 2015-10-27
5,403 commits to master branch, last one about a month ago
238
719
apache-2.0
26
Avro schema generation and serialization / deserialization for Scala
Created 2015-09-16
1,562 commits to master branch, last one 6 months ago
Data Preview 🈸 extension for importing 📤 viewing 🔎 slicing 🔪 dicing 🎲 charting 📊 & exporting 📥 large JSON array/config, YAML, Apache Arrow, Avro, Parquet & Excel data files
Created 2018-12-12
696 commits to master branch, last one about a year ago
78
480
apache-2.0
15
Lightweight message bus interface for .NET (pub/sub and request-response) with transport plugins for popular message brokers.
Created 2016-05-19
647 commits to master branch, last one 3 days ago
60
479
apache-2.0
351
Iceberg is a table format for large, slow-moving tabular data
Created 2017-12-13
278 commits to master branch, last one 5 years ago
Web tool for Avro Schema Registry |
Created 2016-06-12
291 commits to master branch, last one 5 years ago
95
398
mit
6
A fast Go Avro codec
Created 2019-02-27
283 commits to main branch, last one 9 days ago
Flexible, Fast & Compact Serialization with RPC
Created 2020-01-08
224 commits to master branch, last one 2 years ago
246
346
apache-2.0
41
MongoDB Kafka Connector
Created 2019-04-26
551 commits to master branch, last one 17 hours ago
StorageTapper is a scalable realtime MySQL change data streaming, logical backup and logical replication service
Created 2017-05-07
250 commits to master branch, last one 2 years ago
55
341
apache-2.0
27
A tool for data sampling, data generation, and data diffing
Created 2016-08-01
723 commits to master branch, last one about a month ago
19
333
apache-2.0
13
Mu (μ) is a purely functional framework for building micro services.
This repository has been archived (exclude archived)
Created 2019-09-27
313 commits to master branch, last one about a year ago
🔗 A multipurpose Kafka Connect connector that makes it easy to parse, transform and stream any file, in any format, into Apache Kafka
Created 2019-02-15
790 commits to master branch, last one 3 days ago
A Gradle plugin to allow easily performing Java code generation for Apache Avro. It supports JSON schema declaration files, JSON protocol declaration files, and Avro IDL files.
This repository has been archived (exclude archived)
Created 2013-10-22
533 commits to master branch, last one 10 months ago
Uber-project for standard Jackson binary format backends: avro, cbor, ion, protobuf, smile
Created 2016-05-03
1,427 commits to 2.19 branch, last one 2 days ago
A cross-platform (Windows, MAC, Linux) desktop application to view common bigdata binary format like Parquet, ORC, AVRO, etc. Support local file system, HDFS, AWS S3, Azure Blob Storage ,etc.
Created 2020-02-05
119 commits to master branch, last one 7 months ago
70
234
apache-2.0
8
Golang Client for Schema Registry
Created 2019-07-25
156 commits to master branch, last one 3 months ago
Replicate data from MySQL, Postgres and MongoDB to ClickHouse®
Created 2022-03-21
2,619 commits to develop branch, last one 5 days ago
75
231
apache-2.0
17
Avro SerDe for Apache Spark structured APIs.
Created 2018-04-30
439 commits to master branch, last one 6 months ago