84 results found Sort:

1.6k
3.0k
apache-2.0
107
Apache Avro is a data serialization system.
Created 2009-05-21
4,575 commits to main branch, last one 2 days ago
57
2.3k
apache-2.0
21
Record Query - A tool for doing record analysis and transformation
Created 2016-02-20
564 commits to master branch, last one about a year ago
Confluent Schema Registry for Kafka
Created 2014-12-09
15,740 commits to master branch, last one a day ago
1.1k
1.9k
apache-2.0
245
Apache Kafka, Apache Flink and Confluent Platform examples and demos
Created 2018-04-17
11,329 commits to 7.8.0-post branch, last one 19 days ago
164
1.4k
apache-2.0
21
What's in your data? Extract schema, statistics and entities from datasets
Created 2020-11-09
601 commits to main branch, last one 6 months ago
148
1.3k
mit
30
Avro for JavaScript :zap:
Created 2015-09-12
957 commits to master branch, last one 2 months ago
More than 2000+ Data engineer interview questions.
Created 2021-08-08
18 commits to master branch, last one 4 months ago
264
1.1k
other
63
pmacct is a small set of multi-purpose passive network monitoring tools [NetFlow IPFIX sFlow libpcap BGP BMP RPKI IGP Streaming Telemetry].
Created 2015-12-13
5,321 commits to master branch, last one 2 days ago
311
1.0k
apache-2.0
98
ADAM is a genomics analysis platform with specialized file formats built using Apache Avro, Apache Spark, and Apache Parquet. Apache 2 licensed.
Created 2013-11-19
2,034 commits to master branch, last one 14 days ago
82
841
apache-2.0
24
Command Line Tool for managing Apache Kafka
Created 2018-12-10
588 commits to main branch, last one a day ago
136
807
mit
49
ETL framework for .NET (Parser / Writer for CSV, Flat, Xml, JSON, Key-Value, Parquet, Yaml, Avro formatted files)
Created 2016-10-19
1,025 commits to master branch, last one 22 days ago
80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Functions, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML...
Created 2015-10-27
5,410 commits to master branch, last one 29 days ago
239
721
apache-2.0
26
Avro schema generation and serialization / deserialization for Scala
Created 2015-09-16
1,576 commits to master branch, last one 19 days ago
Data Preview 🈸 extension for importing 📤 viewing 🔎 slicing 🔪 dicing 🎲 charting 📊 & exporting 📥 large JSON array/config, YAML, Apache Arrow, Avro, Parquet & Excel data files
Created 2018-12-12
696 commits to master branch, last one about a year ago
78
487
apache-2.0
15
Lightweight message bus interface for .NET (pub/sub and request-response) with transport plugins for popular message brokers.
Created 2016-05-19
648 commits to master branch, last one 26 days ago
59
478
apache-2.0
350
Iceberg is a table format for large, slow-moving tabular data
Created 2017-12-13
278 commits to master branch, last one 6 years ago
Web tool for Avro Schema Registry |
Created 2016-06-12
291 commits to master branch, last one 5 years ago
99
399
mit
6
A fast Go Avro codec
Created 2019-02-27
285 commits to main branch, last one 8 days ago
Flexible, Fast & Compact Serialization with RPC
Created 2020-01-08
224 commits to master branch, last one 2 years ago
249
349
apache-2.0
41
MongoDB Kafka Connector
Created 2019-04-26
554 commits to master branch, last one 11 days ago
StorageTapper is a scalable realtime MySQL change data streaming, logical backup and logical replication service
Created 2017-05-07
250 commits to master branch, last one 2 years ago
54
341
apache-2.0
27
A tool for data sampling, data generation, and data diffing
Created 2016-08-01
731 commits to master branch, last one 22 days ago
19
333
apache-2.0
13
Mu (μ) is a purely functional framework for building micro services.
This repository has been archived (exclude archived)
Created 2019-09-27
313 commits to master branch, last one about a year ago
🔗 A multipurpose Kafka Connect connector that makes it easy to parse, transform and stream any file, in any format, into Apache Kafka
Created 2019-02-15
790 commits to master branch, last one about a month ago
A Gradle plugin to allow easily performing Java code generation for Apache Avro. It supports JSON schema declaration files, JSON protocol declaration files, and Avro IDL files.
This repository has been archived (exclude archived)
Created 2013-10-22
533 commits to master branch, last one 12 months ago
Uber-project for standard Jackson binary format backends: avro, cbor, ion, protobuf, smile
Created 2016-05-03
1,438 commits to 2.19 branch, last one 11 days ago
A cross-platform (Windows, MAC, Linux) desktop application to view common bigdata binary format like Parquet, ORC, AVRO, etc. Support local file system, HDFS, AWS S3, Azure Blob Storage ,etc.
Created 2020-02-05
119 commits to master branch, last one 8 months ago
70
238
apache-2.0
9
Golang Client for Schema Registry
Created 2019-07-25
158 commits to master branch, last one 25 days ago
Replicate data from MySQL, Postgres and MongoDB to ClickHouse®
Created 2022-03-21
2,716 commits to develop branch, last one a day ago
76
232
apache-2.0
17
Avro SerDe for Apache Spark structured APIs.
Created 2018-04-30
439 commits to master branch, last one 7 months ago