88 results found Sort:

628
10.3k
mit
112
A collection of handy Bash One-Liners and terminal tricks for data processing and Linux system maintenance.
Created 2016-06-14
520 commits to master branch, last one 2 months ago
217
9.0k
other
71
Miller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON
Created 2015-05-03
8,946 commits to main branch, last one a day ago
136
7.2k
mit
31
Select, put and delete data from JSON, TOML, YAML, XML and CSV files with a single tool. Supports conversion between formats and can be used as a Go package.
Created 2020-09-22
710 commits to master branch, last one about a month ago
622
5.2k
apache-2.0
93
A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep learning training and inference applications.
Created 2018-06-01
3,730 commits to main branch, last one a day ago
139
4.3k
other
29
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
Created 2022-11-27
867 commits to main branch, last one 18 hours ago
311
3.4k
mit
20
A light-weight, flexible, and expressive statistical data testing library
Created 2018-11-01
779 commits to main branch, last one 8 days ago
161
2.4k
apache-2.0
47
Concurrent and multi-stage data ingestion and data processing with Elixir
Created 2018-11-05
398 commits to main branch, last one 11 days ago
374
2.4k
apache-2.0
79
Toolkit for Machine Learning, Natural Language Processing, and Text Generation, in TensorFlow. This is part of the CASL project: http://casl-project.ai/
Created 2017-07-22
1,719 commits to master branch, last one 4 years ago
340
2.4k
mit
55
Large-scale pretraining for dialogue
Created 2019-08-29
83 commits to master branch, last one 2 years ago
146
1.6k
apache-2.0
58
Extract Transform Load for Python 3.5+
Created 2016-12-09
981 commits to develop branch, last one 3 years ago
64
1.6k
apache-2.0
18
Python Stream Processing
Created 2022-02-04
2,548 commits to main branch, last one 5 days ago
Source code accompanying book: Data Science on the Google Cloud Platform, Valliappa Lakshmanan, O'Reilly 2017
Created 2017-02-10
547 commits to main branch, last one about a year ago
115
1.3k
apache-2.0
22
Kubernetes-native platform to run massively parallel data/streaming jobs
Created 2022-05-20
1,148 commits to main branch, last one 19 hours ago
108
993
apache-2.0
21
Data and tools for generating and inspecting OLMo pre-training data.
Created 2023-06-20
349 commits to main branch, last one about a month ago
582
910
mit
3
A tool that uses advanced Monte Carlo simulations and Turbit parallel processing to create possible Bitcoin prediction scenarios.
Created 2024-08-02
6 commits to main branch, last one 3 months ago
113
857
mit
20
Large-scale pretrained models for goal-directed dialog
Created 2022-05-10
43 commits to main branch, last one about a year ago
Google Cloud Dataflow provides a simple, powerful model for building both batch and streaming parallel data processing pipelines.
This repository has been archived (exclude archived)
Created 2014-12-03
2,332 commits to master branch, last one 6 years ago
117
745
apache-2.0
25
Integrating the Best of TF into PyTorch, for Machine Learning, Natural Language Processing, and Text Generation. This is part of the CASL project: http://casl-project.ai/
Created 2019-03-08
496 commits to master branch, last one 2 years ago
55
708
bsd-3-clause
25
HStreamDB is an open-source, cloud-native streaming database for IoT and beyond. Modernize your data stack for real-time applications.
Created 2020-08-31
1,725 commits to main branch, last one about a month ago
42
685
gpl-3.0
27
Command line tool to download and extract data from HTML/XML pages or JSON-APIs, using CSS, XPath 3.0, XQuery 3.0, JSONiq or pattern matching. It can also create new or transformed XML/HTML/JSON docu...
Created 2015-06-11
753 commits to master branch, last one 7 months ago
35
658
other
10
Advanced and Fast Data Transformation in R
Created 2019-02-27
3,075 commits to master branch, last one 2 days ago
71
622
apache-2.0
4
All-in-one text de-duplication
Created 2021-03-13
363 commits to main branch, last one 6 months ago
163
579
unknown
31
A list about Apache Kafka
Created 2016-04-29
82 commits to master branch, last one 9 months ago
31
535
mit
16
👾~ music, eternal ~ 👾
Created 2019-01-17
346 commits to master branch, last one about a year ago
26
473
apache-2.0
19
Harmonious distributed data analysis in Rust.
Created 2018-10-17
550 commits to master branch, last one 3 years ago
209
455
agpl-3.0
37
Lineage metadata API, artifacts streams, sandbox, API, and spaces for Polyaxon
Created 2016-05-15
489 commits to master branch, last one a day ago
Deal with bad samples in your dataset dynamically, use Transforms as Filters, and more!
Created 2018-10-05
30 commits to master branch, last one 3 years ago
21
349
mit
19
PHP - ETL (Extract Transform Load) data processing library
Created 2020-10-26
909 commits to 1.x branch, last one 3 days ago