62 results found Sort:

infiniflow
ragflow infiniflow
2.2k
22.0k
apache-2.0
128
RAGFlow is an open-source RAG (Retrieval-Augmented Generation) engine based on deep document understanding.
llm nlp rag agent genai graph agents chatbot chatgpt graphrag text2sql ai-search pdf-to-text deep-learning preprocessing data-pipelines document-parser document-understanding table-structure-recognition retrieval-augmented-generation
Created 2023-12-12
1,535 commits to main branch, last one 18 hours ago
Unstructured-IO
unstructured Unstructured-IO
743
9.0k
apache-2.0
59
Open source libraries and APIs to build custom preprocessing pipelines for labeling, training, or production machine learning pipelines.
ml llm nlp ocr pdf docx donut langchain pdf-to-json pdf-to-text deep-learning preprocessing data-pipelines document-parser document-parsing machine-learning information-retrieval document-image-analysis document-image-processing natural-language-processing
Created 2022-09-26
1,613 commits to main branch, last one 6 days ago
dongrixinyu
JioNLP dongrixinyu
404
3.4k
apache-2.0
34
中文 NLP 预处理、解析工具包，准确、高效、易用 A Chinese NLP Preprocessing & Parsing Package www.jionlp.com
ner nlp python apache2 chinese nlp-parse time-parse time-parsing preprocessing natural-language-processing
Created 2020-03-13
540 commits to master branch, last one 10 days ago
nidhaloff
igel nidhaloff
172
3.1k
mit
66
a delightful machine learning tool that allows you to train, test, and use models without writing code
automl sklearn automation data-science scikit-learn data-analysis hacktoberfest preprocessing neural-network machinelearning neural-networks machine-learning hacktoberfest2021 automl-experiments artificial-intelligence machine-learning-library machine-learning-algorithms scikitlearn-machine-learning
Created 2020-08-27
429 commits to master branch, last one about a year ago
OpenGene
fastp OpenGene
334
1.9k
mit
50
An ultra-fast all-in-one FASTQ preprocessor (QC/adapters/trimming/filtering/splitting/merging...)
qc ngs umi fastq polyg filter adapter merging overlap quality illumina trimming filtering splitting sequencing duplication preprocessing bioinformatics quality-control
Created 2017-10-31
453 commits to master branch, last one 26 days ago
AxeldeRomblay
MLBox AxeldeRomblay
274
1.5k
other
65
MLBox is a powerful Automated Machine Learning python library.
drift keras automl kaggle auto-ml xgboost encoding lightgbm pipeline stacking prediction regression distributed data-science optimization deep-learning preprocessing classification machine-learning automated-machine-learning
Created 2017-06-01
1,121 commits to master branch, last one 4 years ago
winedarksea
AutoTS winedarksea
100
1.1k
mit
22
Automated Time Series Forecasting
automl autots forecasting time-series deep-learning preprocessing machine-learning feature-engineering
Created 2019-11-26
787 commits to master branch, last one 3 months ago
NVIDIA-Merlin
NVTabular NVIDIA-Merlin
143
1.0k
apache-2.0
34
NVTabular is a feature engineering and preprocessing library for tabular data designed to quickly and easily manipulate terabyte scale datasets used to train deep learning based recommender systems.
gpu nvidia deep-learning preprocessing machine-learning feature-selection recommender-system feature-engineering recommendation-system
Created 2020-04-03
1,075 commits to main branch, last one 2 months ago
KinWaiCheuk
nnAudio KinWaiCheuk
89
1.0k
mit
18
Audio processing by using pytorch 1D convolution network
stft pytorch spectrogram preprocessing 1d-convolution melspectrogram neural-network cqt-spectrogram audio-processing spectrogram-conversion-toolbox
Created 2019-09-02
305 commits to master branch, last one 8 months ago
sunlabuiuc
PyHealth sunlabuiuc
211
973
mit
33
A Deep Learning Python Toolkit for Healthcare Applications.
healthcare data-mining medical-code clinical-data deep-learning preprocessing clinical-research electronic-health-record electronic-medical-record
Created 2020-08-03
742 commits to master branch, last one 6 months ago
TheAlgorithms
R TheAlgorithms
295
873
mit
68
Collection of various algorithms implemented in R.
r learning practice algorithm education algorithms clustering r-language regression data-mining hacktoberfest preprocessing r-programming classification datamanipulation machine-learning
Created 2018-09-23
286 commits to master branch, last one 9 hours ago
pytorch
torcharrow pytorch
79
648
bsd-3-clause
24
High performance model preprocessing library on PyTorch
python pytorch preprocessing
This repository has been archived (exclude archived)
Created 2021-09-27
439 commits to main branch, last one about a year ago
R1j1t
contextualSpellCheck R1j1t
66
409
mit
10
✔️Contextual word checker for better suggestions
nlp oov bert spacy python chatbot spellcheck help-wanted spellchecker preprocessing spacy-extension spelling-correction spelling-corrections python-spelling-corrector natural-language-processing
Created 2020-04-10
183 commits to master branch, last one about a year ago
msamogh
nonechucks msamogh
27
376
mit
3
Deal with bad samples in your dataset dynamically, use Transforms as Filters, and more!
torch pytorch data-cleaning data-pipeline preprocessing data-processing machine-learning data-preprocessing
Created 2018-10-05
30 commits to master branch, last one 3 years ago
qd-cae
awesome-CAE qd-cae
103
374
unknown
41
A curated list of awesome CAE frameworks, libraries and software.
cae cfd fem tools abaqus ls-dyna libraries scripting collection preprocessing
Created 2016-08-21
36 commits to master branch, last one 2 months ago
DataCanvasIO
HyperGBM DataCanvasIO
46
334
apache-2.0
15
A full pipeline AutoML tool for tabular data
gbm dask automl sklearn xgboost catboost lightgbm rapidsai datacleaning fullpipeline tabular-data preprocessing pseudo-labeling dask-distributed gpu-acceleration ensemble-learning distributed-training adversarial-validation semi-supervised-learning
Created 2020-10-22
763 commits to main branch, last one 4 months ago
ikegami-yukino
jaconv ikegami-yukino
28
314
mit
10
Pure-Python Japanese character interconverter for Hiragana, Katakana, Hankaku, and Zenkaku
julius pure-python japanese-kana preprocessing text-processing transliteration japanese-language character-converter
Created 2016-04-02
132 commits to master branch, last one 2 months ago
cylondata
cylon cylondata
48
298
apache-2.0
19
Cylon is a fast, scalable, distributed memory, parallel runtime with a Pandas like DataFrame.
mpi data join shuffle dataframe deep-learning preprocessing dataframes-api
Created 2019-10-10
1,307 commits to main branch, last one 11 months ago
ikegami-yukino
neologdn ikegami-yukino
20
273
apache-2.0
7
Japanese text normalizer for mecab-neologd
nlp preprocessing japanese-language text-normalization mecab-ipadic-neologd
Created 2015-07-21
103 commits to master branch, last one 6 months ago
Razor12911
xtool Razor12911
24
235
mit
1
Just some tool repackers like to use...
archiving repacking encryption compression preprocessing precompression
This repository has been archived (exclude archived)
Created 2022-01-09
29 commits to main branch, last one about a year ago
dunky11
voicesmith dunky11
32
221
apache-2.0
13
[WIP] VoiceSmith makes training text to speech models easy.
tts toolkit univnet delightfultts preprocessing voice-cloning text-to-speech dataset-manager speech-synthesis
Created 2022-05-17
238 commits to main branch, last one 2 years ago
jbusecke
xMIP jbusecke
44
199
apache-2.0
10
Analysis ready CMIP6 data in python the easy way with pangeo tools.
xgcm cmip6 pangeo cmip6-data preprocessing climate-models climate-analysis analysis-ready-data
Created 2019-10-16
615 commits to main branch, last one 4 months ago
google
tensorflow-recorder google
33
183
apache-2.0
9
TFRecorder makes it easy to create TensorFlow records (TFRecords) from Pandas DataFrames and CSVs files containing images or structured data.
tfrecords tensorflow apache-beam preprocessing image-processing tensorflow-recorder
This repository has been archived (exclude archived)
Created 2020-07-24
128 commits to main branch, last one 3 years ago
jaeho3690
LIDC-IDRI-Preprocessing jaeho3690
43
163
unknown
4
This is the preprocessing step of the LIDC-IDRI dataset
npy lung lidc-idri lidc-dataset preprocessing lidc-preprocessing
Created 2020-04-24
30 commits to master branch, last one 4 years ago
ropensci
MODIStsp ropensci
50
154
gpl-3.0
15
An "R" package for automatic download and preprocessing of MODIS Land Products Time Series
r gdal modis rstats r-package modis-data time-series peer-reviewed preprocessing remote-sensing satellite-imagery modis-land-products
Created 2014-07-09
1,619 commits to master branch, last one 3 months ago
githubharald
DeslantImg githubharald
38
146
mit
9
The deslanting algorithm sets text upright in images. Python, C++ and OpenCL implementations provided.
gpu ocr opencl opencv python c-plus-plus preprocessing image-processing handwriting-recognition
Created 2018-01-25
34 commits to master branch, last one 2 years ago
mlr-org
mlr3pipelines mlr-org
25
140
lgpl-3.0
18
Dataflow Programming for Machine Learning in R
r mlr3 bagging stacking pipelines r-package data-science preprocessing machine-learning ensemble-learning dataflow-programming
Created 2017-10-10
3,214 commits to master branch, last one 10 days ago
autoreject
autoreject autoreject
58
138
bsd-3-clause
12
Automated rejection and repair of bad trials/sensors in M/EEG
meg mne-python preprocessing cross-validation electroencephalography magnetoencephalography
Created 2016-05-23
564 commits to main branch, last one 2 months ago
sappelhoff
pyprep sappelhoff
34
136
mit
8
PyPREP: A Python implementation of the Preprocessing Pipeline (PREP) for EEG data
eeg mne data python artifact neuroimaging neuroscience preprocessing electroencephalogaphy
Created 2018-04-12
386 commits to main branch, last one 9 days ago
basf
mamba-tabular basf
6
127
mit
7
Mambular is a Python package that brings the power of Mamba architectures to tabular data, offering a suite of deep learning models for regression, classification, and distributional regression tasks....
ple rnn ssm mamba resnet tabular regression deeplearning preprocessing classification ft-transformer tabtransformer tabular-learning state-space-models tabular-deep-learning periodic-linear-encoding distributional-regression
Created 2024-05-03
422 commits to master branch, last one 16 days ago