62 results found Sort:

infiniflow
ragflow infiniflow
2.3k
23.3k
apache-2.0
133
RAGFlow is an open-source RAG (Retrieval-Augmented Generation) engine based on deep document understanding.
llm nlp rag agent genai graph agents chatbot chatgpt graphrag text2sql ai-search pdf-to-text deep-learning preprocessing data-pipelines document-parser document-understanding table-structure-recognition retrieval-augmented-generation
Created 2023-12-12
1,659 commits to main branch, last one 22 hours ago
Unstructured-IO
unstructured Unstructured-IO
762
9.2k
apache-2.0
60
Open source libraries and APIs to build custom preprocessing pipelines for labeling, training, or production machine learning pipelines.
ml llm nlp ocr pdf docx donut langchain pdf-to-json pdf-to-text deep-learning preprocessing data-pipelines document-parser document-parsing machine-learning information-retrieval document-image-analysis document-image-processing natural-language-processing
Created 2022-09-26
1,620 commits to main branch, last one 18 hours ago
dongrixinyu
JioNLP dongrixinyu
403
3.4k
apache-2.0
34
中文 NLP 预处理、解析工具包，准确、高效、易用 A Chinese NLP Preprocessing & Parsing Package www.jionlp.com
ner nlp python apache2 chinese nlp-parse time-parse time-parsing preprocessing natural-language-processing
Created 2020-03-13
540 commits to master branch, last one 24 days ago
nidhaloff
igel nidhaloff
172
3.1k
mit
65
a delightful machine learning tool that allows you to train, test, and use models without writing code
automl sklearn automation data-science scikit-learn data-analysis hacktoberfest preprocessing neural-network machinelearning neural-networks machine-learning hacktoberfest2021 automl-experiments artificial-intelligence machine-learning-library machine-learning-algorithms scikitlearn-machine-learning
Created 2020-08-27
429 commits to master branch, last one about a year ago
OpenGene
fastp OpenGene
333
1.9k
mit
50
An ultra-fast all-in-one FASTQ preprocessor (QC/adapters/trimming/filtering/splitting/merging...)
qc ngs umi fastq polyg filter adapter merging overlap quality illumina trimming filtering splitting sequencing duplication preprocessing bioinformatics quality-control
Created 2017-10-31
459 commits to master branch, last one 13 days ago
AxeldeRomblay
MLBox AxeldeRomblay
274
1.5k
other
65
MLBox is a powerful Automated Machine Learning python library.
drift keras automl kaggle auto-ml xgboost encoding lightgbm pipeline stacking prediction regression distributed data-science optimization deep-learning preprocessing classification machine-learning automated-machine-learning
Created 2017-06-01
1,121 commits to master branch, last one 4 years ago
winedarksea
AutoTS winedarksea
100
1.1k
mit
22
Automated Time Series Forecasting
automl autots forecasting time-series deep-learning preprocessing machine-learning feature-engineering
Created 2019-11-26
950 commits to master branch, last one 2 days ago
NVIDIA-Merlin
NVTabular NVIDIA-Merlin
143
1.1k
apache-2.0
34
NVTabular is a feature engineering and preprocessing library for tabular data designed to quickly and easily manipulate terabyte scale datasets used to train deep learning based recommender systems.
gpu nvidia deep-learning preprocessing machine-learning feature-selection recommender-system feature-engineering recommendation-system
Created 2020-04-03
1,075 commits to main branch, last one 3 months ago
KinWaiCheuk
nnAudio KinWaiCheuk
89
1.0k
mit
18
Audio processing by using pytorch 1D convolution network
stft pytorch spectrogram preprocessing 1d-convolution melspectrogram neural-network cqt-spectrogram audio-processing spectrogram-conversion-toolbox
Created 2019-09-02
305 commits to master branch, last one 9 months ago
sunlabuiuc
PyHealth sunlabuiuc
212
988
mit
33
A Deep Learning Python Toolkit for Healthcare Applications.
healthcare data-mining medical-code clinical-data deep-learning preprocessing clinical-research electronic-health-record electronic-medical-record
Created 2020-08-03
742 commits to master branch, last one 6 months ago
TheAlgorithms
R TheAlgorithms
296
878
mit
68
Collection of various algorithms implemented in R.
r learning practice algorithm education algorithms clustering r-language regression data-mining hacktoberfest preprocessing r-programming classification datamanipulation machine-learning
Created 2018-09-23
287 commits to master branch, last one 7 days ago
pytorch
torcharrow pytorch
79
649
bsd-3-clause
24
High performance model preprocessing library on PyTorch
python pytorch preprocessing
This repository has been archived (exclude archived)
Created 2021-09-27
439 commits to main branch, last one about a year ago
R1j1t
contextualSpellCheck R1j1t
66
409
mit
10
✔️Contextual word checker for better suggestions (not actively maintained)
nlp oov bert spacy python chatbot spellcheck help-wanted spellchecker preprocessing spacy-extension spelling-correction spelling-corrections python-spelling-corrector natural-language-processing
Created 2020-04-10
183 commits to master branch, last one about a year ago
msamogh
nonechucks msamogh
27
378
mit
3
Deal with bad samples in your dataset dynamically, use Transforms as Filters, and more!
torch pytorch data-cleaning data-pipeline preprocessing data-processing machine-learning data-preprocessing
Created 2018-10-05
30 commits to master branch, last one 3 years ago
qd-cae
awesome-CAE qd-cae
103
377
unknown
41
A curated list of awesome CAE frameworks, libraries and software.
cae cfd fem tools abaqus ls-dyna libraries scripting collection preprocessing
Created 2016-08-21
36 commits to master branch, last one 3 months ago
DataCanvasIO
HyperGBM DataCanvasIO
46
337
apache-2.0
15
A full pipeline AutoML tool for tabular data
gbm dask automl sklearn xgboost catboost lightgbm rapidsai datacleaning fullpipeline tabular-data preprocessing pseudo-labeling dask-distributed gpu-acceleration ensemble-learning distributed-training adversarial-validation semi-supervised-learning
Created 2020-10-22
763 commits to main branch, last one 5 months ago
ikegami-yukino
jaconv ikegami-yukino
28
315
mit
11
Pure-Python Japanese character interconverter for Hiragana, Katakana, Hankaku, and Zenkaku
julius pure-python japanese-kana preprocessing text-processing transliteration japanese-language character-converter
Created 2016-04-02
132 commits to master branch, last one 3 months ago
cylondata
cylon cylondata
48
298
apache-2.0
19
Cylon is a fast, scalable, distributed memory, parallel runtime with a Pandas like DataFrame.
mpi data join shuffle dataframe deep-learning preprocessing dataframes-api
Created 2019-10-10
1,307 commits to main branch, last one 11 months ago
ikegami-yukino
neologdn ikegami-yukino
20
274
apache-2.0
8
Japanese text normalizer for mecab-neologd
nlp preprocessing japanese-language text-normalization mecab-ipadic-neologd
Created 2015-07-21
103 commits to master branch, last one 6 months ago
Razor12911
xtool Razor12911
24
245
mit
1
Just some tool repackers like to use...
archiving repacking encryption compression preprocessing precompression
This repository has been archived (exclude archived)
Created 2022-01-09
29 commits to main branch, last one about a year ago
dunky11
voicesmith dunky11
32
222
apache-2.0
13
[WIP] VoiceSmith makes training text to speech models easy.
tts toolkit univnet delightfultts preprocessing voice-cloning text-to-speech dataset-manager speech-synthesis
Created 2022-05-17
238 commits to main branch, last one 2 years ago
jbusecke
xMIP jbusecke
44
198
apache-2.0
10
Analysis ready CMIP6 data in python the easy way with pangeo tools.
xgcm cmip6 pangeo cmip6-data preprocessing climate-models climate-analysis analysis-ready-data
Created 2019-10-16
615 commits to main branch, last one 4 months ago
google
tensorflow-recorder google
33
183
apache-2.0
9
TFRecorder makes it easy to create TensorFlow records (TFRecords) from Pandas DataFrames and CSVs files containing images or structured data.
tfrecords tensorflow apache-beam preprocessing image-processing tensorflow-recorder
This repository has been archived (exclude archived)
Created 2020-07-24
128 commits to main branch, last one 3 years ago
jaeho3690
LIDC-IDRI-Preprocessing jaeho3690
44
164
unknown
4
This is the preprocessing step of the LIDC-IDRI dataset
npy lung lidc-idri lidc-dataset preprocessing lidc-preprocessing
Created 2020-04-24
30 commits to master branch, last one 4 years ago
ropensci
MODIStsp ropensci
50
155
gpl-3.0
15
An "R" package for automatic download and preprocessing of MODIS Land Products Time Series
r gdal modis rstats r-package modis-data time-series peer-reviewed preprocessing remote-sensing satellite-imagery modis-land-products
Created 2014-07-09
1,619 commits to master branch, last one 4 months ago
githubharald
DeslantImg githubharald
38
146
mit
9
The deslanting algorithm sets text upright in images. Python, C++ and OpenCL implementations provided.
gpu ocr opencl opencv python c-plus-plus preprocessing image-processing handwriting-recognition
Created 2018-01-25
34 commits to master branch, last one 3 years ago
mlr-org
mlr3pipelines mlr-org
25
140
lgpl-3.0
18
Dataflow Programming for Machine Learning in R
r mlr3 bagging stacking pipelines r-package data-science preprocessing machine-learning ensemble-learning dataflow-programming
Created 2017-10-10
3,246 commits to master branch, last one a day ago
sappelhoff
pyprep sappelhoff
34
139
mit
8
PyPREP: A Python implementation of the Preprocessing Pipeline (PREP) for EEG data
eeg mne data python artifact neuroimaging neuroscience preprocessing electroencephalogaphy
Created 2018-04-12
387 commits to main branch, last one 2 days ago
autoreject
autoreject autoreject
58
138
bsd-3-clause
12
Automated rejection and repair of bad trials/sensors in M/EEG
meg mne-python preprocessing cross-validation electroencephalography magnetoencephalography
Created 2016-05-23
565 commits to main branch, last one a day ago
basf
mamba-tabular basf
7
133
mit
7
Mambular is a Python package that brings the power of Mamba architectures to tabular data, offering a suite of deep learning models for regression, classification, and distributional regression tasks....
ple rnn ssm mamba resnet tabular regression deeplearning preprocessing classification ft-transformer tabtransformer tabular-learning state-space-models tabular-deep-learning periodic-linear-encoding distributional-regression
Created 2024-05-03
422 commits to master branch, last one about a month ago