20 results found Sort:

jiesutd
NCRFpp jiesutd
446
1.9k
apache-2.0
60
NCRF++, a Neural Sequence Labeling Toolkit. Easy use to any sequence labeling tasks (e.g. NER, POS, Segmentation). It includes character LSTM/CNN, word LSTM/CNN and softmax/CRF components.
cnn crf ner lstm nbest pytorch char-cnn char-rnn chunking lstm-crf neural-networks sequence-labeling part-of-speech-tagger artificial-intelligence named-entity-recognition natural-language-processing
Created 2017-12-06
127 commits to master branch, last one 4 years ago
bhavnicksm
chonkie bhavnicksm
65
1.8k
mit
13
🦛 CHONK your texts with Chonkie ✨ - The no-nonsense RAG chunking library
ai rag chunking text-processing retrieval-augmented-generation
Created 2024-11-01
273 commits to main branch, last one 5 days ago
systemd
casync systemd
117
1.5k
unknown
81
Content-Addressable Data Synchronization Tool
tar http upload archive chunking delivery download file-system synchronization
Created 2017-01-13
684 commits to main branch, last one about a year ago
folbricht
desync folbricht
44
343
bsd-3-clause
15
Alternative casync implementation
casync golang archive chunking synchronization
Created 2017-11-09
300 commits to master branch, last one 3 days ago
lazyFrogLOL
llmdocparser lazyFrogLOL
6
246
mit
4
A package for parsing PDFs and analyzing their content using LLMs.
llm nlp ocr rag chunking pdfparser pdf-parser text-chunking document-analysis
Created 2024-07-26
28 commits to main branch, last one 3 months ago
microsoft
rag-experiment-accelerator microsoft
73
199
other
24
The RAG Experiment Accelerator is a versatile tool designed to expedite and facilitate the process of conducting experiments and evaluations using Azure Cognitive Search and RAG pattern.
acs llm rag azure dense genai openai sparse vectors chunking indexing embedding evaluation experiment information-retrieval
Created 2023-09-25
629 commits to development branch, last one 2 months ago
umarbutler
semchunk umarbutler
9
190
mit
4
A fast and lightweight pure Python library for splitting text into semantically meaningful chunks.
nlp text python chunking splitting text-chunking text-splitting semantic-chunking
Created 2023-11-05
88 commits to main branch, last one 4 months ago
jordicenzano
go-ts-segmenter jordicenzano
13
93
gpl-3.0
9
Live TS segmenter and HLS manifest creation in Go
hls lhls chunk video golang chunked chunking transport-stream
Created 2019-05-31
115 commits to master branch, last one 3 years ago
ataguru
TalkWithYourFiles safakan
14
90
mit
4
An LLM GUI application; enables you to interact with your files, offering dynamic parameters that can modify response behavior during runtime.
faiss docker openai python chunking langchain streamlit embeddings vectorstore openai-chatgpt factory-pattern text-processing strategy-pattern similarity-search question-answering dependency-inversion-principle
Created 2023-05-09
88 commits to main branch, last one 12 months ago
Sammyjo20
laravel-chunkable-jobs Sammyjo20
3
83
unknown
3
📑 Split Laravel jobs into multiple separate job chunks
php jobs laravel chunking hacktoberfest
Created 2022-09-18
50 commits to v1 branch, last one 6 months ago
esastack
esa-restclient esastack
22
81
apache-2.0
3
An asynchronous event-driven HTTP client based on netty.
h2c http2 https netty retry filter haproxy chunking httpclient interceptor asynchronous
Created 2020-12-08
203 commits to main branch, last one 2 years ago
swarmauri
swarmauri-sdk swarmauri
42
73
apache-2.0
7
a modular multimodal framework for ai applications
ai nlp tools agents metrics modular parsing tooling vectors chunking measures monorepo factories llm-framework orchestration orchestration-framework
Created 2024-04-08
2,956 commits to master branch, last one 12 days ago
bnosac
crfsuite bnosac
12
62
other
8
Labelling Sequential Data in Natural Language Processing with R - using CRFsuite
r crf ner nlp chunking crfsuite r-package data-science intent-classification conditional-random-fields natural-language-processing
Created 2018-08-17
139 commits to master branch, last one about a year ago
howardyclo
grammar-pattern howardyclo
10
54
unknown
6
Extract and align grammar patterns from English sentences.
grammar chunking grammar-rules grammar-parser shallow-parser grammar-pattern
Created 2018-06-07
13 commits to master branch, last one 4 years ago
DS4SD
quackling DS4SD
3
51
mit
3
Build document-native LLM applications
ai pdf rag python chunking document langchain llamaindex
This repository has been archived (exclude archived)
Created 2024-07-30
20 commits to main branch, last one 2 months ago
DanEngelbrecht
longtail DanEngelbrecht
8
50
mit
7
Incremental asset delivery library
c upload archive chunking delivery download compression syncronization compression-library
Created 2019-07-04
603 commits to main branch, last one 10 days ago
iscc
fastcdc-py iscc
17
50
mit
5
FastCDC implementation in Python https://pypi.org/project/fastcdc/
python chunking deduplication content-dependent chunking-algorithm
Created 2020-05-07
105 commits to master branch, last one 5 months ago
jparkerweb
semantic-chunking jparkerweb
2
46
mit
2
🍱 semantic-chunking ⇢ semantically create chunks from large document for passing to LLM workflows
llm vector chunking embeddings text-chunking text-splitter text-splitting semantic-chunking
Created 2024-02-27
107 commits to main branch, last one 7 days ago
dcarpintero
llamaindexchat dcarpintero
7
39
unknown
2
LLM Chatbot w/ Retrieval Augmented Generation using Llamaindex. It demonstrates how to impl. chunking, indexing, and source citation.
rag python chunking streamlit llamaindex embedding-vectors large-language-models retrieval-augmented-generation
Created 2023-09-12
64 commits to main branch, last one about a year ago
neondatabase-labs
pgrag neondatabase-labs
3
34
other
1
Postgres extensions to support end-to-end Retrieval-Augmented Generation (RAG) pipelines
rag pgrx chunking embeddings postgresql
Created 2024-09-06
82 commits to main branch, last one about a month ago