Search Results - RepositoryStats

447

1.9k

apache-2.0

58

NCRF++, a Neural Sequence Labeling Toolkit. Easy use to any sequence labeling tasks (e.g. NER, POS, Segmentation). It includes character LSTM/CNN, word LSTM/CNN and softmax/CRF components.

cnn crf ner lstm nbest pytorch char-cnn char-rnn chunking lstm-crf neural-networks sequence-labeling part-of-speech-tagger artificial-intelligence named-entity-recognition natural-language-processing

Created 2017-12-06

127 commits to master branch, last one 4 years ago

casync systemd

118

1.5k

unknown

80

Content-Addressable Data Synchronization Tool

tar http upload archive chunking delivery download file-system synchronization

Created 2017-01-13

684 commits to main branch, last one about a year ago

smooks smooks

360

400

other

40

An extensible Java framework for building event-driven applications that break up XML and non-XML data into chunks for data integration

etl sax xml java smooks chunking analytics pipelines event-driven stream-processing enterprise-integration

Created 2010-12-23

854 commits to master branch, last one about a month ago

desync folbricht

45

349

bsd-3-clause

15

Alternative casync implementation

casync golang archive chunking synchronization

Created 2017-11-09

309 commits to master branch, last one 8 days ago

chonky mirth

10

325

mit

5

Fully neural approach for text chunking

ai ml rag llms chunking text-splitter semantic-chunking

Created 2025-04-08

24 commits to main branch, last one 5 days ago

semchunk isaacus-dev

18

293

mit

3

A fast, lightweight and easy-to-use Python library for splitting text into semantically meaningful chunks.

nlp text python isaacus chunking splitting text-chunking text-splitting semantic-chunking

Created 2023-11-05

148 commits to main branch, last one 28 days ago

llmdocparser lazyFrogLOL

9

269

mit

4

A package for parsing PDFs and analyzing their content using LLMs.

llm nlp ocr rag chunking pdfparser pdf-parser text-chunking document-analysis

Created 2024-07-26

28 commits to main branch, last one 8 months ago

rag-experiment-accelerator microsoft

88

244

other

26

The RAG Experiment Accelerator is a versatile tool designed to expedite and facilitate the process of conducting experiments and evaluations using Azure Cognitive Search and RAG pattern.

acs llm rag azure dense genai openai sparse vectors chunking indexing embedding evaluation experiment information-retrieval

Created 2023-09-25

631 commits to development branch, last one 23 days ago

zchunk zeroentropy-ai

11

177

unknown

1

A new chunking strategy developed by ZeroEntropy for general semantic chunking using Llama-70B.

llm chunking retrieval

Created 2024-08-04

12 commits to master branch, last one 2 months ago

go-ts-segmenter jordicenzano

13

94

gpl-3.0

8

Live TS segmenter and HLS manifest creation in Go

hls lhls chunk video golang chunked chunking transport-stream

Created 2019-05-31

115 commits to master branch, last one 3 years ago

TalkWithYourFiles safakan

14

92

mit

4

An LLM GUI application; enables you to interact with your files, offering dynamic parameters that can modify response behavior during runtime.

faiss docker openai python chunking langchain streamlit embeddings vectorstore openai-chatgpt factory-pattern text-processing strategy-pattern similarity-search question-answering dependency-inversion-principle

Created 2023-05-09

88 commits to main branch, last one about a year ago

swarmauri-sdk swarmauri

44

88

apache-2.0

5

a modular multimodal framework for ai applications

ai nlp tools agents metrics modular parsing tooling vectors chunking measures monorepo factories llm-framework orchestration orchestration-framework

Created 2024-04-08

4,909 commits to master branch, last one 22 days ago

semantic-chunking jparkerweb

6

85

mit

2

🍱 semantic-chunking ⇢ semantically create chunks from large document for passing to LLM workflows

llm vector chunking embeddings text-chunking text-splitter text-splitting semantic-chunking

Created 2024-02-27

125 commits to main branch, last one about a month ago

laravel-chunkable-jobs Sammyjo20

4

83

unknown

3

📑 Split Laravel jobs into multiple separate job chunks

php jobs laravel chunking hacktoberfest

Created 2022-09-18

50 commits to v1 branch, last one 11 months ago

esa-restclient esastack

22

82

apache-2.0

2

An asynchronous event-driven HTTP client based on netty.

h2c http2 https netty retry filter haproxy chunking httpclient interceptor asynchronous

Created 2020-12-08

203 commits to main branch, last one 2 years ago

pgrag neondatabase-labs

3

69

other

1

Postgres extensions to support end-to-end Retrieval-Augmented Generation (RAG) pipelines

rag pgrx chunking embeddings postgresql

Created 2024-09-06

85 commits to main branch, last one 18 hours ago

smart-llm-loader drmingler

2

64

mit

1

smart-llm-loader is a lightweight yet powerful Python package that transforms any document into LLM-ready chunks. Spend less time on preprocessing headaches and more time building what matters. From R...

rag claude gemini openai chatbot chunking markdown langchain pdf-parser llama-index pdf-converter pdf-to-markdown

Created 2025-02-13

42 commits to main branch, last one 2 months ago

crfsuite bnosac

11

64

other

7

Labelling Sequential Data in Natural Language Processing with R - using CRFsuite

r crf ner nlp chunking crfsuite r-package data-science intent-classification conditional-random-fields natural-language-processing

Created 2018-08-17

139 commits to master branch, last one about a year ago

fastcdc-py iscc

17

57

mit

3

FastCDC implementation in Python https://pypi.org/project/fastcdc/

python chunking deduplication content-dependent chunking-algorithm

Created 2020-05-07

105 commits to master branch, last one 10 months ago

longtail DanEngelbrecht

8

56

mit

6

Incremental asset delivery library

c upload archive chunking delivery download compression syncronization compression-library

Created 2019-07-04

603 commits to main branch, last one 5 months ago

grammar-pattern howardyclo

10

54

unknown

5

Extract and align grammar patterns from English sentences.

grammar chunking grammar-rules grammar-parser shallow-parser grammar-pattern

Created 2018-06-07

13 commits to master branch, last one 5 years ago

quackling DS4SD

2

53

mit

3

Build document-native LLM applications

ai pdf rag python chunking document langchain llamaindex

This repository has been archived (exclude archived)

Created 2024-07-30

20 commits to main branch, last one 7 months ago

llamaindexchat dcarpintero

6

44

unknown

2

LLM Chatbot w/ Retrieval Augmented Generation using Llamaindex. It demonstrates how to impl. chunking, indexing, and source citation.

rag python chunking streamlit llamaindex embedding-vectors large-language-models retrieval-augmented-generation

Created 2023-09-12

64 commits to main branch, last one about a year ago

DocumentAtom DocumentAtom

5

37

mit

2

DocumentAtom provides a light, fast library for breaking input documents into constituent parts (atoms), useful for text processing, analysis, and artificial intelligence.

ai etl chunk parse parser chunking semantic extraction extraction-transformation-and-loading

Created 2024-12-30

45 commits to main branch, last one 16 days ago

chunking-strategies ALucek

7

36

unknown

2

An Overview of the Latest Document Chunking Research

rag chunking retrieval-augmented-generation

Created 2024-11-19

21 commits to main branch, last one 5 months ago

betterhtmlchunking carlosplanchon

2

33

mit

3

BetterHTMLChunking is a Python library for intelligent HTML segmentation. It builds a DOM tree from raw HTML and extracts content-rich regions of interest, making content analysis effortless. Great fo...

ai llm html chunking splitting

Created 2025-02-14

8 commits to main branch, last one 27 days ago