Search Results - RepositoryStats

18

292

mit

3

A fast, lightweight and easy-to-use Python library for splitting text into semantically meaningful chunks.

nlp text python isaacus chunking splitting text-chunking text-splitting semantic-chunking

Created 2023-11-05

148 commits to main branch, last one 26 days ago

6

84

mit

2

🍱 semantic-chunking ⇢ semantically create chunks from large document for passing to LLM workflows

llm vector chunking embeddings text-chunking text-splitter text-splitting semantic-chunking

Created 2024-02-27

125 commits to main branch, last one about a month ago

6

31

mit

1

A sentence splitting (sentence boundary disambiguation) library for Go. It is rule-based and works out-of-the-box.

ai llm rag golang nlp-library text-splitter text-splitting sentence-splitter sentence-segmenter sentence-splitting sentence-tokenizer sentence-segmentation natural-language-processing sentence-boundary-detection retrieval-augmented-generation

Created 2024-02-14

45 commits to main branch, last one 17 days ago