2 results found Sort:

cometkim
unicode-segmenter cometkim
1
57
mit
3
A lightweight implementation of the Unicode Text Segmentation (UAX #29)
emoji uax29 unicode grapheme grapheme-cluster
Created 2024-04-13
168 commits to main branch, last one 18 days ago
clipperhouse
uax29 clipperhouse
3
54
mit
5
A tokenizer based on Unicode text segmentation (UAX #29), for Go. Split words, sentences and graphemes.
go nlp uax29 golang unicode tokenizer tokenization
Created 2020-04-15
264 commits to master branch, last one 2 months ago