9 results found Sort:

micromark
micromark micromark
63
1.7k
mit
15
small, safe, and great commonmark (optionally gfm) compliant markdown parser
ast cst gfm parse render compile unified markdown tokenize commonmark
Created 2018-11-13
619 commits to main branch, last one 12 days ago
winkjs
wink-nlp winkjs
57
1.2k
mit
15
Developer friendly Natural Language Processing ✨
ner nlp sbd bm25 wink chatbot tokenize wink-nlp vectorizer pos-tagging word-vectors hacktoberfest visualization pattern-matching negation-handling sentiment-analysis custom-entity-detection named-entity-extraction natural-language-processing sentence-boundary-detection
Created 2018-12-15
302 commits to master branch, last one about a month ago
wooorm
markdown-rs wooorm
41
833
mit
12
CommonMark compliant markdown parser in Rust with ASTs and extensions
gfm rust parse render compiler markdown tokenize commonmark
Created 2022-06-08
530 commits to main branch, last one 14 days ago
alasdairforsythe
tokenmonster alasdairforsythe
19
524
mit
10
Ungreedy subword tokenizer and vocabulary trainer for Python, Go & Javascript
tokenize tokenizer tokenizing vocabulary tokenisation tokenization text-tokenization vocabulary-builder vocabulary-generator
Created 2023-05-12
196 commits to main branch, last one 7 months ago
here-be
snapdragon here-be
25
219
mit
7
snapdragon is an extremely pluggable, powerful and easy-to-use parser-renderer factory.
ast lex node lexer parse token nodejs parser render compile compiler tokenize javascript source-map
Created 2015-05-11
172 commits to master branch, last one 3 years ago
syntax-tree
mdast-util-from-markdown syntax-tree
19
195
mit
10
mdast utility to parse markdown
mdast parse unist markdown tokenize mdast-util
Created 2020-08-31
149 commits to main branch, last one about a month ago
winkjs
wink-nlp-utils winkjs
12
113
mit
7
NLP Functions for amplifying negations, managing elisions, creating ngrams, stems, phonetic codes to tokens and more.
nlp stem ngrams tokenize phonetize stop-words bag-of-words natural-language-processing sentence-boundary-detection
Created 2017-05-12
136 commits to master branch, last one 3 months ago
privateai
deid-examples privateai
1
69
mit
3
Examples scripts that showcase how to use Private AI Text to de-identify, redact, hash, tokenize, mask and synthesize PII in text.
dlp cpra gdpr hipaa redact masking tokenize redaction de-identify data-masking anonymization privacy-tools synthetic-data deidentification de-identification data-anonymization text-anonymization data-loss-prevention synthetic-data-generator synthetic-dataset-generation
Created 2021-11-18
87 commits to main branch, last one 29 days ago
chayanforyou
bkash-pgwclient-demo-flutter chayanforyou
27
39
unknown
2
bKash payment gateway integration in flutter
bkash flutter tokenize bkash-pgw bkash-payment bkash-payment-gateway
Created 2021-02-07
5 commits to master branch, last one 2 months ago