9 results found Sort:

micromark
micromark micromark
66
1.9k
mit
15
small, safe, and great commonmark (optionally gfm) compliant markdown parser
ast cst gfm parse render compile unified markdown tokenize commonmark
Created 2018-11-13
642 commits to main branch, last one 9 days ago
winkjs
wink-nlp winkjs
58
1.2k
mit
15
Developer friendly Natural Language Processing ✨
ner nlp sbd bm25 wink chatbot tokenize wink-nlp vectorizer pos-tagging word-vectors hacktoberfest visualization pattern-matching negation-handling sentiment-analysis custom-entity-detection named-entity-extraction natural-language-processing sentence-boundary-detection
Created 2018-12-15
309 commits to master branch, last one 2 months ago
wooorm
markdown-rs wooorm
57
1.0k
mit
16
CommonMark compliant markdown parser in Rust with ASTs and extensions
gfm rust parse render compiler markdown tokenize commonmark
Created 2022-06-08
558 commits to main branch, last one a day ago
alasdairforsythe
tokenmonster alasdairforsythe
20
566
mit
11
Ungreedy subword tokenizer and vocabulary trainer for Python, Go & Javascript
tokenize tokenizer tokenizing vocabulary tokenisation tokenization text-tokenization vocabulary-builder vocabulary-generator
Created 2023-05-12
196 commits to main branch, last one about a year ago
here-be
snapdragon here-be
25
224
mit
7
snapdragon is an extremely pluggable, powerful and easy-to-use parser-renderer factory.
ast lex node lexer parse token nodejs parser render compile compiler tokenize javascript source-map
Created 2015-05-11
172 commits to master branch, last one 3 years ago
syntax-tree
mdast-util-from-markdown syntax-tree
20
221
mit
10
mdast utility to parse markdown
mdast parse unist markdown tokenize mdast-util
Created 2020-08-31
160 commits to main branch, last one 9 days ago
winkjs
wink-nlp-utils winkjs
11
124
mit
8
NLP Functions for amplifying negations, managing elisions, creating ngrams, stems, phonetic codes to tokens and more.
nlp stem ngrams tokenize phonetize stop-words bag-of-words natural-language-processing sentence-boundary-detection
Created 2017-05-12
136 commits to master branch, last one 11 months ago
privateai
deid-examples privateai
1
79
mit
5
Examples scripts that showcase how to use Private AI Text to de-identify, redact, hash, tokenize, mask and synthesize PII in text.
dlp cpra gdpr hipaa redact masking tokenize redaction de-identify data-masking anonymization privacy-tools synthetic-data deidentification de-identification data-anonymization text-anonymization data-loss-prevention synthetic-data-generator synthetic-dataset-generation
Created 2021-11-18
142 commits to main branch, last one 10 days ago
chayanforyou
bkash-pgwclient-demo-flutter chayanforyou
28
41
unknown
3
bKash payment gateway integration in flutter
bkash flutter tokenize bkash-pgw bkash-payment bkash-payment-gateway
Created 2021-02-07
6 commits to master branch, last one 3 months ago