9 results found Sort:

micromark
micromark micromark
65
1.8k
mit
14
small, safe, and great commonmark (optionally gfm) compliant markdown parser
ast cst gfm parse render compile unified markdown tokenize commonmark
Created 2018-11-13
639 commits to main branch, last one about a month ago
winkjs
wink-nlp winkjs
58
1.2k
mit
16
Developer friendly Natural Language Processing ✨
ner nlp sbd bm25 wink chatbot tokenize wink-nlp vectorizer pos-tagging word-vectors hacktoberfest visualization pattern-matching negation-handling sentiment-analysis custom-entity-detection named-entity-extraction natural-language-processing sentence-boundary-detection
Created 2018-12-15
309 commits to master branch, last one 21 days ago
wooorm
markdown-rs wooorm
53
990
mit
16
CommonMark compliant markdown parser in Rust with ASTs and extensions
gfm rust parse render compiler markdown tokenize commonmark
Created 2022-06-08
548 commits to main branch, last one 2 months ago
alasdairforsythe
tokenmonster alasdairforsythe
20
557
mit
11
Ungreedy subword tokenizer and vocabulary trainer for Python, Go & Javascript
tokenize tokenizer tokenizing vocabulary tokenisation tokenization text-tokenization vocabulary-builder vocabulary-generator
Created 2023-05-12
196 commits to main branch, last one about a year ago
here-be
snapdragon here-be
25
223
mit
7
snapdragon is an extremely pluggable, powerful and easy-to-use parser-renderer factory.
ast lex node lexer parse token nodejs parser render compile compiler tokenize javascript source-map
Created 2015-05-11
172 commits to master branch, last one 3 years ago
syntax-tree
mdast-util-from-markdown syntax-tree
20
217
mit
10
mdast utility to parse markdown
mdast parse unist markdown tokenize mdast-util
Created 2020-08-31
158 commits to main branch, last one about a month ago
winkjs
wink-nlp-utils winkjs
12
124
mit
8
NLP Functions for amplifying negations, managing elisions, creating ngrams, stems, phonetic codes to tokens and more.
nlp stem ngrams tokenize phonetize stop-words bag-of-words natural-language-processing sentence-boundary-detection
Created 2017-05-12
136 commits to master branch, last one 9 months ago
privateai
deid-examples privateai
1
78
mit
5
Examples scripts that showcase how to use Private AI Text to de-identify, redact, hash, tokenize, mask and synthesize PII in text.
dlp cpra gdpr hipaa redact masking tokenize redaction de-identify data-masking anonymization privacy-tools synthetic-data deidentification de-identification data-anonymization text-anonymization data-loss-prevention synthetic-data-generator synthetic-dataset-generation
Created 2021-11-18
141 commits to main branch, last one about a month ago
chayanforyou
bkash-pgwclient-demo-flutter chayanforyou
28
41
unknown
3
bKash payment gateway integration in flutter
bkash flutter tokenize bkash-pgw bkash-payment bkash-payment-gateway
Created 2021-02-07
6 commits to master branch, last one 2 months ago