Search Results - RepositoryStats

21

575

mit

11

Ungreedy subword tokenizer and vocabulary trainer for Python, Go & Javascript

tokenize tokenizer tokenizing vocabulary tokenisation tokenization text-tokenization vocabulary-builder vocabulary-generator

Created 2023-05-12

196 commits to main branch, last one about a year ago

68

243

mit

17

TokenScript schema, specs and paper

xml web3 mobile tokens security blockchain cryptography tokenisation tokenization

Created 2019-02-06

563 commits to main branch, last one 9 months ago

52

90

mit

12

Frames iOS: making native card payments simple

ios swift fintech payment checkout validation credit-card card-payment tokenisation mobile-payments payments-expert card-validations

Created 2018-07-09

1,789 commits to main branch, last one 7 months ago

25

88

other

12

Open morphology for Finnish

python finnish analysis spell-check tokenisation python-bindings morphological-analysis

Created 2015-03-18

2,925 commits to main branch, last one 2 months ago

1

32

mit

1

Taiwanese Hokkien Transliterator and Tokeniser

tl nlp poj taigi python zhuyin hokkien taiwanese tokeniser tokenizer nlp-library romanisation romanization tokenisation tokenization transliterator transliteration natural-language-processing

Created 2023-06-14

269 commits to main branch, last one 7 months ago