1 result found Sort:

georg-jung
FastBertTokenizer georg-jung
7
32
mit
3
Fast and memory-efficient library for WordPiece tokenization as it is used by BERT.
ai llm nlp bert tokens wordpiece tokenization bert-embeddings machine-learning nlp-machine-learning wordpiece-tokenization natural-language-processing
Created 2023-09-13
186 commits to master branch, last one 2 months ago