1 result found Sort:

georg-jung
FastBertTokenizer georg-jung
10
41
mit
3
Fast and memory-efficient library for WordPiece tokenization as it is used by BERT.
ai llm nlp bert tokens wordpiece tokenization bert-embeddings machine-learning nlp-machine-learning wordpiece-tokenization natural-language-processing
Created 2023-09-13
187 commits to master branch, last one 25 days ago