Search Results - RepositoryStats

1 result found Sort:

mit

Fast and memory-efficient library for WordPiece tokenization as it is used by BERT.

ai llm nlp bert tokens wordpiece tokenization bert-embeddings machine-learning nlp-machine-learning wordpiece-tokenization natural-language-processing

Created 2023-09-13

186 commits to master branch, last one 6 months ago