Kaleidophon / token2index

A lightweight but powerful library to build token indices for NLP tasks, compatible with major Deep Learning frameworks like PyTorch and Tensorflow.

Date Created 2020-06-06 (4 years ago)

Commits 118 (last one 3 months ago)

Stargazers 51 (0 this week)

Watchers 4 (0 this week)

Forks 6

License gpl-3.0

Ranking

RepositoryStats indexes 633,155 repositories, of these Kaleidophon/token2index is ranked #484,947 (23rd percentile) for total stargazers, and #366,274 for total watchers. Github reports the primary language for this repository as Python, for repositories using this language it is ranked #94,743/129,369.

Kaleidophon/token2index is also tagged with popular topics, for these it's ranked: python (#19,260/23437), deep-learning (#7,209/8816), pytorch (#5,055/6220), nlp (#2,068/2521), tensorflow (#2,012/2301), transformer (#859/1075), transformers (#712/900), numpy (#478/566), deeplearning (#358/424)

Other Information

There have been 4 releases, the latest one was published on 2020-10-28 (4 years ago) with the name Extend functionalities to tokenized corpus (#4).

Homepage URL: http://token2index.readthedocs.io

Star History

Github stargazers over time

Watcher History

Github watchers over time, collection started in '23

Recent Commit History

3 commits on the default branch (master) since jan '22

Yearly Commits

Commits to the default branch (master) per year

Issue History

Languages

The only known language in this repository is Python

updated: 2025-03-07 @ 11:39am, id: 269975463 / R_kgDOEBd_pw