Kaleidophon / token2index

A lightweight but powerful library to build token indices for NLP tasks, compatible with major Deep Learning frameworks like PyTorch and Tensorflow.

Date Created 2020-06-06 (4 years ago)
Commits 118 (last one 2 months ago)
Stargazers 51 (0 this week)
Watchers 5 (0 this week)
Forks 6
License gpl-3.0
Ranking

RepositoryStats indexes 618,350 repositories, of these Kaleidophon/token2index is ranked #476,526 (23rd percentile) for total stargazers, and #339,715 for total watchers. Github reports the primary language for this repository as Python, for repositories using this language it is ranked #92,230/125,168.

Kaleidophon/token2index is also tagged with popular topics, for these it's ranked: python (#18,986/22999),  deep-learning (#7,128/8711),  pytorch (#4,999/6144),  nlp (#2,051/2486),  tensorflow (#2,002/2286),  transformer (#848/1051),  transformers (#700/879),  numpy (#472/557),  deeplearning (#351/415)

Other Information

There have been 4 releases, the latest one was published on 2020-10-28 (4 years ago) with the name Extend functionalities to tokenized corpus (#4).

Homepage URL: http://token2index.readthedocs.io

Star History

Github stargazers over time

6060505040403030202010100020212021Jul '21Jul '2120222022Jul '22Jul '2220232023Jul '23Jul '2320242024Jul '24Jul '2420252025

Watcher History

Github watchers over time, collection started in '23

6666555555444410 Dec10 Dec20 Dec20 DecJan '25Jan '2510 Jan10 Jan20 Jan20 JanFeb '25Feb '2510 Feb10 Feb20 Feb20 Feb

Recent Commit History

3 commits on the default branch (master) since jan '22

332.52.5221.51.5110.50.50010 Dec10 Dec20 Dec20 DecJan '25Jan '2510 Jan10 Jan20 Jan20 JanFeb '25Feb '2510 Feb10 Feb20 Feb20 Feb

Yearly Commits

Commits to the default branch (master) per year

12012010010080806060404020200020202020202120212022202220242024

Issue History

Total Issues
Open Issues
Closed Issues
1111110.50.500000020212021Jul '21Jul '2120222022Jul '22Jul '2220232023Jul '23Jul '2320242024Jul '24Jul '2420252025

Languages

The only known language in this repository is Python

PythonPython

updated: 2025-01-25 @ 01:22pm, id: 269975463 / R_kgDOEBd_pw