knotgrass / attention

several types of attention modules written in PyTorch for learning purposes

Date Created 2023-06-28 (about a year ago)

Commits 45 (last one 3 months ago)

Stargazers 42 (0 this week)

Watchers 3 (0 this week)

Forks 10

License unknown

Ranking

RepositoryStats indexes 599,932 repositories, of these knotgrass/attention is ranked #513,053 (14th percentile) for total stargazers, and #429,405 for total watchers. Github reports the primary language for this repository as Python, for repositories using this language it is ranked #99,979/120,502.

knotgrass/attention is also tagged with popular topics, for these it's ranked: pytorch (#5,371/6036), transformer (#902/1019), transformers (#734/851)

All Topics

pytorch attention transformer transformers softmax-layer attention-mechanism multi-head-attention multi-query-attention grouped-query-attention scale-dot-product-attention

Star History

Github stargazers over time

Watcher History

Github watchers over time, collection started in '23

Recent Commit History

45 commits on the default branch (main) since jan '22

Yearly Commits

Commits to the default branch (main) per year

Issue History

No issues have been posted

Languages

The only known language in this repository is Python

updated: 2025-01-01 @ 05:23pm, id: 659540905 / R_kgDOJ0_LqQ