knotgrass / attention

several types of attention modules written in PyTorch

Date Created 2023-06-28 (about a year ago)

Commits 43 (last one about a month ago)

Stargazers 30 (0 this week)

Watchers 3 (0 this week)

Forks 9

License unknown

Ranking

RepositoryStats indexes 534,551 repositories, of these knotgrass/attention is ranked #516,218 (3rd percentile) for total stargazers, and #398,999 for total watchers. Github reports the primary language for this repository as Python, for repositories using this language it is ranked #99,300/103,470.

knotgrass/attention is also tagged with popular topics, for these it's ranked: pytorch (#5,478/5588), transformer (#891/916), transformers (#707/732)

Other Information

knotgrass/attention has 1 open pull request on Github, 0 pull requests have been merged over the lifetime of the repository.

All Topics

pytorch attention transformer transformers softmax-layer attention-mechanism multi-head-attention multi-query-attention grouped-query-attention scale-dot-product-attention

Star History

Github stargazers over time

Watcher History

Github watchers over time, collection started in '23

Recent Commit History

43 commits on the default branch (main) since jan '22

Yearly Commits

Commits to the default branch (main) per year

Issue History

No issues have been posted

Languages

The only known language in this repository is Python

updated: 2024-06-26 @ 10:05am, id: 659540905 / R_kgDOJ0_LqQ