RobertCsordas / transformer_generalization

The official repository for our paper "The Devil is in the Detail: Simple Tricks Improve Systematic Generalization of Transformers". We significantly improve the systematic generalization of transformer models on a variety of datasets using simple tricks and careful considerations.

Date Created 2021-08-25 (3 years ago)

Commits 4 (last one 3 years ago)

Stargazers 66 (0 this week)

Watchers 1 (0 this week)

Forks 14

License mit

Ranking

RepositoryStats indexes 609,066 repositories, of these RobertCsordas/transformer_generalization is ranked #396,176 (35th percentile) for total stargazers, and #554,446 for total watchers. Github reports the primary language for this repository as Python, for repositories using this language it is ranked #75,736/122,846.

RobertCsordas/transformer_generalization is also tagged with popular topics, for these it's ranked: deep-learning (#6,270/8637), machine-learning (#5,965/8197), pytorch (#4,419/6095), transformers (#616/865), paper (#350/450)

Other Information

RobertCsordas/transformer_generalization has 1 open pull request on Github, 0 pull requests have been merged over the lifetime of the repository.

All Topics

paper pytorch transformers deep-learning generalization machine-learning systematic-generalization

Star History

Github stargazers over time

Watcher History

Github watchers over time, collection started in '23

Recent Commit History

0 commits on the default branch (master) since jan '22

No recent commits to this repository

Yearly Commits

Commits to the default branch (master) per year

Issue History

No issues have been posted

Languages

The primary language is Python but there's also others...

updated: 2024-12-16 @ 04:02am, id: 399842208 / R_kgDOF9UboA