princeton-nlp / SWE-bench

[ICLR 2024] SWE-bench: Can Language Models Resolve Real-world Github Issues?

Date Created 2023-10-04 (about a year ago)

Commits 454 (last one 5 days ago)

Stargazers 1,988 (35 this week)

Watchers 26 (0 this week)

Forks 345

License mit

Ranking

RepositoryStats indexes 583,081 repositories, of these princeton-nlp/SWE-bench is ranked #25,729 (96th percentile) for total stargazers, and #84,691 for total watchers. Github reports the primary language for this repository as Python, for repositories using this language it is ranked #3,929/115,996.

princeton-nlp/SWE-bench is also tagged with popular topics, for these it's ranked: benchmark (#34/755), language-model (#60/505), software-engineering (#21/244)

Other Information

princeton-nlp/SWE-bench has 4 open pull requests on Github, 75 pull requests have been merged over the lifetime of the repository.

Github issues are enabled, there are 11 open issues and 142 closed issues.

Homepage URL: https://www.swebench.com

All Topics

benchmark language-model software-engineering

Star History

Github stargazers over time

Watcher History

Github watchers over time, collection started in '23

Recent Commit History

454 commits on the default branch (main) since jan '22

Yearly Commits

Commits to the default branch (main) per year

Issue History

Languages

The primary language is Python but there's also others...

updated: 2024-11-17 @ 06:59am, id: 700117650 / R_kgDOKbrykg