bigcode-project / bigcodebench

[ICLR'25] BigCodeBench: Benchmarking Code Generation Towards AGI

bigcode-project
bigcode-project
Date Created 2024-04-29 (10 months ago)
Commits 1,254 (last one 21 days ago)
Stargazers 317 (3 this week)
Watchers 7 (0 this week)
Forks 37
License apache-2.0
Ranking

RepositoryStats indexes 630,459 repositories, of these bigcode-project/bigcodebench is ranked #133,937 (79th percentile) for total stargazers, and #260,990 for total watchers. Github reports the primary language for this repository as Python, for repositories using this language it is ranked #23,446/128,655.

bigcode-project/bigcodebench is also tagged with popular topics, for these it's ranked: llm (#1,110/3536),  chatgpt (#819/2662),  large-language-models (#398/1222),  benchmark (#200/820),  gpt-4 (#257/767),  agent (#243/597),  code-generation (#112/400),  agents (#155/397),  gemini (#119/386)

Other Information

bigcode-project/bigcodebench has Github issues enabled, there are 7 open issues and 58 closed issues.

There have been 12 releases, the latest one was published on 2025-03-02 (21 days ago) with the name Release BigCodeBench v0.2.4.

Homepage URL: https://bigcode-bench.github.io/

Star History

Github stargazers over time

350350300300250250200200150150100100505000Jun '24Jun '24Jul '24Jul '24Aug '24Aug '24Sep '24Sep '24Oct '24Oct '24Nov '24Nov '24Dec '24Dec '2420252025Feb '25Feb '25Mar '25Mar '25

Watcher History

Github watchers over time, collection started in '23

776.56.5665.55.5554.54.544Jul '24Jul '24Aug '24Aug '24Sep '24Sep '24Oct '24Oct '24Nov '24Nov '24Dec '24Dec '2420252025Feb '25Feb '25Mar '25Mar '25

Recent Commit History

1,254 commits on the default branch (main) since jan '22

1.4k1.4k1.2k1.2k1k1k80080060060040040020020000May '23May '23Jul '23Jul '23Aug '23Aug '23Oct '23Oct '23Nov '23Nov '2320242024Feb '24Feb '24Apr '24Apr '24Jun '24Jun '24Jul '24Jul '24Aug '24Aug '24Oct '24Oct '24Nov '24Nov '2420252025Feb '25Feb '25

Yearly Commits

Commits to the default branch (main) per year

6006005005004004003003002002001001000020242024

Issue History

Total Issues
Open Issues
Closed Issues
707060605050404030302020101000Jul '24Jul '24Aug '24Aug '24Sep '24Sep '24Oct '24Oct '24Nov '24Nov '24Dec '24Dec '2420252025Feb '25Feb '25Mar '25Mar '25

Languages

The primary language is Python but there's also others...

PythonPythonDockerfileDockerfileShellShell

updated: 2025-03-21 @ 06:47am, id: 793526430 / R_kgDOL0xAng