CodeEval-Pro / CodeEval-Pro

Official repo for "HumanEval Pro and MBPP Pro: Evaluating Large Language Models on Self-invoking Code Generation Task"

CodeEval-Pro
CodeEval-Pro
Date Created 2024-12-05 (4 months ago)
Commits 27 (last one 8 days ago)
Stargazers 26 (0 this week)
Watchers 2 (0 this week)
Forks 2
License unknown
Ranking

RepositoryStats indexes 640,560 repositories, of these CodeEval-Pro/CodeEval-Pro is ranked #626,826 (2nd percentile) for total stargazers, and #485,708 for total watchers. Github reports the primary language for this repository as Python, for repositories using this language it is ranked #128,161/131,281.

CodeEval-Pro/CodeEval-Pro is also tagged with popular topics, for these it's ranked: llm (#3,587/3710),  code-generation (#405/410)

Other Information

Homepage URL: https://arxiv.org/abs/2412.21199

Star History

Github stargazers over time

30302525202015151010550015 Dec15 DecJan '25Jan '2515 Jan15 JanFeb '25Feb '2515 Feb15 FebMar '25Mar '2515 Mar15 MarApr '25Apr '25

Watcher History

Github watchers over time, collection started in '23

3333222222111126 Mar26 Mar27 Mar27 Mar28 Mar28 Mar29 Mar29 Mar30 Mar30 Mar31 Mar31 MarApr '25Apr '2502 Apr02 Apr03 Apr03 Apr04 Apr04 Apr05 Apr05 Apr06 Apr06 Apr07 Apr07 Apr08 Apr08 Apr09 Apr09 Apr10 Apr10 Apr11 Apr11 Apr12 Apr12 Apr13 Apr13 Apr14 Apr14 Apr15 Apr15 Apr16 Apr16 Apr

Recent Commit History

27 commits on the default branch (main) since jan '22

30302525202015151010550015 Dec15 DecJan '25Jan '2515 Jan15 JanFeb '25Feb '2515 Feb15 FebMar '25Mar '2515 Mar15 MarApr '25Apr '25

Yearly Commits

Commits to the default branch (main) per year

2525202015151010550020242024

Issue History

Total Issues
Open Issues
Closed Issues
2222111111000020 Jan20 JanFeb '25Feb '2510 Feb10 Feb20 Feb20 FebMar '25Mar '2510 Mar10 Mar20 Mar20 MarApr '25Apr '2510 Apr10 Apr

Languages

The only known language in this repository is Python

PythonPython

updated: 2025-04-08 @ 02:46pm, id: 898858043 / R_kgDONZN8Ow