huggingface / evaluation-guidebook

Sharing both practical insights and theoretical knowledge about LLM evaluation that we gathered while managing the Open LLM Leaderboard and designing lighteval!

Date Created 2024-10-09 (4 months ago)
Commits 73 (last one about a month ago)
Stargazers 1,032 (26 this week)
Watchers 10 (0 this week)
Forks 63
License other
Ranking

RepositoryStats indexes 618,350 repositories, of these huggingface/evaluation-guidebook is ranked #51,052 (92nd percentile) for total stargazers, and #209,610 for total watchers. Github reports the primary language for this repository as Jupyter Notebook, for repositories using this language it is ranked #1,062/18,432.

huggingface/evaluation-guidebook is also tagged with popular topics, for these it's ranked: machine-learning (#1,322/8271),  llm (#488/3282),  tutorial (#256/1545),  large-language-models (#169/1166)

Other Information

huggingface/evaluation-guidebook has Github issues enabled, there are 2 open issues and 1 closed issue.

Star History

Github stargazers over time

1.2k1.2k1k1k8008006006004004002002000015 Oct15 OctNov '24Nov '2415 Nov15 NovDec '24Dec '2415 Dec15 DecJan '25Jan '2515 Jan15 JanFeb '25Feb '2515 Feb15 Feb

Watcher History

Github watchers over time, collection started in '23

10109.59.5998.58.5887.57.5776.56.5665.55.55515 Oct15 OctNov '24Nov '2415 Nov15 NovDec '24Dec '2415 Dec15 DecJan '25Jan '2515 Jan15 JanFeb '25Feb '2515 Feb15 Feb

Recent Commit History

73 commits on the default branch (main) since jan '22

808070706060505040403030202010100015 Oct15 OctNov '24Nov '2415 Nov15 NovDec '24Dec '2415 Dec15 DecJan '25Jan '2515 Jan15 JanFeb '25Feb '2515 Feb15 Feb

Yearly Commits

Commits to the default branch (main) per year

808070706060505040403030202010100020242024

Issue History

Total Issues
Open Issues
Closed Issues
332.52.5221.51.5110.50.50015 Oct15 OctNov '24Nov '2415 Nov15 NovDec '24Dec '2415 Dec15 DecJan '25Jan '2515 Jan15 JanFeb '25Feb '2515 Feb15 Feb

Languages

The only known language in this repository is Jupyter Notebook

Jupyter NotebookJupyter Notebook

updated: 2025-02-22 @ 07:45am, id: 870039374 / R_kgDOM9u_Tg