microsoft / MMLU-CF

A Contamination-free Multi-task Language Understanding Benchmark

microsoft
microsoft
Date Created 2024-12-02 (3 months ago)
Commits 36 (last one 2 months ago)
Stargazers 114 (0 this week)
Watchers 3 (0 this week)
Forks 2
License mit
Ranking

RepositoryStats indexes 630,443 repositories, of these microsoft/MMLU-CF is ranked #280,023 (56th percentile) for total stargazers, and #416,864 for total watchers.

microsoft/MMLU-CF is also tagged with popular topics, for these it's ranked: llm (#1,872/3538),  benchmark (#419/820)

Other Information

Homepage URL: https://arxiv.org/pdf/2412.15194

Star History

Github stargazers over time

140140120120100100808060604040202000Jan '25Jan '2515 Jan15 JanFeb '25Feb '2515 Feb15 FebMar '25Mar '2515 Mar15 Mar

Watcher History

Github watchers over time, collection started in '23

44443333332222Jan '25Jan '2510 Jan10 Jan20 Jan20 JanFeb '25Feb '2510 Feb10 Feb20 Feb20 FebMar '25Mar '2510 Mar10 Mar20 Mar20 Mar

Recent Commit History

36 commits on the default branch (main) since jan '22

4040353530302525202015151010550015 Dec15 DecJan '25Jan '2515 Jan15 JanFeb '25Feb '2515 Feb15 FebMar '25Mar '2515 Mar15 Mar

Yearly Commits

Commits to the default branch (main) per year

30302525202015151010550020242024

Issue History

Total Issues
Open Issues
Closed Issues
332.52.5221.51.5110.50.500Jan '25Jan '2510 Jan10 Jan20 Jan20 JanFeb '25Feb '2510 Feb10 Feb20 Feb20 FebMar '25Mar '2510 Mar10 Mar20 Mar20 Mar

Languages

We don't have any language data for this repository

It's a mystery

updated: 2025-03-12 @ 07:18pm, id: 897452247 / R_kgDONX4I1w