nl4opt / ORQA

[AAAI 2025] ORQA is a new QA benchmark designed to assess the reasoning capabilities of LLMs in a specialized technical domain of Operations Research. The benchmark evaluates whether LLMs can emulate the knowledge and reasoning skills of OR experts when presented with complex optimization modeling tasks.

nl4opt
nl4opt
Date Created 2024-12-21 (3 months ago)
Commits 18 (last one 10 days ago)
Stargazers 54 (2 this week)
Watchers 1 (0 this week)
Forks 0
License unknown
Ranking

RepositoryStats indexes 633,155 repositories, of these nl4opt/ORQA is ranked #466,847 (26th percentile) for total stargazers, and #557,746 for total watchers.

nl4opt/ORQA is also tagged with popular topics, for these it's ranked: llm (#2,556/3577),  optimization (#759/946)

Star History

Github stargazers over time

60605050404030302020101000Jan '25Jan '2515 Jan15 JanFeb '25Feb '2515 Feb15 FebMar '25Mar '2515 Mar15 Mar

Watcher History

Github watchers over time, collection started in '23

2222111111000021 Mar21 Mar22 Mar22 Mar23 Mar23 Mar24 Mar24 Mar25 Mar25 Mar26 Mar26 Mar27 Mar27 Mar28 Mar28 Mar29 Mar29 Mar30 Mar30 Mar

Recent Commit History

18 commits on the default branch (main) since jan '22

181816161414121210108866442200Jan '25Jan '2515 Jan15 JanFeb '25Feb '2515 Feb15 FebMar '25Mar '2515 Mar15 Mar

Yearly Commits

Commits to the default branch (main) per year

88776655443322110020242024

Issue History

No issues have been posted

Languages

We don't have any language data for this repository

It's a mystery

updated: 2025-03-30 @ 11:31am, id: 906451448 / R_kgDONgdZ-A