9 results found Sort:

JinjieNi
MixEval JinjieNi
41
235
unknown
1
The official evaluation suite and dynamic data release for MixEval.
mixeval benchmark evaluation llm-inference llm-evaluation benchmark-mixture foundation-models benchmarking-suite evaluation-framework large-language-model large-language-models benchmarking-framework large-multimodal-models llm-evaluation-framework
Created 2024-06-01
120 commits to main branch, last one 5 months ago
dice-group
gerbil dice-group
57
226
agpl-3.0
28
GERBIL - General Entity annotatoR Benchmark
benchmarking entity-linking entity-annotation benchmarking-framework named-entity-recognition
Created 2014-09-11
979 commits to master branch, last one 21 days ago
microsoft
MLOS microsoft
72
154
mit
12
MLOS is a project to enable autotuning for systems.
autotuning benchmarking data-science infrastructure optimize-systems benchmarking-framework performance-engineering
Created 2020-04-06
539 commits to main branch, last one about a month ago
neurosim
DNN_NeuroSim_V2.1 neurosim
61
146
unknown
1
Benchmark framework of compute-in-memory based accelerators for deep neural network (on-chip training chip focused)
dnn-neurosim chip-training xiaochen-peng memory-accelerators benchmarking-framework
Created 2020-08-07
96 commits to master branch, last one about a year ago
spcl
npbench spcl
33
80
bsd-3-clause
10
NPBench - A Benchmarking Suite for High-Performance NumPy
numpy python benchmarking-suite benchmarking-framework
Created 2021-04-28
336 commits to main branch, last one 18 days ago
pyrddlgym-project
pyRDDLGym pyrddlgym-project
22
79
mit
7
A toolkit for auto-generation of OpenAI Gym environments from RDDL description files.
gym rddl planner planners planning gymnasium simulator simulation visualizer model-based benchmarking rddl-domains visualisation visualization gym-environments benchmark-framework evaluation-framework benchmarking-framework reinforcement-learning planning-domain-definition-language
Created 2022-07-10
2,127 commits to main branch, last one 5 days ago
HewlettPackard
dc-rl HewlettPackard
11
51
mit
6
SustainDC is a set of Python environments for Data Center simulation and control using Heterogeneous Multi Agent Reinforcement Learning. Includes customizable environments for workload scheduling, coo...
python benchmark gymnasium data-center benchmarking sustainability carbon-footprint machine-learning energy-efficiency battery-management workload-scheduling cooling-optimization gymnasium-environment sustainable-computing benchmarking-framework data-center-management multi-agent-reinforcement-learning heterogeneous-reinforcement-learning reinforcement-learningmulti-agent-systems
Created 2023-05-31
404 commits to main branch, last one about a month ago
neurosim
DNN_NeuroSim_V2.0 neurosim
18
48
unknown
2
Benchmark framework of compute-in-memory based accelerators for deep neural network (on-chip training chip focused)
dnn-neurosim chip-training xiaochen-peng memory-accelerators benchmarking-framework
Created 2020-03-12
89 commits to master branch, last one 3 years ago
KumarRobotics
kr_mp_design KumarRobotics
3
42
bsd-3-clause
7
A guidance for the design and evaluation of motion planners for quadrotors in Environments with Varying Complexities
motion-planning benchmarking-framework
Created 2023-09-14
10 commits to main branch, last one 8 months ago