9 results found Sort:

Psycoy
MixEval Psycoy
37
229
unknown
1
The official evaluation suite and dynamic data release for MixEval.
mixeval benchmark evaluation llm-inference llm-evaluation benchmark-mixture foundation-models benchmarking-suite evaluation-framework large-language-model large-language-models benchmarking-framework large-multimodal-models llm-evaluation-framework
Created 2024-06-01
120 commits to main branch, last one about a month ago
dice-group
gerbil dice-group
58
224
agpl-3.0
29
GERBIL - General Entity annotatoR Benchmark
benchmarking entity-linking entity-annotation benchmarking-framework named-entity-recognition
Created 2014-09-11
962 commits to master branch, last one 4 months ago
microsoft
MLOS microsoft
68
145
mit
13
MLOS is a project to enable autotuning for systems.
autotuning benchmarking data-science infrastructure optimize-systems benchmarking-framework performance-engineering
Created 2020-04-06
500 commits to main branch, last one 3 days ago
neurosim
DNN_NeuroSim_V2.1 neurosim
55
128
unknown
1
Benchmark framework of compute-in-memory based accelerators for deep neural network (on-chip training chip focused)
dnn-neurosim chip-training xiaochen-peng memory-accelerators benchmarking-framework
Created 2020-08-07
96 commits to master branch, last one 10 months ago
spcl
npbench spcl
28
75
bsd-3-clause
12
NPBench - A Benchmarking Suite for High-Performance NumPy
numpy python benchmarking-suite benchmarking-framework
Created 2021-04-28
95 commits to main branch, last one 6 months ago
pyrddlgym-project
pyRDDLGym pyrddlgym-project
17
73
mit
8
A toolkit for auto-generation of OpenAI Gym environments from RDDL description files.
gym rddl planner planners planning gymnasium simulator simulation visualizer model-based benchmarking rddl-domains visualisation visualization gym-environments benchmark-framework evaluation-framework benchmarking-framework reinforcement-learning planning-domain-definition-language
Created 2022-07-10
2,065 commits to main branch, last one 24 days ago
neurosim
DNN_NeuroSim_V2.0 neurosim
18
46
unknown
2
Benchmark framework of compute-in-memory based accelerators for deep neural network (on-chip training chip focused)
dnn-neurosim chip-training xiaochen-peng memory-accelerators benchmarking-framework
Created 2020-03-12
89 commits to master branch, last one 3 years ago
KumarRobotics
kr_mp_design KumarRobotics
3
39
bsd-3-clause
7
A guidance for the design and evaluation of motion planners for quadrotors in Environments with Varying Complexities
motion-planning benchmarking-framework
Created 2023-09-14
10 commits to main branch, last one 4 months ago
HewlettPackard
dc-rl HewlettPackard
7
36
mit
7
SustainDC is a set of Python environments for Data Center simulation and control using Heterogeneous Multi Agent Reinforcement Learning. Includes customizable environments for workload scheduling, coo...
python benchmark gymnasium data-center benchmarking sustainability carbon-footprint machine-learning energy-efficiency battery-management workload-scheduling cooling-optimization gymnasium-environment sustainable-computing benchmarking-framework data-center-management multi-agent-reinforcement-learning heterogeneous-reinforcement-learning reinforcement-learningmulti-agent-systems
Created 2023-05-31
403 commits to main branch, last one 15 days ago