10 results found Sort:

ChemFoundationModels
ChemLLMBench ChemFoundationModels
6
127
unknown
4
What can Large Language Models do in chemistry? A comprehensive benchmark on eight tasks
llm nlp benchmark chemistry ai4science llms-benchmarking large-language-models
Created 2023-05-21
62 commits to main branch, last one 4 months ago
lerogo
MMGenBench lerogo
5
84
unknown
3
Official repository of MMGenBench
mllm mmgenbench llms-benchmarking
Created 2024-11-18
6 commits to main branch, last one 11 days ago
bboylyg
BackdoorLLM bboylyg
5
81
mit
3
BackdoorLLM: A Comprehensive Benchmark for Backdoor Attacks on Large Language Models
llms backdoor llms-benchmarking
Created 2024-08-21
79 commits to main branch, last one 3 months ago
parea-ai
parea-sdk-py parea-ai
6
75
apache-2.0
2
Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)
llm llmops metrics llm-eval llm-tools generative-ai llm-evaluation good-first-issue llms-benchmarking prompt-engineering llm-evaluation-toolkit llm-evaluation-framework
Created 2023-07-24
1,067 commits to main branch, last one 2 months ago
lamalab-org
chem-bench lamalab-org
6
54
mit
2
How good are LLMs at chemistry?
llm llms safety benchmark chemistry machine-learning llms-benchmarking materials-science
Created 2023-05-16
1,083 commits to main branch, last one about a month ago
FSoft-AI4Code
XMainframe FSoft-AI4Code
5
43
apache-2.0
4
Language Model for Mainframe Modernization
cobol codellm mainframe migration llms-benchmarking code-summarization
Created 2024-08-02
30 commits to main branch, last one 3 months ago
RaptorMai
CompBench RaptorMai
1
31
other
1
CompBench evaluates the comparative reasoning of multimodal large language models (MLLMs) with 40K image pairs and questions across 8 dimensions of relative comparison: visual attribute, existence, st...
llms benchmark reasoning evaluation-llms human-annotation foundation-models llms-benchmarking vision-and-language large-language-models vision-language-model multimodal-deep-learning multimodal-large-language-models
Created 2024-07-23
4 commits to main branch, last one 3 months ago
epfl-dlab
cc_flows epfl-dlab
2
31
mit
28
The data and implementation for the experiments in the paper "Flows: Building Blocks of Reasoning and Collaborating AI".
ai llms agents aiflows llms-reasoning llms-benchmarking competitive-coding competitive-programming competitive-programming-contests
Created 2023-08-02
6 commits to main branch, last one 9 months ago
declare-lab
resta declare-lab
1
26
unknown
2
Restore safety in fine-tuned language models through task arithmetic
llm llms safety alignment llm-safety llms-benchmarking alignment-algorithm llm-safety-benchmark
Created 2024-02-17
83 commits to main branch, last one 8 months ago
amazon-science
llm-code-preference amazon-science
2
26
other
3
Training and Benchmarking LLMs for Code Preference.
llm-training llm-evaluation code-generation llms-benchmarking
Created 2024-10-22
10 commits to main branch, last one 17 days ago