Search Results - RepositoryStats

awesome-semantic-segmentation mrgloom

2.5k

10.4k

unknown

443

:metal: awesome-semantic-segmentation

benchmark evaluation deeplearning semantic-segmentation

Created 2015-10-03

417 commits to master branch, last one 3 years ago

langfuse langfuse

368

4.0k

other

14

🪢 Open source LLM engineering platform: Observability, metrics, evals, prompt management, playground, datasets. Integrates with LlamaIndex, Langchain, OpenAI SDK, LiteLLM, and more. 🍊YC W23

gpt llm evals llmops openai analytics langchain evaluation monitoring playground llama-index open-source self-hosted ycombinator observability llm-evaluation prompt-management prompt-engineering large-language-models

Created 2023-05-18

1,889 commits to main branch, last one 20 hours ago

govaluate Knetic

493

3.6k

mit

66

Arbitrary expression evaluation for golang

go parsing evaluation expression

Created 2014-12-19

311 commits to master branch, last one 6 years ago

write-you-a-haskell sdiehl

256

3.3k

mit

192

Building a modern functional compiler from first principles. (http://dev.stephendiehl.com/fun/)

book type haskel compiler pdf-book evaluation type-system type-theory type-checking hindley-milner type-inference lambda-calculus functional-language functional-programming intermediate-representation

Created 2015-01-05

299 commits to master branch, last one 7 years ago

evo MichaelGrupp

736

3.3k

gpl-3.0

50

Python package for the evaluation of odometry and SLAM

ros tum ros2 slam euroc kitti mapping metrics odometry robotics benchmark evaluation trajectory trajectory-analysis trajectory-evaluation

Created 2017-09-13

428 commits to master branch, last one 6 days ago

promptfoo promptfoo

206

3.1k

mit

17

Test your prompts, models, and RAGs. Catch regressions and improve prompt quality. LLM evals for OpenAI, Azure, Anthropic, Gemini, Mistral, Llama, Bedrock, Ollama, and other local & private models wit...

ci llm rag cicd ci-cd llmops prompts testing llm-eval evaluation llm-evaluation prompt-testing prompt-engineering evaluation-framework llm-evaluation-framework

Created 2023-04-28

1,179 commits to main branch, last one 16 hours ago

klipse viebel

153

3.1k

gpl-3.0

55

Klipse is a JavaScript plugin for embedding interactive code snippets in tech blogs.

lua ruby ocaml react prolog python scheme clojure reactjs reasonml brainfuck evaluation javascript common-lisp clojurescript klipse-plugin code-evaluation codemirror-editor interactive-snippets

Created 2015-11-19

1,024 commits to master branch, last one about a year ago

opencompass open-compass

306

2.9k

apache-2.0

21

OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

llm llama2 llama3 openai chatgpt benchmark evaluation large-language-model

Created 2023-06-15

565 commits to main branch, last one a day ago

Automatic_Speech_Recognition zzw922cn

538

2.8k

mit

147

End-to-end Automatic Speech Recognition for Madarian and English in Tensorflow

cnn rnn lstm audio paper phonemes end-to-end evaluation tensorflow deep-learning timit-dataset feature-vector data-preprocessing speech-recognition layer-normalization rnn-encoder-decoder chinese-speech-recognition automatic-speech-recognition

Created 2016-11-13

266 commits to master branch, last one 2 years ago

SuperCLUE CLUEbenchmark

89

2.7k

unknown

35

SuperCLUE: 中文通用大模型综合性基准 | A Benchmark for Foundation Models in Chinese

gpt-4 chatgpt chinese evaluation foundation-models

Created 2023-05-02

247 commits to main branch, last one 9 days ago

promptbench microsoft

172

2.2k

mit

21

A unified evaluation framework for large language models

prompt chatgpt benchmark evaluation robustness prompt-engineering adversarial-attacks large-language-models

Created 2023-06-13

239 commits to main branch, last one 5 days ago

ChainForge ianarawjo

150

2.1k

mit

24

An open-source visual programming environment for battle-testing prompts to LLMs.

ai llms llmops evaluation prompt-engineering large-language-models

Created 2023-03-26

369 commits to main branch, last one 14 days ago

uptrain uptrain-ai

170

2.0k

apache-2.0

20

UpTrain is an open-source unified platform to evaluate and improve Generative AI applications. We provide grades for 20+ preconfigured checks (covering language, code, embedding use-cases), perform ro...

llmops llm-eval llm-test evaluation monitoring openai-evals llm-prompting autoevaluation experimentation machine-learning prompt-engineering jailbreak-detection root-cause-analysis hallucination-detection

Created 2022-11-07

763 commits to main branch, last one 23 hours ago

evaluate huggingface

228

1.8k

apache-2.0

50

🤗 Evaluate: A library for easily evaluating machine learning models and datasets.

evaluation machine-learning

Created 2022-03-30

943 commits to main branch, last one about a month ago

EvalAI Cloud-CV

768

1.7k

other

54

:cloud: :rocket: :bar_chart: :chart_with_upwards_trend: Evaluating state of the art in AI

ai django docker evalai python angular7 angularjs challenge evaluation leaderboard ai-challenges reproducibility machine-learning reproducible-research artificial-intelligence

Created 2016-10-21

2,422 commits to master branch, last one about a month ago

avalanche ContinualAI

281

1.7k

mit

27

Avalanche: an End-to-End Library for Continual Learning based on PyTorch.

library metrics pytorch training framework benchmarks evaluation strategies continualai deep-learning lifelong-learning continual-learning

Created 2020-03-05

3,909 commits to master branch, last one 22 hours ago

AB3DMOT xinshuoweng

401

1.6k

other

48

(IROS 2020, ECCVW 2020) Official Python Implementation for "3D Multi-Object Tracking: A Baseline and New Evaluation Metrics"

kitti 3d-mot 3d-multi kitti-3d robotics tracking real-time evaluation 3d-tracking computer-vision machine-learning 2d-mot-evaluation evaluation-metrics multi-object-tracking 3d-multi-object-tracking

Created 2019-06-19

221 commits to master branch, last one about a year ago

pycm sepandhaghighi

121

1.4k

mit

36

Multi-class confusion matrix library in Python

Created 2018-01-22

3,033 commits to master branch, last one 12 months ago

nlg-eval Maluuba

218

1.3k

other

29

Evaluation code for various unsupervised automated metrics for Natural Language Generation.

nlg nlp bleu cider rouge dialog meteor rouge-l dialogue bleu-score evaluation skip-thoughts machine-translation skip-thought-vectors task-oriented-dialogue natural-language-generation natural-language-processing

Created 2017-06-27

87 commits to master branch, last one 2 months ago

LLM-eval-survey MLGroupJLU

80

1.3k

unknown

10

The official GitHub page for the survey paper "A Survey on Evaluation of Large Language Models".

llm llms benchmark evaluation model-assessment large-language-models

Created 2023-07-02

254 commits to main branch, last one 5 months ago

alpaca_eval tatsu-lab

174

1.2k

apache-2.0

9

An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.

nlp rlhf evaluation leaderboard deep-learning foundation-models instruction-following large-language-models

Created 2023-05-25

498 commits to main branch, last one a day ago

lispy abo-abo

129

1.2k

unknown

26

Short and sweet LISP editing

python scheme clojure emacs-lisp evaluation navigation common-lisp refactoring

Created 2014-01-10

2,707 commits to master branch, last one about a year ago

xai EthicalML

160

1.1k

mit

44

XAI - An eXplainability toolbox for machine learning

ai ml xai bias imbalance evaluation upsampling xai-library downsampling explainability explainable-ai explainable-ml bias-evaluation interpretability machine-learning feature-importance artificial-intelligence machine-learning-explainability

Created 2019-01-11

91 commits to master branch, last one 2 years ago

fuzzbench google

255

1.1k

apache-2.0

36

FuzzBench - Fuzzer benchmarking as a service.

fuzzing security evaluation benchmarking benchmark-framework

Created 2020-02-04

1,336 commits to master branch, last one 12 days ago

lunary lunary-ai

94

904

apache-2.0

8

The production toolkit for LLMs. Observability, prompt management and evaluations.

ai llm logs openai prompts testing langchain evaluation monitoring self-hosted hacktoberfest observability

Created 2023-05-12

1,072 commits to main branch, last one a day ago

torch-fidelity toshas

58

891

other

7

High-fidelity performance metrics for generative models in PyTorch

gan metrics pytorch precision evaluation inception-score reproducibility generative-model reproducible-research perceptual-path-length kernel-inception-distance frechet-inception-distance

Created 2020-04-23

202 commits to master branch, last one 4 months ago