Search Results - RepositoryStats

193

2.2k

apache-2.0

21

UpTrain is an open-source unified platform to evaluate and improve Generative AI applications. We provide grades for 20+ preconfigured checks (covering language, code, embedding use-cases), perform ro...

llmops llm-eval llm-test evaluation monitoring openai-evals llm-prompting autoevaluation experimentation machine-learning prompt-engineering jailbreak-detection root-cause-analysis hallucination-detection

Created 2022-11-07

770 commits to main branch, last one 4 months ago

LLM-Finetuning-Toolkit georgian-io

92

793

apache-2.0

16

Toolkit for fine-tuning, ablating and unit-testing open-source LLMs.

nlp lora qlora falcon llama2 zephyr flan-t5 llm-test redpajama finetuning mistral-7b fine-tuning unit-testing summarization ablation-study classification nlp-machine-learning large-language-models

Created 2023-07-24

540 commits to main branch, last one 2 months ago

langtest JohnSnowLabs

41

505

apache-2.0

10

Deliver safe & effective language models

llm nlp mlops llm-test ai-safety ml-safety ai-testing benchmarks ml-testing llm-testing ethics-in-ai responsible-ai trustworthy-ai llm-as-evaluator model-assessment benchmark-framework large-language-models llm-evaluation-toolkit artificial-intelligence

Created 2022-11-18

5,461 commits to main branch, last one 2 months ago

athina-sdk athina-ai

1

132

unknown

2

LLM Testing SDK that helps you write and run tests to monitor your LLM app in production

llm aiops mlops llmops llm-test monitoring testing-tools

Created 2023-07-02

101 commits to master branch, last one 11 months ago