4 results found Sort:

uptrain-ai
uptrain uptrain-ai
174
2.1k
apache-2.0
20
UpTrain is an open-source unified platform to evaluate and improve Generative AI applications. We provide grades for 20+ preconfigured checks (covering language, code, embedding use-cases), perform ro...
llmops llm-eval llm-test evaluation monitoring openai-evals llm-prompting autoevaluation experimentation machine-learning prompt-engineering jailbreak-detection root-cause-analysis hallucination-detection
Created 2022-11-07
764 commits to main branch, last one 21 days ago
georgian-io
LLM-Finetuning-Toolkit georgian-io
85
723
apache-2.0
14
Toolkit for fine-tuning, ablating and unit-testing open-source LLMs.
nlp lora qlora falcon llama2 zephyr flan-t5 llm-test redpajama finetuning mistral-7b fine-tuning unit-testing summarization ablation-study classification nlp-machine-learning large-language-models
Created 2023-07-24
527 commits to main branch, last one 4 days ago
JohnSnowLabs
langtest JohnSnowLabs
35
468
apache-2.0
11
Deliver safe & effective language models
nlp mlops llm-test ml-safety benchmarks ml-testing ethics-in-ai responsible-ai model-assessment large-language-models
Created 2022-11-18
5,209 commits to main branch, last one 11 days ago
athina-ai
athina-sdk athina-ai
1
129
unknown
2
LLM Testing SDK that helps you write and run tests to monitor your LLM app in production
llm aiops mlops llmops llm-test monitoring testing-tools
Created 2023-07-02
101 commits to master branch, last one 5 months ago