14 results found Sort:

Giskard-AI
giskard Giskard-AI
277
4.1k
apache-2.0
33
🐢 Open-Source Evaluation & Testing for AI & LLM systems
llm mlops llmops llm-eval ai-safety ml-safety ai-testing ml-testing ai-red-team ai-security fairness-ai llm-security ml-validation llm-evaluation rag-evaluation red-team-tools responsible-ai trustworthy-ai evaluation-framework ethical-artificial-intelligence
Created 2022-03-06
10,170 commits to main branch, last one 2 days ago
hendrycks
robustness hendrycks
144
1.0k
apache-2.0
14
Corruption and Perturbation Robustness (ICLR 2019)
pytorch imagenet ml-safety robustness deep-learning computer-vision machine-learning domain-generalization convolutional-neural-networks
Created 2018-04-06
74 commits to master branch, last one 2 years ago
hendrycks
natural-adv-examples hendrycks
52
596
mit
12
A Harder ImageNet Test Set (CVPR 2021)
imagenet ml-safety robustness adversarial-attacks adversarial-example domain-generalization
Created 2019-06-10
16 commits to master branch, last one 3 years ago
hendrycks
outlier-exposure hendrycks
108
548
apache-2.0
19
Deep Anomaly Detection with Outlier Exposure (ICLR 2019)
anomaly pytorch ml-safety calibration deep-learning anomaly-detection out-of-distribution-detection
Created 2018-05-22
42 commits to master branch, last one 3 years ago
JohnSnowLabs
langtest JohnSnowLabs
41
505
apache-2.0
10
Deliver safe & effective language models
llm nlp mlops llm-test ai-safety ml-safety ai-testing benchmarks ml-testing llm-testing ethics-in-ai responsible-ai trustworthy-ai llm-as-evaluator model-assessment benchmark-framework large-language-models llm-evaluation-toolkit artificial-intelligence
Created 2022-11-18
5,461 commits to main branch, last one 2 months ago
agencyenterprise
PromptInject agencyenterprise
32
320
mit
11
PromptInject is a framework that assembles prompts in a modular fashion to provide a quantitative analysis of the robustness of LLMs to adversarial prompt attacks. 🏆 Best Paper Awards @ NeurIPS ML Sa...
agi gpt-3 ai-safety ml-safety ai-alignment agi-alignment language-models chain-of-thought machine-learning prompt-engineering adversarial-attacks large-language-models
Created 2022-10-25
2 commits to main branch, last one 2 years ago
hendrycks
ss-ood hendrycks
31
266
mit
8
Self-Supervised Learning for OOD Detection (NeurIPS 2019)
ml-safety robustness uncertainty self-supervised self-supervised-learning out-of-distribution-detection
Created 2019-06-10
15 commits to master branch, last one 3 years ago
hendrycks
ethics hendrycks
44
261
mit
9
Aligning AI With Shared Human Values (ICLR 2021)
gpt-3 ai-safety ml-safety ethical-ai machine-ethics
Created 2020-08-06
25 commits to master branch, last one about a year ago
hendrycks
imagenet-r hendrycks
18
258
mit
8
ImageNet-R(endition) and DeepAugment (ICCV 2021)
ml-safety robustness domain-adaptation out-of-distribution domain-generalization
Created 2020-02-28
20 commits to master branch, last one 3 years ago
jiachens
ModelNet40-C jiachens
25
217
bsd-3-clause
14
Repo for "Benchmarking Robustness of 3D Point Cloud Recognition against Common Corruptions" https://arxiv.org/abs/2201.12296
pytorch benchmark ml-safety robustness deep-learning regularization computer-vision data-augmentation corruption-robustness point-cloud-processing
Created 2022-01-22
112 commits to master branch, last one about a year ago
Giskard-AI
awesome-ai-safety Giskard-AI
13
166
apache-2.0
3
📚 A curated list of papers & technical articles on AI Quality & Safety
ai ml llm mlops llmops awesome ai-safety ml-safety ai-quality ethical-ai ml-testing robustness ai-alignment awesome-list model-testing computer-vision machine-learning model-validation artificial-intelligence natural-language-processing
Created 2023-04-19
28 commits to main branch, last one about a year ago
hendrycks
anomaly-seg hendrycks
20
157
mit
10
The Combined Anomalous Object Segmentation (CAOS) Benchmark
ml-safety segmentation carla-simulator anomaly-detection out-of-distribution-detection
Created 2019-11-25
35 commits to master branch, last one about a year ago
hendrycks
pre-training hendrycks
17
100
apache-2.0
7
Pre-Training Buys Better Robustness and Uncertainty Estimates (ICML 2019)
ml-safety pretrained robustness calibration uncertainty data-corruption adversarial-examples out-of-distribution-detection
Created 2019-01-28
10 commits to master branch, last one 2 years ago
YyzHarry
ME-Net YyzHarry
10
52
mit
3
[ICML 2019] ME-Net: Towards Effective Adversarial Robustness with Matrix Estimation
icml defense icml-2019 ml-safety robustness matrix-completion matrix-estimation adversarial-attacks adversarial-example
Created 2019-04-22
30 commits to master branch, last one 4 years ago