11 results found Sort:

MinghuiChen43
awesome-trustworthy-deep-learning MinghuiChen43
35
345
mit
13
A curated list of trustworthy deep learning papers. Daily updating...
privacy backdoor fairness green-ai security causality ownership poisoning robustness uncertainty ai-alignment watermarking deep-learning hallucinations gradient-leakage machine-unlearning interpretable-deep-learning membership-inference-attack adversarial-machine-learning out-of-distribution-generalization
Created 2020-07-19
646 commits to master branch, last one a day ago
agencyenterprise
PromptInject agencyenterprise
32
320
mit
11
PromptInject is a framework that assembles prompts in a modular fashion to provide a quantitative analysis of the robustness of LLMs to adversarial prompt attacks. 🏆 Best Paper Awards @ NeurIPS ML Sa...
agi gpt-3 ai-safety ml-safety ai-alignment agi-alignment language-models chain-of-thought machine-learning prompt-engineering adversarial-attacks large-language-models
Created 2022-10-25
2 commits to main branch, last one 2 years ago
tomekkorbak
pretraining-with-human-feedback tomekkorbak
14
178
mit
6
Code accompanying the paper Pretraining Language Models with Human Preferences
gpt rlhf ai-safety pretraining ai-alignment language-models decision-transformers reinforcement-learning
Created 2023-02-20
5 commits to master branch, last one 10 months ago
lets-make-safe-ai
make-safe-ai lets-make-safe-ai
7
168
unknown
2
How to Make Safe AI? Let's Discuss! 💡|💬|🙌|📚
ai agi ai-safety ai-alignment artificial-intelligence artificial-general-intelligence
Created 2023-02-27
11 commits to main branch, last one about a year ago
Giskard-AI
awesome-ai-safety Giskard-AI
13
166
apache-2.0
3
📚 A curated list of papers & technical articles on AI Quality & Safety
ai ml llm mlops llmops awesome ai-safety ml-safety ai-quality ethical-ai ml-testing robustness ai-alignment awesome-list model-testing computer-vision machine-learning model-validation artificial-intelligence natural-language-processing
Created 2023-04-19
28 commits to main branch, last one about a year ago
wjfu99
MIA-Tuner wjfu99
8
128
unknown
9
[AAAI'25 Oral] "MIA-Tuner: Adapting Large Language Models as Pre-training Text Detector".
ai-alignment large-language-models pretraining-data-detection membership-inference-attack
Created 2023-12-20
1 commits to main branch, last one 7 days ago
EzgiKorkmaz
adversarial-reinforcement-learning EzgiKorkmaz
5
94
unknown
6
Reading list for adversarial perspective and robustness in deep reinforcement learning.
ai-safety safe-rlhf ai-alignment responsible-ai adversarial-policies machine-learning-safety robust-machine-learning deep-reinforcement-learning meta-reinforcement-learning safe-reinforcement-learning adversarial-machine-learning explainable-machine-learning reinforcement-learning-safety robust-reinforcement-learning reinforcement-learning-alignment artificial-intelligence-alignment multiagent-reinforcement-learning adversarial-reinforcement-learning robust-deep-reinforcement-learning
Created 2023-09-08
15 commits to main branch, last one 6 months ago
dit7ya
awesome-ai-alignment dit7ya
11
67
unknown
5
A curated list of awesome resources for Artificial Intelligence Alignment research
awesome ai-safety ai-alignment awesome-list
Created 2018-11-16
19 commits to master branch, last one about a year ago
AthenaCore
AwesomeResponsibleAI AthenaCore
10
58
mit
4
A curated list of awesome academic research, books, code of ethics, data sets, institutes, newsletters, principles, podcasts, reports, tools, regulations and standards related to Responsible, Trustwor...
ai xai ai-safety ethical-ai fairness-ai ai-alignment ai-standards awesome-list ai-governance ai-regulation explainable-ai responsible-ai trustworthy-ai interpretable-ai
Created 2021-09-05
296 commits to main branch, last one 2 days ago
wesg52
sparse-probing-paper wesg52
10
52
mit
2
Sparse probing paper full code.
ai-safety ai-alignment interpretability mechanistic-interpretability
Created 2023-05-02
5 commits to main branch, last one about a year ago
RLHFlow
Directional-Preference-Alignment RLHFlow
3
52
apache-2.0
3
Directional Preference Alignment
rlhf ai-alignment large-language-models
Created 2024-02-27
11 commits to main branch, last one 2 months ago