19 results found Sort:

Giskard-AI
giskard Giskard-AI
215
3.4k
apache-2.0
27
🐢 Open-Source Evaluation & Testing for LLMs and ML models
llm mlops llmops llm-eval ai-safety ml-safety ai-testing ml-testing ai-red-team ai-security fairness-ai llm-security ml-validation llm-evaluation rag-evaluation red-team-tools responsible-ai trustworthy-ai model-monitoring ethical-artificial-intelligence
Created 2022-03-06
9,675 commits to main branch, last one a day ago
pathwaycom
llm-app pathwaycom
176
3.0k
mit
28
LLM App templates for RAG, knowledge mining, and stream analytics. Ready to run with Docker,⚡in sync with your data sources.
llm rag llmops chatbot open-ai pathway llm-local real-time hugging-face llm-security vector-index llm-prompting vector-database machine-learning retrieval-augmented-generation
Created 2023-07-19
153 commits to main branch, last one 22 hours ago
protectai
llm-guard protectai
104
918
mit
17
The Security Toolkit for LLM Interactions
llm llmops chatgpt llm-security transformers security-tools prompt-injection prompt-engineering large-language-models adversarial-machine-learning
Created 2023-07-27
447 commits to main branch, last one 4 days ago
mariocandela
beelzebub mariocandela
48
585
mit
8
A secure low code honeypot framework, leveraging AI for System Virtualization.
go llm golang openai honeypot low-code research security whitehat framework kubernetes cloudnative llm-honeypot llm-security cloudsecurity cybersecurity research-project
Created 2022-05-08
201 commits to main branch, last one 19 days ago
EasyJailbreak
EasyJailbreak EasyJailbreak
24
267
gpl-3.0
5
An easy-to-use Python framework to generate adversarial jailbreak prompts.
jailbreak llm-security jailbreak-framework large-language-model llm-safety-benchmark discrete-optimization
Created 2024-01-31
81 commits to master branch, last one about a month ago
chawins
llm-sp chawins
17
261
apache-2.0
15
Papers and resources related to the security and privacy of LLMs 🤖
llm privacy security llm-privacy awesome-list llm-security adversarial-machine-learning
Created 2023-11-15
28 commits to main branch, last one a day ago
deadbits
vigil-llm deadbits
31
254
apache-2.0
9
⚡ Vigil ⚡ Detect prompt injections, jailbreaks, and other potentially risky Large Language Model (LLM) inputs
llmops llm-security yara-scanner security-tools prompt-injection adversarial-attacks large-language-models adversarial-machine-learning
Created 2023-09-04
230 commits to main branch, last one 4 months ago
msoedov
agentic_security msoedov
17
217
apache-2.0
5
Agentic LLM Vulnerability Scanner
llm-fuzzer llm-fuzzing llm-scanner llm-security llm-guardrails llm-jailbreaks owasp-llm-top-10 llm-vulnerabilities llm-fuzzer-aggregator
Created 2024-04-11
64 commits to main branch, last one 18 days ago
arekusandr
last_layer arekusandr
1
90
mit
2
Ultra-fast, low latency LLM prompt injection/jailbreak detection ⛓️
jailbreak llm-guard llm-local llm-security llm-guardrails security-tools chatgpt-prompts prompt-engineering large-language-models
Created 2024-03-29
40 commits to main branch, last one about a month ago
liu00222
Open-Prompt-Injection liu00222
13
90
unknown
2
Prompt injection attacks and defenses in LLM-integrated applications
llms llm-security prompt-injection prompt-injection-tool
Created 2023-10-19
22 commits to main branch, last one 19 hours ago
yevh
TaaC-AI yevh
9
85
unknown
2
AI-driven Threat modeling-as-a-Code (TaaC-AI)
ai gpt taac gpt-3 gpt-4 threat claude-3 devsecops mistral-7b llm-security threat-models threat-modeling secure-development application-security threat-modeling-tool threat-modeling-from-code
Created 2023-12-14
61 commits to main branch, last one about a month ago
raga-ai-hub
raga-llm-hub raga-ai-hub
6
76
other
2
Framework for LLM evaluation, guardrails and security
llmops guardrails llm-security llm-evaluation
Created 2024-03-02
5 commits to main branch, last one a day ago
ZenGuard-AI
fast-llm-security-guardrails ZenGuard-AI
8
75
mit
2
The fastest && easiest LLM security and privacy guardrails for GenAI apps.
security llm-guard llm-privacy llm-security llm-guardrails prompt-security adversarial-machine-learning
Created 2024-03-11
117 commits to main branch, last one 2 days ago
lakeraai
pint-benchmark lakeraai
7
61
mit
6
A benchmark for prompt injection detection systems.
llm benchmark llm-security llm-benchmarking prompt-injection
Created 2024-03-27
47 commits to main branch, last one 3 days ago
pdparchitect
llm-hacking-database pdparchitect
1
46
unknown
2
This repository contains various attack against Large Language Models.
llm hacking security llm-security
Created 2024-04-15
25 commits to main branch, last one 10 days ago
NaniDAO
ie NaniDAO
6
36
agpl-3.0
5
intents engine
llm-security account-abstraction
Created 2024-02-01
114 commits to main branch, last one 2 months ago
microsoft
BIPIA microsoft
1
32
other
6
A benchmark for evaluating the robustness of LLMs and defenses to indirect prompt injection attacks.
llm-security
Created 2024-01-04
34 commits to main branch, last one about a month ago
briland
LLM-security-and-privacy briland
4
30
unknown
2
LLM security and privacy
llm awesome privacy security llm-privacy llm-threats awesome-list llm-security generative-ai llm-framework llm-vulnerabilities awesome-llm-security-and-privacy
Created 2023-08-30
40 commits to main branch, last one about a month ago
llm-platform-security
SecGPT llm-platform-security
4
25
other
3
SecGPT: An execution isolation architecture for LLM-based systems
gpt llm chatgpt sandbox isolation langchain llm-agent openai-api llm-privacy llm-platform llm-security llm-framework llm-based-systems multi-agent-systems
Created 2024-03-07
6 commits to main branch, last one about a month ago