31 results found Sort:

pathwaycom
llm-app pathwaycom
328
12.2k
mit
42
Ready-to-run cloud templates for RAG, AI pipelines, and enterprise search with live data. 🐳Docker-friendly.⚡Always in sync with Sharepoint, Google Drive, S3, Kafka, PostgreSQL, real-time data APIs, a...
llm rag llmops chatbot open-ai pathway llm-local real-time hugging-face llm-security vector-index llm-prompting vector-database machine-learning retrieval-augmented-generation
Created 2023-07-19
220 commits to main branch, last one 4 days ago
Giskard-AI
giskard Giskard-AI
290
4.3k
apache-2.0
34
🐢 Open-Source Evaluation & Testing for AI & LLM systems
llm mlops llmops llm-eval ai-safety ml-safety ai-testing ml-testing ai-red-team ai-security fairness-ai llm-security ml-validation llm-evaluation rag-evaluation red-team-tools responsible-ai trustworthy-ai evaluation-framework ethical-artificial-intelligence
Created 2022-03-06
10,170 commits to main branch, last one about a month ago
NVIDIA
garak NVIDIA
331
3.8k
apache-2.0
37
the LLM vulnerability scanner
ai llm-security llm-evaluation security-scanners vulnerability-assessment
Created 2023-05-10
1,544 commits to main branch, last one 7 days ago
verazuo
jailbreak_llms verazuo
267
2.9k
mit
36
[CCS'24] A dataset consists of 15,140 ChatGPT prompts from Reddit, Discord, websites, and open-source datasets (including 1,405 jailbreak prompts).
llm prompt chatgpt jailbreak jailbreaking llm-security large-language-model
Created 2023-08-01
19 commits to main branch, last one about a month ago
protectai
llm-guard protectai
177
1.4k
mit
18
The Security Toolkit for LLM Interactions
llm llmops chatgpt llm-security transformers security-tools prompt-injection prompt-engineering large-language-models adversarial-machine-learning
Created 2023-07-27
492 commits to main branch, last one 3 months ago
msoedov
agentic_security msoedov
105
945
apache-2.0
17
Agentic LLM Vulnerability Scanner / AI red teaming kit 🧪
llm-fuzzer ai-red-team llm-fuzzing llm-scanner llm-security agent-security llm-evaluation llm-guardrails llm-jailbreaks prompt-testing agent-framework llm-vulnerabilities llm-fuzzer-aggregator llm-evaluation-framework
Created 2024-04-11
263 commits to main branch, last one a day ago
mariocandela
beelzebub mariocandela
56
733
mit
12
A secure low code honeypot framework, leveraging AI for System Virtualization.
go llm golang llama3 ollama openai honeypot low-code research security whitehat framework kubernetes cloudnative llm-honeypot llm-security cloudsecurity cybersecurity research-project
Created 2022-05-08
241 commits to main branch, last one 4 days ago
EasyJailbreak
EasyJailbreak EasyJailbreak
43
537
gpl-3.0
8
An easy-to-use Python framework to generate adversarial jailbreak prompts.
jailbreak llm-security jailbreak-framework large-language-model llm-safety-benchmark discrete-optimization
Created 2024-01-31
89 commits to master branch, last one 4 months ago
chawins
llm-sp chawins
35
468
apache-2.0
18
Papers and resources related to the security and privacy of LLMs 🤖
llm privacy security llm-privacy awesome-list llm-security adversarial-machine-learning
Created 2023-11-15
44 commits to main branch, last one 2 months ago
deadbits
vigil-llm deadbits
37
341
apache-2.0
11
⚡ Vigil ⚡ Detect prompt injections, jailbreaks, and other potentially risky Large Language Model (LLM) inputs
llmops llm-security yara-scanner security-tools prompt-injection adversarial-attacks large-language-models adversarial-machine-learning
Created 2023-09-04
230 commits to main branch, last one 12 months ago
R3DRUN3
sploitcraft R3DRUN3
27
190
unlicense
4
🏴‍☠️ Hacking Guides, Demos and Proof-of-Concepts 🥷
ai aws cloud linux docker python hacking redteam windows tutorials llm-security cybersecurity network-security proof-of-concept hacking-tutorials container-security offensive-security web-vulnerabilities
Created 2024-06-23
178 commits to main branch, last one 12 days ago
liu00222
Open-Prompt-Injection liu00222
20
166
mit
2
This repository provides implementation to formalize and benchmark Prompt Injection attacks and defenses
llm llms llm-security prompt-injection security-and-privacy prompt-injection-tool
Created 2023-10-19
28 commits to main branch, last one 6 days ago
phantasmlabs
phantasm phantasmlabs
6
155
gpl-3.0
2
Toolkits to create a human-in-the-loop approval layer to monitor and guide AI agents workflow in real-time.
llm rust llmops ai-agents ai-safety dashboard monitoring ai-security open-source control-flow llm-security automation-tools approval-workflow human-in-the-loop human-computer-interaction
Created 2024-10-13
146 commits to main branch, last one 2 months ago
yevh
TaaC-AI yevh
13
123
unknown
5
AI-driven Threat modeling-as-a-Code (TaaC-AI)
ai gpt taac gpt-3 gpt-4 threat claude-3 devsecops mistral-7b llm-security threat-models threat-modeling secure-development application-security threat-modeling-tool threat-modeling-from-code
Created 2023-12-14
67 commits to main branch, last one 7 months ago
ZenGuard-AI
fast-llm-security-guardrails ZenGuard-AI
15
118
mit
2
The fastest && easiest LLM security guardrails for CX AI Agents and applications.
cx-agent security llm-guard llm-privacy llm-security llm-guardrails prompt-security
Created 2024-03-11
221 commits to main branch, last one 10 days ago
arekusandr
last_layer arekusandr
3
111
mit
2
Ultra-fast, low latency LLM prompt injection/jailbreak detection ⛓️
jailbreak llm-guard llm-local llm-security llm-guardrails security-tools chatgpt-prompts prompt-engineering large-language-models
Created 2024-03-29
40 commits to main branch, last one 9 months ago
raga-ai-hub
raga-llm-hub raga-ai-hub
12
110
other
2
Framework for LLM evaluation, guardrails and security
llmops guardrails llm-security llm-evaluation
Created 2024-03-02
9 commits to main branch, last one 4 months ago
lakeraai
pint-benchmark lakeraai
11
94
mit
5
A benchmark for prompt injection detection systems.
llm benchmark llm-security llm-benchmarking prompt-injection
Created 2024-03-27
57 commits to main branch, last one 4 months ago
pdparchitect
llm-hacking-database pdparchitect
5
87
unknown
4
This repository contains various attack against Large Language Models.
llm hacking security llm-security
Created 2024-04-15
25 commits to main branch, last one 8 months ago
RomiconEZ
llamator RomiconEZ
3
64
other
3
Framework for testing vulnerabilities of large language models (LLM).
ai llm nlp rag owasp attack python red-team jailbreak ai-security llm-testing red-teaming llm-security llm-read-team hallucinations misinformation rag-evaluation red-team-tools security-tools vulnerability-assessment
Created 2024-09-05
6 commits to release branch, last one 10 days ago
llm-platform-security
SecGPT llm-platform-security
7
58
other
3
SecGPT: An execution isolation architecture for LLM-based systems
gpt llm chatgpt sandbox isolation langchain llm-agent openai-api llm-privacy llm-platform llm-security llm-framework llm-based-systems multi-agent-systems
Created 2024-03-07
8 commits to main branch, last one 2 months ago
microsoft
BIPIA microsoft
4
55
other
6
A benchmark for evaluating the robustness of LLMs and defenses to indirect prompt injection attacks.
llm-security
Created 2024-01-04
34 commits to main branch, last one 9 months ago
NaniDAO
ie NaniDAO
7
54
agpl-3.0
6
intents engine
llm-security account-abstraction
Created 2024-02-01
188 commits to main branch, last one 3 months ago
azminewasi
Awesome-LLMs-ICLR-24 azminewasi
1
48
mit
1
It is a comprehensive resource hub compiling all LLM papers accepted at the International Conference on Learning Representations (ICLR) in 2024.
llm llms llmops llm-agent llm-privacy llm-serving llm-security llm-training llm-framework llm-inference llm-prompting llm-evaluation pretrained-models pretrained-weights large-language-model large-language-models pretrained-language-model large-language-models-for-graph-learning large-language-models-and-translation-systems
Created 2024-03-18
5 commits to main branch, last one 9 months ago
briland
LLM-security-and-privacy briland
7
44
unknown
2
LLM security and privacy
llm awesome privacy security llm-privacy llm-threats awesome-list llm-security generative-ai llm-framework llm-vulnerabilities awesome-llm-security-and-privacy
Created 2023-08-30
41 commits to main branch, last one 3 months ago
sinanw
llm-security-prompt-injection sinanw
8
36
mit
3
This project investigates the security of large language models by performing binary classification of a set of input prompts to discover malicious prompts. Several approaches have been analyzed using...
llm-security cybersecurity llm-prompting prompt-injection transformers-models
Created 2023-11-21
40 commits to main branch, last one about a year ago
TrustAI-laboratory
Learn-Prompt-Hacking TrustAI-laboratory
2
36
mit
1
This is The most comprehensive prompt hacking course available, which record our progress on a prompt engineering and prompt hacking course.
llm turorial jailbreak prompt-hack llm-learning llm-security security-ctf llm-tutorials prompt-injection prompt-engineering
Created 2024-08-12
307 commits to main branch, last one 6 days ago
SEC-CAFE
handbook SEC-CAFE
4
34
other
1
安全手册，企业安全实践、攻防与安全研究知识库
ai-security llm-security security-wiki awesome-security security-handbook
Created 2023-11-22
39 commits to main branch, last one 2 months ago
LostOxygen
llm-confidentiality LostOxygen
4
32
apache-2.0
2
Whispers in the Machine: Confidentiality in LLM-integrated Systems
gpt llm openai chatgpt security framework llm-security transformers deep-learning prompt-toolkit confidentiality machine-learning prompt-injection systems-security prompt-engineering
Created 2023-05-26
792 commits to main branch, last one 7 days ago
leondz
lm_risk_cards leondz
8
30
unknown
6
Risks and targets for assessing LLMs & LLM vulnerabilities
llm security red-teaming llm-security vulnerability
Created 2022-12-13
38 commits to main branch, last one 8 months ago