29 results found Sort:

pathwaycom
llm-app pathwaycom
256
7.7k
mit
31
Ready-to-run cloud templates for RAG, AI pipelines, and enterprise search with live data. 🐳Docker-friendly.⚡Always in sync with Sharepoint, Google Drive, S3, Kafka, PostgreSQL, real-time data APIs, a...
llm rag llmops chatbot open-ai pathway llm-local real-time hugging-face llm-security vector-index llm-prompting vector-database machine-learning retrieval-augmented-generation
Created 2023-07-19
210 commits to main branch, last one a day ago
Giskard-AI
giskard Giskard-AI
277
4.1k
apache-2.0
33
🐢 Open-Source Evaluation & Testing for AI & LLM systems
llm mlops llmops llm-eval ai-safety ml-safety ai-testing ml-testing ai-red-team ai-security fairness-ai llm-security ml-validation llm-evaluation rag-evaluation red-team-tools responsible-ai trustworthy-ai evaluation-framework ethical-artificial-intelligence
Created 2022-03-06
10,170 commits to main branch, last one 2 days ago
NVIDIA
garak NVIDIA
265
3.1k
apache-2.0
30
the LLM vulnerability scanner
ai llm-security llm-evaluation security-scanners vulnerability-assessment
Created 2023-05-10
1,492 commits to main branch, last one a day ago
verazuo
jailbreak_llms verazuo
256
2.8k
mit
36
[CCS'24] A dataset consists of 15,140 ChatGPT prompts from Reddit, Discord, websites, and open-source datasets (including 1,405 jailbreak prompts).
llm prompt chatgpt jailbreak llm-security large-language-model
Created 2023-08-01
18 commits to main branch, last one about a month ago
protectai
llm-guard protectai
168
1.3k
mit
19
The Security Toolkit for LLM Interactions
llm llmops chatgpt llm-security transformers security-tools prompt-injection prompt-engineering large-language-models adversarial-machine-learning
Created 2023-07-27
492 commits to main branch, last one 2 months ago
msoedov
agentic_security msoedov
87
857
apache-2.0
15
Agentic LLM Vulnerability Scanner / AI red teaming kit
llm-fuzzer ai-red-team llm-fuzzing llm-scanner llm-security llm-guardrails llm-jailbreaks owasp-llm-top-10 llm-vulnerabilities llm-fuzzer-aggregator
Created 2024-04-11
158 commits to main branch, last one 5 days ago
mariocandela
beelzebub mariocandela
55
708
mit
12
A secure low code honeypot framework, leveraging AI for System Virtualization.
go llm golang llama3 ollama openai honeypot low-code research security whitehat framework kubernetes cloudnative llm-honeypot llm-security cloudsecurity cybersecurity research-project
Created 2022-05-08
235 commits to main branch, last one 8 days ago
EasyJailbreak
EasyJailbreak EasyJailbreak
41
512
gpl-3.0
8
An easy-to-use Python framework to generate adversarial jailbreak prompts.
jailbreak llm-security jailbreak-framework large-language-model llm-safety-benchmark discrete-optimization
Created 2024-01-31
89 commits to master branch, last one 3 months ago
chawins
llm-sp chawins
34
456
apache-2.0
17
Papers and resources related to the security and privacy of LLMs 🤖
llm privacy security llm-privacy awesome-list llm-security adversarial-machine-learning
Created 2023-11-15
44 commits to main branch, last one 23 days ago
deadbits
vigil-llm deadbits
36
329
apache-2.0
11
⚡ Vigil ⚡ Detect prompt injections, jailbreaks, and other potentially risky Large Language Model (LLM) inputs
llmops llm-security yara-scanner security-tools prompt-injection adversarial-attacks large-language-models adversarial-machine-learning
Created 2023-09-04
230 commits to main branch, last one 10 months ago
R3DRUN3
sploitcraft R3DRUN3
26
184
unlicense
4
🏴‍☠️ Hacking Guides, Demos and Proof-of-Concepts 🥷
ai aws cloud linux docker python hacking redteam windows tutorials llm-security cybersecurity network-security proof-of-concept hacking-tutorials container-security offensive-security web-vulnerabilities
Created 2024-06-23
173 commits to main branch, last one 3 days ago
liu00222
Open-Prompt-Injection liu00222
20
157
unknown
2
This repository provides implementation to formalize and benchmark Prompt Injection attacks and defenses
llm llms llm-security prompt-injection security-and-privacy prompt-injection-tool
Created 2023-10-19
26 commits to main branch, last one 24 days ago
phantasmlabs
phantasm phantasmlabs
6
151
gpl-3.0
2
Toolkits to create a human-in-the-loop approval layer to monitor and guide AI agents workflow in real-time.
llm rust llmops ai-agents ai-safety dashboard monitoring ai-security open-source control-flow llm-security automation-tools approval-workflow human-in-the-loop human-computer-interaction
Created 2024-10-13
146 commits to main branch, last one 25 days ago
yevh
TaaC-AI yevh
13
119
unknown
5
AI-driven Threat modeling-as-a-Code (TaaC-AI)
ai gpt taac gpt-3 gpt-4 threat claude-3 devsecops mistral-7b llm-security threat-models threat-modeling secure-development application-security threat-modeling-tool threat-modeling-from-code
Created 2023-12-14
67 commits to main branch, last one 6 months ago
ZenGuard-AI
fast-llm-security-guardrails ZenGuard-AI
13
109
mit
2
The fastest && easiest LLM security guardrails for AI Agents and applications.
security llm-guard llm-privacy llm-security llm-guardrails prompt-security adversarial-machine-learning
Created 2024-03-11
218 commits to main branch, last one 18 days ago
arekusandr
last_layer arekusandr
3
109
mit
2
Ultra-fast, low latency LLM prompt injection/jailbreak detection ⛓️
jailbreak llm-guard llm-local llm-security llm-guardrails security-tools chatgpt-prompts prompt-engineering large-language-models
Created 2024-03-29
40 commits to main branch, last one 7 months ago
raga-ai-hub
raga-llm-hub raga-ai-hub
10
100
other
2
Framework for LLM evaluation, guardrails and security
llmops guardrails llm-security llm-evaluation
Created 2024-03-02
9 commits to main branch, last one 3 months ago
lakeraai
pint-benchmark lakeraai
10
94
mit
5
A benchmark for prompt injection detection systems.
llm benchmark llm-security llm-benchmarking prompt-injection
Created 2024-03-27
57 commits to main branch, last one 3 months ago
pdparchitect
llm-hacking-database pdparchitect
4
82
unknown
4
This repository contains various attack against Large Language Models.
llm hacking security llm-security
Created 2024-04-15
25 commits to main branch, last one 7 months ago
NaniDAO
ie NaniDAO
6
53
agpl-3.0
6
intents engine
llm-security account-abstraction
Created 2024-02-01
188 commits to main branch, last one 2 months ago
microsoft
BIPIA microsoft
5
53
other
6
A benchmark for evaluating the robustness of LLMs and defenses to indirect prompt injection attacks.
llm-security
Created 2024-01-04
34 commits to main branch, last one 8 months ago
llm-platform-security
SecGPT llm-platform-security
7
52
other
3
SecGPT: An execution isolation architecture for LLM-based systems
gpt llm chatgpt sandbox isolation langchain llm-agent openai-api llm-privacy llm-platform llm-security llm-framework llm-based-systems multi-agent-systems
Created 2024-03-07
8 commits to main branch, last one 28 days ago
azminewasi
Awesome-LLMs-ICLR-24 azminewasi
1
43
mit
1
It is a comprehensive resource hub compiling all LLM papers accepted at the International Conference on Learning Representations (ICLR) in 2024.
llm llms llmops llm-agent llm-privacy llm-serving llm-security llm-training llm-framework llm-inference llm-prompting llm-evaluation pretrained-models pretrained-weights large-language-model large-language-models pretrained-language-model large-language-models-for-graph-learning large-language-models-and-translation-systems
Created 2024-03-18
5 commits to main branch, last one 8 months ago
briland
LLM-security-and-privacy briland
7
43
unknown
2
LLM security and privacy
llm awesome privacy security llm-privacy llm-threats awesome-list llm-security generative-ai llm-framework llm-vulnerabilities awesome-llm-security-and-privacy
Created 2023-08-30
41 commits to main branch, last one 2 months ago
RomiconEZ
llamator RomiconEZ
2
36
other
3
Framework for testing vulnerabilities of large language models (LLM).
ai llm nlp rag attack python red-team framework jailbreaks ai-security llm-testing red-teaming llm-red-team llm-security hallucinations misinformation rag-evaluation security-tools red-team-framework vulnerability-assessment
Created 2024-09-05
4 commits to release branch, last one 4 days ago
sinanw
llm-security-prompt-injection sinanw
7
35
mit
3
This project investigates the security of large language models by performing binary classification of a set of input prompts to discover malicious prompts. Several approaches have been analyzed using...
llm-security cybersecurity llm-prompting prompt-injection transformers-models
Created 2023-11-21
40 commits to main branch, last one about a year ago
SEC-CAFE
handbook SEC-CAFE
4
34
other
1
安全手册，企业安全实践、攻防与安全研究知识库
ai-security llm-security security-wiki awesome-security security-handbook
Created 2023-11-22
39 commits to main branch, last one 23 days ago
LostOxygen
llm-confidentiality LostOxygen
4
30
apache-2.0
2
Whispers in the Machine: Confidentiality in LLM-integrated Systems
gpt llm openai chatgpt security framework llm-security transformers deep-learning prompt-toolkit confidentiality machine-learning prompt-injection systems-security prompt-engineering
Created 2023-05-26
790 commits to main branch, last one 13 days ago
llm-platform-security
chatgpt-plugin-eval llm-platform-security
7
25
unknown
2
LLM Platform Security: Applying a Systematic Evaluation Framework to OpenAI's ChatGPT Plugins
llm openai chatgpt llm-privacy llm-platform llm-security chatgpt-plugins llm-platform-security
Created 2023-09-11
5 commits to main branch, last one 4 months ago