37 results found Sort:

pathwaycom
llm-app pathwaycom
407
23.3k
mit
46
Ready-to-run cloud templates for RAG, AI pipelines, and enterprise search with live data. 🐳Docker-friendly.⚡Always in sync with Sharepoint, Google Drive, S3, Kafka, PostgreSQL, real-time data APIs, a...
llm rag llmops chatbot open-ai pathway llm-local real-time hugging-face llm-security vector-index llm-prompting vector-database machine-learning retrieval-augmented-generation
Created 2023-07-19
237 commits to main branch, last one a day ago
Giskard-AI
giskard Giskard-AI
318
4.5k
apache-2.0
35
🐢 Open-Source Evaluation & Testing for AI & LLM systems
llm mlops llmops llm-eval ai-testing ml-testing ai-red-team ai-security fairness-ai llm-security ml-validation llm-evaluation rag-evaluation red-team-tools responsible-ai trustworthy-ai agent-evaluation
Created 2022-03-06
10,273 commits to main branch, last one 3 days ago
NVIDIA
garak NVIDIA
411
4.3k
apache-2.0
40
the LLM vulnerability scanner
ai llm-security llm-evaluation security-scanners vulnerability-assessment
Created 2023-05-10
1,833 commits to main branch, last one a day ago
verazuo
jailbreak_llms verazuo
279
3.1k
mit
39
[CCS'24] A dataset consists of 15,140 ChatGPT prompts from Reddit, Discord, websites, and open-source datasets (including 1,405 jailbreak prompts).
llm prompt chatgpt jailbreak jailbreaking llm-security large-language-model
Created 2023-08-01
19 commits to main branch, last one 3 months ago
protectai
llm-guard protectai
197
1.6k
mit
19
The Security Toolkit for LLM Interactions
llm llmops chatgpt llm-security transformers security-tools prompt-injection prompt-engineering large-language-models adversarial-machine-learning
Created 2023-07-27
501 commits to main branch, last one 26 days ago
msoedov
agentic_security msoedov
197
1.3k
apache-2.0
16
Agentic LLM Vulnerability Scanner / AI red teaming kit 🧪
llm-fuzzer ai-red-team llm-fuzzing llm-scanner llm-security agent-security llm-evaluation llm-guardrails llm-jailbreaks prompt-testing agent-framework llm-vulnerabilities llm-fuzzer-aggregator llm-evaluation-framework
Created 2024-04-11
581 commits to main branch, last one 3 days ago
mariocandela
beelzebub mariocandela
76
1.0k
gpl-3.0
15
A secure low code honeypot framework, leveraging LLM for System Virtualization.
go llm golang llama3 ollama openai honeypot low-code research security whitehat deception framework kubernetes cloudnative llm-honeypot llm-security cloudsecurity cybersecurity research-project
Created 2022-05-08
264 commits to main branch, last one 3 days ago
EasyJailbreak
EasyJailbreak EasyJailbreak
54
622
gpl-3.0
8
An easy-to-use Python framework to generate adversarial jailbreak prompts.
jailbreak llm-security jailbreak-framework large-language-model llm-safety-benchmark discrete-optimization
Created 2024-01-31
94 commits to master branch, last one 16 days ago
cyberark
FuzzyAI cyberark
48
494
apache-2.0
9
A powerful tool for automated LLM fuzzing. It is designed to help developers and security researchers identify and mitigate potential jailbreaks in their LLM APIs.
ai llm llms fuzzing security jailbreak ai-read-team jailbreaking llm-security llm-evaluation
Created 2024-12-03
186 commits to main branch, last one 10 days ago
chawins
llm-sp chawins
35
493
apache-2.0
18
Papers and resources related to the security and privacy of LLMs 🤖
llm privacy security llm-privacy awesome-list llm-security adversarial-machine-learning
Created 2023-11-15
44 commits to main branch, last one 4 months ago
splx-ai
agentic-radar splx-ai
44
395
apache-2.0
10
A security scanner for your LLM agentic workflows
ai cli llm security devsecops agentic-ai ai-security red-teaming llm-security generative-ai ai-red-teaming security-tools agentic-workflow agentic-framework
Created 2025-02-12
59 commits to main branch, last one a day ago
deadbits
vigil-llm deadbits
41
371
apache-2.0
11
⚡ Vigil ⚡ Detect prompt injections, jailbreaks, and other potentially risky Large Language Model (LLM) inputs
llmops llm-security yara-scanner security-tools prompt-injection adversarial-attacks large-language-models adversarial-machine-learning
Created 2023-09-04
230 commits to main branch, last one about a year ago
R3DRUN3
sploitcraft R3DRUN3
27
195
unlicense
4
🏴‍☠️ Hacking Guides, Demos and Proof-of-Concepts 🥷
ai aws cloud linux docker python hacking redteam windows tutorials llm-security cybersecurity network-security proof-of-concept hacking-tutorials container-security offensive-security web-vulnerabilities
Created 2024-06-23
186 commits to main branch, last one 16 days ago
liu00222
Open-Prompt-Injection liu00222
28
181
mit
2
This repository provides implementation to formalize and benchmark Prompt Injection attacks and defenses
llm llms llm-security prompt-injection security-and-privacy prompt-injection-tool
Created 2023-10-19
28 commits to main branch, last one 2 months ago
phantasmlabs
phantasm phantasmlabs
6
162
gpl-3.0
2
Toolkits to create a human-in-the-loop approval layer to monitor and guide AI agents workflow in real-time.
llm rust llmops ai-agents ai-safety dashboard monitoring ai-security open-source control-flow llm-security automation-tools approval-workflow human-in-the-loop human-computer-interaction
Created 2024-10-13
146 commits to main branch, last one 4 months ago
sshh12
llm_backdoor sshh12
19
153
mit
3
Experimental tools to backdoor large language models by re-writing their system prompts at a raw parameter level. This allows you to potentially execute offline remote code execution without running a...
qwen2-5 llm-security backdoor-attacks
Created 2025-01-30
38 commits to main branch, last one 7 days ago
yevh
TaaC-AI yevh
16
129
unknown
7
AI-driven Threat modeling-as-a-Code (TaaC-AI)
ai gpt taac gpt-3 gpt-4 threat claude-3 devsecops mistral-7b llm-security threat-models threat-modeling secure-development application-security threat-modeling-tool threat-modeling-from-code
Created 2023-12-14
67 commits to main branch, last one 10 months ago
ZenGuard-AI
fast-llm-security-guardrails ZenGuard-AI
16
128
mit
2
The fastest Trust Layer for AI Agents
ai-agent cx-agent security ai-agents llm-guard agentic-ai ai-runtime llm-privacy llm-security llm-guardrails prompt-security
Created 2024-03-11
235 commits to main branch, last one about a month ago
Repello-AI
whistleblower Repello-AI
10
115
unknown
2
Whistleblower is a offensive security tool for testing against system prompt leakage and capability discovery of an AI application exposed through API. Built for AI engineers, security researchers and...
jailbreaks ai-security llm-security ai-red-teaming prompt-engineering prompt-injection-llm-security
Created 2024-06-23
28 commits to main branch, last one 8 months ago
arekusandr
last_layer arekusandr
3
114
mit
1
Ultra-fast, low latency LLM prompt injection/jailbreak detection ⛓️
jailbreak llm-guard llm-local llm-security llm-guardrails security-tools chatgpt-prompts prompt-engineering large-language-models
Created 2024-03-29
40 commits to main branch, last one 11 months ago
raga-ai-hub
raga-llm-hub raga-ai-hub
14
112
other
1
Framework for LLM evaluation, guardrails and security
llmops guardrails llm-security llm-evaluation
Created 2024-03-02
9 commits to main branch, last one 7 months ago
pdparchitect
llm-hacking-database pdparchitect
5
102
unknown
4
This repository contains various attack against Large Language Models.
llm hacking security llm-security
Created 2024-04-15
25 commits to main branch, last one 10 months ago
lakeraai
pint-benchmark lakeraai
11
99
mit
5
A benchmark for prompt injection detection systems.
llm benchmark llm-security llm-benchmarking prompt-injection
Created 2024-03-27
59 commits to main branch, last one 2 months ago
LLAMATOR-Core
llamator LLAMATOR-Core
9
96
other
2
Framework for testing vulnerabilities of large language models (LLM).
ai llm nlp rag owasp attack python red-team jailbreak ai-security llm-testing red-teaming llm-security llm-read-team hallucinations misinformation rag-evaluation red-team-tools security-tools vulnerability-assessment
Created 2024-09-05
9 commits to release branch, last one about a month ago
llm-platform-security
SecGPT llm-platform-security
8
69
other
3
An Execution Isolation Architecture for LLM-Based Agentic Systems
gpt llm chatgpt sandbox isolation langchain llm-agent openai-api llm-privacy llm-platform llm-security llm-framework llm-based-systems multi-agent-systems
Created 2024-03-07
10 commits to main branch, last one 2 months ago
microsoft
BIPIA microsoft
5
64
other
5
A benchmark for evaluating the robustness of LLMs and defenses to indirect prompt injection attacks.
llm-security
Created 2024-01-04
34 commits to main branch, last one 12 months ago
azminewasi
Awesome-LLMs-ICLR-24 azminewasi
3
57
mit
1
It is a comprehensive resource hub compiling all LLM papers accepted at the International Conference on Learning Representations (ICLR) in 2024.
llm llms llmops llm-agent llm-privacy llm-serving llm-security llm-training llm-framework llm-inference llm-prompting llm-evaluation pretrained-models pretrained-weights large-language-model large-language-models pretrained-language-model large-language-models-for-graph-learning large-language-models-and-translation-systems
Created 2024-03-18
5 commits to main branch, last one about a year ago
kereva-dev
kereva-scanner kereva-dev
3
56
apache-2.0
2
Code scanner to check for issues in prompts and LLM calls
ai cli llm linter security evaluation ai-security red-teaming llm-security ai-evaluation code-scanning hallucination ai-code-review ai-performance ai-red-teaming llm-evaluation llm-performance owasp-llm-top-10 prompt-injection
Created 2025-03-14
51 commits to master branch, last one 6 days ago
NaniDAO
ie NaniDAO
8
56
agpl-3.0
6
intents engine
llm-security account-abstraction
Created 2024-02-01
188 commits to main branch, last one 5 months ago
TrustAI-laboratory
Learn-Prompt-Hacking TrustAI-laboratory
4
51
mit
1
This is The most comprehensive prompt hacking course available, which record our progress on a prompt engineering and prompt hacking course.
llm turorial jailbreak prompt-hack llm-learning llm-security security-ctf llm-tutorials prompt-injection prompt-engineering
Created 2024-08-12
319 commits to main branch, last one 16 hours ago