#1Adversarial ML attack frameworks, evasion techniques, and model robustness evaluation tools.
Kitploit recommended
promptfoo/promptfooTest your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and…
s3n4t0r-0x0/apts-adversary-simulationThis repository contains detailed adversary simulation APT campaigns targeting various critical sectors. Each simulation includes custom tools, C2…
s3n4t0r-0x0/bear-c2The exploit server for out-of-band findings. Point a target at a domain you own. Every HTTP request and every email it sends back lands in a…
trusted-ai/adversarial-robustness-toolboxPython library for adversarial machine learning security, enabling red and blue teams to run evasion, poisoning, extraction, and inference attacks…
p-e-w/hereticFully automatic censorship removal for language models
datadog/stratus-red-team:cloud: :zap: Granular, Actionable Adversary Emulation for the Cloud
microsoft/pyritOpen-source framework for red-teaming generative AI systems: automate attack prompts, score model responses, and audit behavior to identify security…
abhinavdubey30/perturbed-embedding-vectorsCode, response logs and labels for the paper Jailbreaking Open-Weight LLMs via Random Embedding Perturbations
misp/misp-galaxyClusters and elements to attach to MISP events or attributes (like threat actors)
togg53192-cmd/jailbreaksCurated collection of LLM jailbreak prompts and bypass techniques, documenting adversarial inputs that circumvent AI model safety guardrails.
giskard-ai/giskard-oss🐢 Open-Source Evaluation & Testing library for LLM Agents
ottosulin/awesome-ai-securityA collection of awesome resources related AI security
bishopfox/sliverAdversary Emulation Framework
owasp/aisvsThe AI Security Verification Standard (AISVS) focuses on providing developers, architects, and security professionals with a structured checklist to…
gmh5225/awesome-ai-securityA curated list of AI Security materials and resources for Pentesters, Bug Hunters, and Security Researchers.
matheusht/redthreadAn autonomous red-teaming engine for LLMs. RedThread manages the full security lifecycle: generating adversarial attacks, executing precision…
nvidia/garakModular LLM vulnerability scanner that probes for hallucination, data leakage, prompt injection, jailbreaks, and toxicity using static, dynamic, and…
breachsimrange/redteamsimmerWeb-based adversary emulation platform that orchestrates Atomic Red Team tests across Windows endpoints via Go agents, with MITRE ATT&CK mapping, APT…
