#1LLM security, prompt injection, model extraction, adversarial AI, and AI red teaming tools.
Kitploit recommended

An adversarial example library for constructing attacks, building defenses, and benchmarking both

A Python toolbox to create adversarial examples that fool neural networks in PyTorch, TensorFlow, and JAX

Protection against Model Serialization Attacks

Algorithms for outlier, adversarial and drift detection

A security scanner for your LLM agentic workflows

Curated list of backdoor learning papers, surveys, and toolboxes, organizing poisoning-based attacks and defenses in deep learning for researchers…

Train, evaluate, and explore neural networks with built-in adversarial robustness tools, including PGD attacks, adversarial training, and robust…

Automates CAPTCHA solving with multimodal AI models (GPT-4o, Gemini) and Selenium, supporting text, audio, slider puzzles, and reCAPTCHA v2 via a…

Standardized adversarial robustness benchmark with a public leaderboard and downloadable model zoo for evaluating ML models against Lp attacks and…

Interpretability and explainability of data and machine learning models

🥂 Gracefully face hCaptcha challenge with multimodal large language model.

A curated list of useful resources that cover Offensive AI.

Intentionally vulnerable banking platform for practicing web application, API, and AI/LLM security testing, secure code review, and DevSecOps…

Keep private data, internal infrastructure and secrets out of cloud coding agents without breaking your workflow.

Open-source framework for red-teaming generative AI systems: automate attack prompts, score model responses, and audit behavior to identify security…

Security scanner for AI/ML model files. Detects malicious code, backdoors, and vulnerabilities before deployment

🐢 Open-Source Evaluation & Testing library for LLM Agents

Set of tools to assess and improve LLM security.