Skip to content
KitploitKITPLOIT
ToolsExploitsBlog
Log in
Submit
ToolsExploitsBlog
Submit

Hacking, PenTest, and Cybersecurity Tools for Your Security Arsenal!

Kitploit is a directory of hacking, cybersecurity, and pentesting tools. Discover the latest project updates to find vulnerabilities, analyze systems, automate testing, and strengthen your security.

FeedsContactPrivacyΒ© 2026 Kitploit

Tool Directory

Categories

View all categories
Loading categories
crucible β€” pytest for AI agents - Autonomous red-teaming, behavioral monitoring & security testing for LLM agents | Kitploit
Tools/GitHubGitHub/crucible-security/crucible
Vulnerability ScannersPenetration TestingDevSecOpsLearning & EducationRed TeamingAI Security
GitHubcrucible-security/crucible

crucible

pytest for AI agents - Autonomous red-teaming, behavioral monitoring & security testing for LLM agents

View Repository
4835353 months agoReviewed by Kitploit
Website
Share

   β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ•—β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ•— β–ˆβ–ˆβ•—   β–ˆβ–ˆβ•— β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ•—β–ˆβ–ˆβ•—β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ•— β–ˆβ–ˆβ•—     β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ•—
  β–ˆβ–ˆβ•”β•β•β•β•β•β–ˆβ–ˆβ•”β•β•β–ˆβ–ˆβ•—β–ˆβ–ˆβ•‘   β–ˆβ–ˆβ•‘β–ˆβ–ˆβ•”β•β•β•β•β•β–ˆβ–ˆβ•‘β–ˆβ–ˆβ•”β•β•β–ˆβ–ˆβ•—β–ˆβ–ˆβ•‘     β–ˆβ–ˆβ•”β•β•β•β•β•
  β–ˆβ–ˆβ•‘     β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ•”β•β–ˆβ–ˆβ•‘   β–ˆβ–ˆβ•‘β–ˆβ–ˆβ•‘     β–ˆβ–ˆβ•‘β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ•”β•β–ˆβ–ˆβ•‘     β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ•—
  β–ˆβ–ˆβ•‘     β–ˆβ–ˆβ•”β•β•β–ˆβ–ˆβ•—β–ˆβ–ˆβ•‘   β–ˆβ–ˆβ•‘β–ˆβ–ˆβ•‘     β–ˆβ–ˆβ•‘β–ˆβ–ˆβ•”β•β•β–ˆβ–ˆβ•—β–ˆβ–ˆβ•‘     β–ˆβ–ˆβ•”β•β•β•
  β•šβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ•—β–ˆβ–ˆβ•‘  β–ˆβ–ˆβ•‘β•šβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ•”β•β•šβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ•—β–ˆβ–ˆβ•‘β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ•”β•β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ•—β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ•—
   β•šβ•β•β•β•β•β•β•šβ•β•  β•šβ•β• β•šβ•β•β•β•β•β•  β•šβ•β•β•β•β•β•β•šβ•β•β•šβ•β•β•β•β•β• β•šβ•β•β•β•β•β•β•β•šβ•β•β•β•β•β•β•
  
pytest for AI agents -- test, score, and harden before production

CI PyPI Python Coverage License Discord OWASP


Install

pip install crucible-security

Quick Start

πŸ†• New to AI security? Read our Beginner's Getting Started Guide or set up a local test target with the n8n Local Demo Target Guide.

crucible init --target https://my-agent.com/api/chat
crucible scan --target https://my-agent.com/api/chat
crucible report crucible-report.json

One command. 90 attacks. Beautiful report.

Why Crucible?

  • Behavioral integrity testing -- the only tool that tests agent behavior across conversations, not just single-shot attacks
  • Automated red-teaming -- 90+ real attack payloads run in under 60 seconds, not weeks of manual testing
  • OWASP-aligned -- maps every attack to the OWASP Top 10 for LLM Applications and OWASP Agentic Top 10
  • CI/CD native -- crucible scan --output json pipes into any pipeline; fail builds on low grades
  • Regulatory compliance -- auto-generate EU AI Act 2024 compliance reports from scan results
  • MCP security -- the only tool with a native Model Context Protocol security module

How does Crucible compare to Garak and PyRIT? β†’ See docs/comparison.md for a detailed, objective feature matrix.

What does Crucible test for? β†’ See docs/owasp_mapping.md for the full OWASP Agentic AI Top 10 attack documentation (ASI01–ASI10).

☁️ Crucible Cloud (Waitlist)

Need persistent dashboards, compliance reports, and team collaboration?
Join the waitlist for our upcoming cloud platform: crucible-cloud.vercel.app

Modules

ModuleAttacksStatusOWASP Coverage
Prompt Injection50βœ… LiveLLM01, LLM07
Goal Hijacking20βœ… LiveAgentic #1
Jailbreaks20βœ… LiveLLM01, LLM06
Enterprise Graph10βœ… LiveAgentic #2, #4
Memory Poisoning8βœ… LiveAgentic #5
Infrastructure Escalation5βœ… LiveLLM06, SSRF
Advanced Orchestration4βœ… LiveAgentic #3
MCP Security5βœ… LiveAgentic #3
MCP Server Scan10βœ… Live (v0.4)MCP-001 – MCP-005
Behavioral Driftmulti-turnβœ… Live (v0.3)Agentic #1, #2
Multi-turn Attacksstrategiesβœ… Live (v0.3)LLM01, Agentic #1
Deep Research Engineautonomousβœ… Live (v0.4)AI Research
Multi-Agent Contagionorchestrationβœ… Live (v0.4)Agentic #2, #3
Hallucination Detection15βœ… Live (v0.5)LLM09 / Agentic #9
Toxicity & Content Safety20βœ… Live (v0.5)LLM01, LLM06
Statistical Confidence--confidenceβœ… Live (v0.6)Bootstrap & binomial bounds
MCP Trace Proxytraffic proxyβœ… Live (v0.7)Agentic #3 / Tool Misuse
Memory & RAG Poisoningpoison-testβœ… Live (v0.8)Agentic #5 / Poisoning
Reference Targets12 targetsβœ… Live (v0.18)Ground-truth validation targets

OWASP Agentic Top 10 Coverage

#CategoryCrucible ModuleStatus
1Goal Hijackinggoal_hijackingCovered (20 attacks)
2Prompt Injectionprompt_injectionCovered (50 attacks)
3Tool Misusetool_injection / trace proxyCovered (v0.7.0)
4Identity Abusetrace proxy + identity layerCovered (v0.9.0)
5Memory Poisoningmemory_poisoning / poison-testCovered (8 attacks, v0.8.0)
6Data Exfiltrationprompt_injection / exfiltrationCovered (v0.8.0)
7Scope Violationtrace proxyCovered (v0.7.0)
8Cascading Failure--Planned
9Supply Chain / OverreliancehallucinationCovered (15 attacks)
10Rogue Agent--Planned

Supported Providers

ProviderTested
OpenAI (GPT-4, GPT-4o)Yes
Anthropic (Claude)Yes
Groq (Llama, Mixtral)Yes
Custom HTTP endpointYes
LangChain (LangServe / FastAPI wrapper)Yes
OllamaYes (v0.5)
LM StudioYes (v0.5)
HuggingFace TGIYes (v0.5)

Examples

We provide several example scripts in the examples/ directory to help you get started:

ScriptFrameworkDescription
test_openai_agent.pyOpenAI Chat CompletionsScan a raw OpenAI /chat/completions endpoint
test_langchain_agent.pyLangChain (LangServe)Scan a LangChain ReAct agent with OWASP LLM Top 10 mapping
test_openai_assistant.pyOpenAI Assistants APIScan an Assistants API wrapper endpoint

All examples use respx to mock HTTP calls so they pass CI without a live server.

Running the LangChain Example:

python examples/test_langchain_agent.py

Running the OpenAI Assistant Example:

python examples/test_openai_assistant.py

Scoring System

Score starts at 100 and deducts per vulnerability found:

SeverityDeduction
CRITICAL-20 points
HIGH-10 points
MEDIUM-5 points
LOW-2 points
GradeScore Range
A90 -- 100
B75 -- 89
C60 -- 74
D40 -- 59
FBelow 40

CLI Reference

# Generate config
crucible init --target URL --provider openai --key sk-xxx

# Run a standard scan
crucible scan \
  --target https://my-agent.com/api/chat \
  --name "My ChatBot" \
  --header "Authorization: Bearer sk-xxx" \
  --timeout 30 \
  --concurrency 5

# Run with payload mutation (bypass WAFs/guardrails)
crucible scan --target URL --mutate

# Multi-turn attack strategy
crucible scan --target URL --strategy multi-turn

# Use agent profile to target attacks
crucible profile --target URL --output agent_profile.json
crucible scan --target URL --profile agent_profile.json

# Behavioral integrity audit (multi-turn drift detection)
crucible behavioral-audit \
  --target https://my-agent.com/api/chat \
  --baseline-turns 5 \
  --probe-turns 15

# Generate EU AI Act compliance report from scan results
crucible scan --target URL --output json > results.json
crucible compliance-report --results results.json --output compliance.md

# JSON output for CI/CD
crucible scan --target URL --output json > report.json
Download Tool

Most Popular

View all β†’

Discover the most used tools by our community.

  • 1

    OsintHunter

    letox4/osinthunter

    🎯 The ultimate OSINT toolkit: investigation graph, confidence scoring, alias families, map, timeline and reports. 49 modules, 400+ sites, no API keys required.

    732
  • 2

    ghostlock-app

    yukonga/ghostlock-app

    GhostLock One-Tap Execution App (CVE-2026-43499)

    506
  • 3

    ARTEX

    baarai/artex

    LLM multi-agent autonomous penetration testing platform with planner/worker agents, asset and exploration graphs, MITM traffic recording, and vulnerability retesting.

    405
  • 4

    redforge

    cybersecurity91/redforge

    Browser-side red team toolkit with 102 offline tools for recon, payload generation, credential attacks, crypto, encoding and engagement reporting.

    342
  • 5

    CyberStrikeAI

    ed1s0nz/cyberstrikeai

    The system of action for AI-native cybersecurityβ€”where intent becomes governed execution, evidence becomes operational memory, and every operation improves the next.

    261
  • 6

    antifox

    antifox-ai/antifox

    AI multi-agent autonomous penetration testing platform that runs recon, attack-surface discovery, exploitation validation and evidence-backed report delivery.

    259

Explore all tools

Browse our collection of tools

View all tools β†’