Skip to content
KitploitKITPLOIT
ToolsExploitsBlog
Log in
Submit
ToolsExploitsBlog
Submit

Hacking, PenTest, and Cybersecurity Tools for Your Security Arsenal!

Kitploit is a directory of hacking, cybersecurity, and pentesting tools. Discover the latest project updates to find vulnerabilities, analyze systems, automate testing, and strengthen your security.

FeedsContactPrivacy© 2026 Kitploit

Tool Directory

Categories

View all categories
Loading categories
ActGuard — Pre-execution action-auditing defense that detects and masks indirect prompt injection in tool-using LLM agents using embedding retrieval and contrastive log-probability scoring. | Kitploit
Tools/GitHubGitHub/binzhwang/actguard
Defensive ToolsVulnerability AnalysisPenetration TestingMachine LearningAI Security
GitHubbinzhwang/actguard

ActGuard

Pre-execution action-auditing defense that detects and masks indirect prompt injection in tool-using LLM agents using embedding retrieval and contrastive log-probability scoring.

View Repository
31752 months agoNot yet reviewed
Share

ActGuard

ActGuard is a pre-execution action-auditing defense against indirect prompt injection in tool-using LLM agents. This repository contains the final ActGuard implementation and the AgentDojo-based runtime needed to evaluate it.

The release contains only the final, full ActGuard configuration. Internal components still use the identifier reflective_audit for compatibility with the AgentDojo benchmark and trace formats.

Requirements

  • Python 3.10 or newer
  • An OpenRouter API key
  • Access to the meta-llama/Meta-Llama-3.1-8B-Instruct checkpoint, or an equivalent local checkpoint
  • A CUDA-capable GPU is strongly recommended for local log-probability scoring

Installation

Using uv is recommended:

uv sync --frozen --extra actguard

Alternatively, install into an activated Python environment:

python -m pip install -e '.[actguard]'

Quick start

From the repository root:

export OPENROUTER_API_KEY=...
uv run --frozen --extra actguard ./scripts/run_actguard.sh

If the project was installed with pip, run:

export OPENROUTER_API_KEY=...
./scripts/run_actguard.sh

The script evaluates the workspace suite with the important_instructions attack. It uses OpenRouter for the main agent and verifier, and Hugging Face-compatible local models for embedding retrieval and contrastive log-probability attribution. Hugging Face authentication may be required before the default gated Llama checkpoint can be downloaded.

To use downloaded checkpoints, replace the values of --reflective-audit-embedding-model and --reflective-audit-logprob-model in scripts/run_actguard.sh with their local paths. Use uv run --frozen actguard-benchmark --help to see all benchmark options.

Default configuration

ParameterSetting
Backend modelopenai/gpt-4o-mini-2024-07-18 via OpenRouter
Backend model temperature0
Chunk length80--180 characters
Embedding modelsentence-transformers/all-MiniLM-L6-v2
Retrieved chunksk = 3
Contrastive log-probability modelmeta-llama/Meta-Llama-3.1-8B-Instruct
Log-probability threshold0
Similar-chunk grouping threshold0.9
Tool-result contextComplete auditable history
Verifier modelopenai/gpt-5-mini via OpenRouter
Verifier temperature0
Predicted next-tool set size1--3
Neighbor-chunk expansion1 chunk on each side
Maximum repair attempts per action2
Local masking text[Removed suspicious instruction from external tool result.]

Output

Results are written below:

runs/openai_gpt-4o-mini-2024-07-18-reflective_audit/actguard/

The runs/ directory is ignored by Git.

Tests

Run the ActGuard regression tests:

uv run --frozen pytest -q tests/test_agent_pipeline/test_reflective_audit.py

Repository layout

  • src/agentdojo/agent_pipeline/reflective_audit.py: ActGuard implementation
  • src/agentdojo/agent_pipeline/agent_pipeline.py: pipeline integration
  • src/agentdojo/scripts/benchmark.py: benchmark CLI
  • src/agentdojo/default_suites/: evaluation suites and task definitions
  • tests/test_agent_pipeline/test_reflective_audit.py: regression tests
  • src/agentdojo/reflective_audit_trace.py: trace generation and inspection

Run logs, local environments, credentials, paper drafts, temporary analysis outputs, and comparison defenses are intentionally excluded from this release.

License

This project is distributed under the MIT License. It includes an AgentDojo-derived benchmark runtime; see LICENSE for the retained upstream copyright notice.

Download Tool

Most Popular

View all →

Discover the most used tools by our community.

  • 1

    OsintHunter

    letox4/osinthunter

    🎯 The ultimate OSINT toolkit: investigation graph, confidence scoring, alias families, map, timeline and reports. 49 modules, 400+ sites, no API keys required.

    795
  • 2

    ghostlock-app

    yukonga/ghostlock-app

    GhostLock One-Tap Execution App (CVE-2026-43499)

    520
  • 3

    ARTEX

    baarai/artex

    LLM multi-agent autonomous penetration testing platform with planner/worker agents, asset and exploration graphs, MITM traffic recording, and vulnerability retesting.

    439
  • 4

    redforge

    cybersecurity91/redforge

    Browser-side red team toolkit with 102 offline tools for recon, payload generation, credential attacks, crypto, encoding and engagement reporting.

    346
  • 5

    looking-glass

    anonghosty/looking-glass

    CSIRT platform that ingests Shadowserver reports into MongoDB and replays them as interactive maps, analysis, findings, advisories and executive dashboards.

    267
  • 6

    CyberStrikeAI

    ed1s0nz/cyberstrikeai

    The system of action for AI-native cybersecurity—where intent becomes governed execution, evidence becomes operational memory, and every operation improves the next.

    264

Explore all tools

Browse our collection of tools

View all tools →