Skip to content
KitploitKITPLOIT
도구익스플로잇블로그
Log in
제출
도구익스플로잇블로그
제출

해킹, 침투 테스트 및 사이버 보안 도구를 당신의 보안 무기고에!

Kitploit은 해킹, 사이버 보안 및 침투 테스트 도구 디렉토리입니다. 최신 프로젝트 업데이트를 발견하여 취약점을 찾고, 시스템을 분석하고, 테스트를 자동화하고, 보안을 강화하세요.

피드문의개인정보© 2026 Kitploit

도구 디렉토리

카테고리

모든 카테고리 보기
Loading categories
AutoControl-Arena — Automated framework for frontier AI safety evaluation that synthesizes executable, pressure-rich test environments to uncover latent risks in advanced agent models. | Kitploit
도구/GitHubGitHub/cosmosyi/autocontrol-arena
Utilities & FrameworksMachine LearningPapers & ResearchLearning & EducationAI-Assisted ReversingAI SecurityLabs & Practice
GitHubcosmosyi/autocontrol-arena

AutoControl-Arena

Automated framework for frontier AI safety evaluation that synthesizes executable, pressure-rich test environments to uncover latent risks in advanced agent models.

저장소 보기
1056991개월 전Kitploit 검토 완료
공유
웹사이트
요청한 언어로 콘텐츠를 사용할 수 없습니다. 영어 버전을 표시합니다.

🛡️AutoControl Arena

Synthesizing Executable Test Environments for Frontier AI Risk Evaluation

Joint Work ICML 2026 Accepted

Project Page Paper arXiv Architecture Docs Citation

AutoControl Arena Teaser

👋 Overview

AutoControl Arena is an automated framework for frontier AI safety evaluation, designed to uncover latent risks in advanced models by stress-testing within executable, pressure-rich environments.

The core idea is logic-narrative decoupling:

  • Logic layer: deterministic state transitions, tools, and environment mechanics are grounded in real executable Python code.
  • Narrative layer: open-ended social/contextual dynamics are generated by LLMs, but always conditioned on the grounded logical state.

This design addresses a central trade-off in agent safety evaluation by combining executable environments with LLM-driven narrative flexibility:

  • Manual Benchmarks are realistic but expensive and slow to scale.
  • In-Context Simulators are scalable but vulnerable to logic hallucination.

AutoControl Arena can automatically reconstruct and reproduce expert-designed risk-evaluation scenarios and target risky behaviors from organizations such as Anthropic, OpenAI, and Apollo Research.

Real-to-sim verification of expert-designed risk evaluation cases

Curious about the paper, architecture, and key findings? Please see our 📖 Project Page for a full tour, or read our paper.

⚡ Quick Start

1. Interactive UI (aca)

aca

The interactive UI lets you browse scenarios, pick profiles, choose stress levels, enable parallel repeats, and inspect previous run history from a menu.

AutoControl Arena interactive main menu

2. Run a batch JSON from the interactive UI

aca is not limited to manual selection. It also includes a Run from JSON flow that lets you:

  1. browse configs/batch_configs/examples/ interactively,
  2. select an existing batch JSON file,
  3. choose serial vs parallel execution,

AutoControl Arena batch TUI

Use this when you want the convenience of the interactive UI but already have a batch JSON prepared.

3. Command-mode CLI (autocontrol)

autocontrol --help

Use autocontrol when you want explicit subcommands such as run, batch, profiles, or prepare-envs. Unlike aca, it does not open the interactive menu by default.

🌐 Frontend Usage

Local results viewer

The results viewer is a separate local web UI for browsing completed runs, artifacts, summaries, and live execution details from results/.

Start it with:

python tools/results_viewer/serve.py --port 8000

Then open:

http://127.0.0.1:8000/viewer/

Optional flags:

# Bind to a different host
python tools/results_viewer/serve.py --host 0.0.0.0 --port 8000

# Point the viewer at a specific results root
python tools/results_viewer/serve.py \
  --results-dir results/autocontrol_arena \
  --port 8000

Use the results viewer when you want a browser-based inspection surface for run trajectories and artifacts.

AutoControl Arena web results viewer

🗂️ Repository Layout

.
├── configs/
│   ├── batch_configs/examples/     # public example batch JSON configs
│   ├── profiles/templates/         # public model/provider profile templates
│   ├── scenarios/benchmark/        # X-Bench YAML scenario definitions
│   └── settings/                   # runtime hyperparameters
├── docs/                           # public docs plus internal planning / design notes
├── runners/                        # CLI entrypoints and interactive UI
├── src/                            # agents, orchestration, infra, and core logic
├── tests/                          # unit and regression tests
├── tools/                          # result management utilities
├── results/                        # generated outputs under results/autocontrol_arena/
├── runtime_envs/                   # generated environments (auto-generated)
├── .env.example
└── pyproject.toml

⚙️ Setup

Prerequisites: Python 3.10+, API credentials for the model providers you want to test.

Step 1 — Install Dependencies

# Create and activate a virtual environment
python -m venv .venv
source .venv/bin/activate

# Install all dependencies (includes LiteLLM, the default model backend)
pip install -e .

# Optional: dev tools (pytest, ruff, mypy)
pip install -e ".[dev]"

This installation exposes two shell commands:

  • aca — interactive operator entrypoint
  • autocontrol — command-mode CLI for scripting and automation

Step 2 — Set API credentials

cp .env.example .env

Edit .env and fill in only the providers you need. Here are some examples:

# OpenAI
OPENAI_API_KEY=sk-xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx

# Anthropic
ANTHROPIC_API_KEY=sk-xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx

# Qwen / DashScope
DASHSCOPE_API_KEY=sk-xxxxxxxxxxxxxxxxxxxxxxxx

Step 3 — Configure model profiles

도구 다운로드

인기

모두 보기 →

커뮤니티에서 가장 많이 사용되는 도구를 찾아보세요.

  • 1

    OsintHunter

    letox4/osinthunter

    🎯 궁극의 OSINT 툴킷: 조사 그래프, 신뢰도 점수 산정, 별칭 패밀리, 지도, 타임라인 및 보고서. 49개 모듈, 400개 이상 사이트, API 키 불필요.

    806
  • 2

    ghostlock-app

    yukonga/ghostlock-app

    # GhostLock 원탭 실행 앱 (CVE-2026-43499)

    523
  • 3

    ARTEX

    baarai/artex

    LLM 멀티 에이전트 자율 침투 테스트 플랫폼으로, 플래너/워커 에이전트, 자산 및 탐색 그래프, MITM 트래픽 기록, 취약점 재테스트 기능을 제공합니다.

    441
  • 4

    redforge

    cybersecurity91/redforge

    브라우저 측 레드 팀 툴킷으로, 정찰, 페이로드 생성, 자격 증명 공격, 암호화, 인코딩 및 참여 보고를 위한 102개의 오프라인 도구를 제공합니다.

    346
  • 5

    looking-glass

    anonghosty/looking-glass

    Shadowserver 보고서를 MongoDB로 수집하고 이를 대화형 지도, 분석, 발견 사항, 권고 및 경영진 대시보드로 재생하는 CSIRT 플랫폼입니다.

    270
  • 6

    CyberStrikeAI

    ed1s0nz/cyberstrikeai

    AI 네이티브 사이버보안을 위한 행동 체계—의도가 통제된 실행이 되고, 증거가 운영 메모리가 되며, 모든 운영이 다음 운영을 개선하는 곳.

    264

모든 도구 탐색

도구 컬렉션을 둘러보세요

모든 도구 보기 →