benign-instruction-bench
lzwhehe/benign-instruction-benchRe-evaluating prompt-injection detectors on LLM agent tool outputs (paper draft, scripts, scores)
ai-securitydefensive-toolseducation+3
lzwhehe/benign-instruction-benchRe-evaluating prompt-injection detectors on LLM agent tool outputs (paper draft, scripts, scores)
sliu11-byte/mea-benchA lifecycle benchmark for black-box LLM extraction attacks, defenses, and adaptive attacks.
kevinchunye/prompt_injectionBenchmark harness measuring where prompt injection defenses fire in tool-using LLM agent pipelines, tracking canary tokens across exposed, persisted,…
albert-y1n/piforgeOpen framework for RL-based prompt injection red teaming, with a shared trainer, curriculum learning, and benchmarks like AgentDojo, InjecAgent, and…
sisl-uri/t-backdoorResearch code implementing T-Backdoor, temporal-trigger backdoor attacks on spiking neural networks using rate, latency, and jitter triggers without…
selectstar-ai/finred-paperfinance domain specific red-teaming benchmark evaluation rubric
norrrrrrr-lyn/wainjectbenchBenchmarking prompt injection detections for web agents.
zjuwyh/shadowmemDefensive framework that maintains a safety-focused shadow memory to detect and block prompt-injection and long-horizon threats against LLM agents…
clearlotus-git/cve-2024-37054-pocProof-of-concept and research repository for CVE-2024-37054, an unsafe deserialization flaw in MLflow PyFunc model loading that can lead to remote…
safety-research/red-teaming-auto-modeResearch code for red-teaming AI auto-mode monitors, including simulation evals, fuzzing, and monitor implementations for Claude Code and Codex…
zhou-cybersecurity-ai/synghostSyntactic Ghost: An Imperceptible General-purpose Backdoor Attacks on Pre-trained Language Models
siyuanli00/intactResearch code reproducing multi-turn LLM jailbreak experiments (FITD, MRCJ, ActorAttack, X-Teaming) from the SoK intent-oriented systematization…
zdcslab/rubrics-as-an-attack-surfaceResearch code for Rubric-Induced Preference Drift (RIPD): evolutionary rubric search, benchmark-preserving selection, and DPO policy misalignment…
9xeb/context-segmentationMulti-agent automated context management for long horizon tasks in local AI Agents
96kihyun/batch_jailbreakThis repository contains the official implementation of the paper "[Safety in Batches? Understanding and Mitigating Safety Failures in Batch…
phkhanhtrinh23/agasLLM-driven agentic group shilling attack framework that manipulates black-box collaborative-filtering recommender rankings using adaptive multi-role…
mlily2024/final-project-sql-injection-pipelineHybrid machine-learning pipelines for detecting SQL injection in web traffic, combining DistilBERT and BERT-GNN models with adversarial training and…
cucu220123/safety-awarenessResearch code for extracting and training safety-awareness directions in multimodal LLMs to improve refusal behavior while limiting benign-task drift.