MEA-Bench
sliu11-byte/mea-benchA lifecycle benchmark for black-box LLM extraction attacks, defenses, and adaptive attacks.
adversarial-attackai-securityeducation+3
sliu11-byte/mea-benchA lifecycle benchmark for black-box LLM extraction attacks, defenses, and adaptive attacks.
js-lee-ai/refusal-relocatesRefusal localizes, the damage relocates, safety layers under few-sample fine-tuning
kevinchunye/prompt_injectionBenchmark harness measuring where prompt injection defenses fire in tool-using LLM agent pipelines, tracking canary tokens across exposed, persisted,…
guzonghua/awesome-latency-attacksCurated index of deep learning latency, energy-latency & timing (availability) attacks and defenses — companion to the ACM Computing Surveys…
kaill-jlq/mmskillriskBenchmark and evaluation harness testing whether LLM agents resist malicious instructions hidden in multimodal skill images, with 108 cases across…
zju-llm-safety/darwinEvolutionary LLM jailbreak and guardrail framework that grows a reusable strategy pool via genetic mutation, Markov selection, and online adversarial…
albert-y1n/piforgeOpen framework for RL-based prompt injection red teaming, with a shared trainer, curriculum learning, and benchmarks like AgentDojo, InjecAgent, and…
portswigger/http-terminatorAI-assisted research pipeline that extracts HTTP desync techniques, generates malformed request test-cases, validates them via Burp, and confirms…
cybershujin/prompt-injection-in-the-wildTracker of publicly reported prompt-injection techniques, broken down by delivery method, encoding, and propagation behavior, with confirmed models,…
azzzzliao/aegis-audio-defenseDefense framework that keeps audio-language models frozen and adds a mid-layer risk gate with late-layer safety adapters to block audio jailbreaks at…
alex66366/odpureBlack-box input-stage purification defense that neutralizes backdoor attacks on object detectors via corruption, diffusion reconstruction, and DBSCAN…
norrrrrrr-lyn/wainjectbenchBenchmarking prompt injection detections for web agents.
usama1002/deleting-the-traceExperiments for control-token chain-of-thought suppression and parser-leniency attacks on tool-using LLM agents
ml-security-research-lab/cachetrapResearch code for a gray-box trojan attack that flips a single KV-cache bit in fine-tuned LLM classifiers and measures per-class attack success rate.
pwnhyo/t-mapTrajectory-aware evolutionary search framework for red-teaming LLM agents over MCP servers, generating adversarial prompts to map vulnerability…
cleverhans-lab/cleverhansAn adversarial example library for constructing attacks, building defenses, and benchmarking both
bethgelab/foolboxA Python toolbox to create adversarial examples that fool neural networks in PyTorch, TensorFlow, and JAX
misp/misp-galaxyClusters and elements to attach to MISP events or attributes (like threat actors)