llm-security
greshake/llm-securityProof-of-concept demos and research on indirect prompt injection attacks against application-integrated LLMs, covering data exfiltration, remote…
adversarial-attackai-securitycommand-and-control+7
2.1k
greshake/llm-securityProof-of-concept demos and research on indirect prompt injection attacks against application-integrated LLMs, covering data exfiltration, remote…
euph00/zoneclaw-codeBenchmark and defense code for persistent memory attacks on OpenClaw-style computer-use agents, with memory-zoning mitigation, attack scenarios, and…
sliu11-byte/mea-benchA lifecycle benchmark for black-box LLM extraction attacks, defenses, and adaptive attacks.
js-lee-ai/refusal-relocatesRefusal localizes, the damage relocates, safety layers under few-sample fine-tuning
kevinchunye/prompt_injectionBenchmark harness measuring where prompt injection defenses fire in tool-using LLM agent pipelines, tracking canary tokens across exposed, persisted,…
guzonghua/awesome-latency-attacksCurated index of deep learning latency, energy-latency & timing (availability) attacks and defenses — companion to the ACM Computing Surveys…
facebookresearch/meta_secalignOpen-weight LLMs and training/evaluation code for defending against prompt injection attacks, with benchmarks for agentic tool-calling and…
kaill-jlq/mmskillriskBenchmark and evaluation harness testing whether LLM agents resist malicious instructions hidden in multimodal skill images, with 108 cases across…
zju-llm-safety/traceAgentic jailbreak framework for LLM-based agents using scheme-based task decomposition, multi-turn disguising strategies, and adaptive self-evolution…
zju-llm-safety/darwinEvolutionary LLM jailbreak and guardrail framework that grows a reusable strategy pool via genetic mutation, Markov selection, and online adversarial…
albert-y1n/piforgeOpen framework for RL-based prompt injection red teaming, with a shared trainer, curriculum learning, and benchmarks like AgentDojo, InjecAgent, and…
loophole-llc/fish-live-in-treesGemini - Production LLM Runtime Alignment Context Injection
portswigger/http-terminatorAI-assisted research pipeline that extracts HTTP desync techniques, generates malformed request test-cases, validates them via Burp, and confirms…
wsu-cyber-security-lab-ai/clipguardAdversarial image perturbation tool that uses SAM segmentation and CLIP models to evade AI-based scam image classifiers for security research.
mrphrazer/binary-cartographyTechnical webinars on reverse engineering, malware analysis, and software protection.
cybershujin/prompt-injection-in-the-wildTracker of publicly reported prompt-injection techniques, broken down by delivery method, encoding, and propagation behavior, with confirmed models,…
sisl-uri/t-backdoorResearch code implementing T-Backdoor, temporal-trigger backdoor attacks on spiking neural networks using rate, latency, and jitter triggers without…
azzzzliao/aegis-audio-defenseDefense framework that keeps audio-language models frozen and adds a mid-layer risk gate with late-layer safety adapters to block audio jailbreaks at…