
AtomicTestHarnesses
Public Repo for Atomic Test Harness

Public Repo for Atomic Test Harness

🐢 Open-Source Evaluation & Testing library for LLM Agents

reverse engineering Gemini's SynthID detection

Automated behavioral evaluation framework for LLMs that generates diverse test scenarios to probe for sycophancy, bias, and other safety-relevant…

Black-box input-stage purification defense that neutralizes backdoor attacks on object detectors via corruption, diffusion reconstruction, and DBSCAN…

Research code for a gray-box trojan attack that flips a single KV-cache bit in fine-tuned LLM classifiers and measures per-class attack success rate.

Scripted framework for simulating over 50 MITRE ATT&CK techniques to test blue team detection capabilities. Includes Python scripts and a compiled…

Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and…

Benchmarking framework for evaluating computer-use AI agents against multi-step indirect prompt injection, with automatic adversarial goal…

See adversary, do adversary: Simple execution of commands for defensive tuning/research (now with more ELF on the shelf)

LLM security testing framework for detecting prompt injection, jailbreaks, and adversarial attacks — 190+ probes, 28 providers, single Go binary

A PoC ransomware sample to test out your ransomware response strategy.

CVE-2026-6765, Test only FormAutofill handlers exposed in Firefox

A toolset to make a system look as if it was the victim of an APT attack

Python library for adversarial machine learning security, enabling red and blue teams to run evasion, poisoning, extraction, and inference attacks…

An adversarial example library for constructing attacks, building defenses, and benchmarking both

:cloud: :zap: Granular, Actionable Adversary Emulation for the Cloud

Real-time deepfake toolkit for penetration testing of identity verification and video conferencing systems. Supports face swap, image animation, and…