PyRIT
microsoft/pyritOpen-source framework for red-teaming generative AI systems: automate attack prompts, score model responses, and audit behavior to identify security…
adversarial-attackai-securitymachine-learning+2
4.5k
microsoft/pyritOpen-source framework for red-teaming generative AI systems: automate attack prompts, score model responses, and audit behavior to identify security…
nvidia/garakModular LLM vulnerability scanner that probes for hallucination, data leakage, prompt injection, jailbreaks, and toxicity using static, dynamic, and…
phkhanhtrinh23/agasLLM-driven agentic group shilling attack framework that manipulates black-box collaborative-filtering recommender rankings using adaptive multi-role…
jiep/offensive-ai-compilationA curated list of useful resources that cover Offensive AI.
meridianlabs-ai/inspect_petriAn alignment auditing agent capable of quickly exploring alignment hypothesis
microsoft/responsible-ai-toolboxInteractive dashboards and libraries for responsible AI model debugging, covering error analysis, fairness, interpretability, counterfactuals, causal…
atsukisato/pgm-attackResearch code for poisoning attacks on the PGM-index, demonstrating how to craft adversarial data to degrade learned index performance.
toxy4ny/delirium-ai-safety-benchmarkA diagnostic framework for measuring LLM vulnerability to Affective Contextual Erosion (ACE) and related liminal attack vectors. **Delirium** is not…
paul12345-cyber/multimodal-web-attack-datasetThis repository hosts a multimodal web attack dataset (MWAD) to advance AI-driven threat detection research.
trusted-ai/aif360A comprehensive set of fairness metrics for datasets and machine learning models, explanations for these metrics, and algorithms to mitigate bias in…
dtrizna/quasarnixReverse Shell Detection with Machine Learning
c3rb3ru5d3d53c/binlexA Binary Genetic Traits Lexer Framework
jpoindexter/interrogation-gameVoice-based detective interrogation game. Mistral Large 3 + Voxtral STT + ElevenLabs TTS. Built for the Mistral Worldwide Hackathon 2026.
safety-research/bloomAutomated behavioral evaluation framework for LLMs that generates diverse test scenarios to probe for sycophancy, bias, and other safety-relevant…
pwnhyo/t-mapTrajectory-aware evolutionary search framework for red-teaming LLM agents over MCP servers, generating adversarial prompts to map vulnerability…
trailofbits/anamorpherimage scaling attacks for multi-modal prompt injection
sbamit/exponentiated-gradient-descent-llm-attackA novel adversarial attack on LLM based on the Exponentiated Gradient Descent technique.
xueboqiu/prohunterGraph-based threat detection system using inexact graph vector matching to compare threat graphs with CTI-derived attack query graphs for automated…