Skip to content
KitploitKITPLOIT
ToolsExploitsBlog
Log in
Submit
ToolsExploitsBlog
Submit

Hacking, PenTest, and Cybersecurity Tools for Your Security Arsenal!

Kitploit is a directory of hacking, cybersecurity, and pentesting tools. Discover the latest project updates to find vulnerabilities, analyze systems, automate testing, and strengthen your security.

··Feeds·Contact·Privacy·© 2026 Kitploit

Tool Directory

Categories

View all categories
Loading categories
Prompt-Injection-in-the-Wild — Tracker of publicly reported prompt-injection techniques, broken down by delivery method, encoding, and propagation behavior, with confirmed models, sources, and MITRE ATLAS tags. | Kitploit
Tools/GitHubGitHub/cybershujin/prompt-injection-in-the-wild
Indicator of Compromise (IOC) ManagementThreat Feeds & AggregatorsVulnerability AnalysisThreat IntelligencePapers & ResearchLearning & EducationCurated ResourcesAI SecurityAdversarial Attack

Most Popular

View all →

Discover the most used tools by our community.

Explore all tools

Browse our collection of tools

View all tools →
Share
GitHubcybershujin/prompt-injection-in-the-wild

Prompt-Injection-in-the-Wild

Tracker of publicly reported prompt-injection techniques, broken down by delivery method, encoding, and propagation behavior, with confirmed models, sources, and MITRE ATLAS tags.

View Repository
22312 days agoNot yet reviewed

Prompt Injection in the Wild

A tracker of publicly reported prompt-injection techniques from roughly the last two years, maintained by Rachel James (cybershujin).

Each technique is broken down into the three elements of a prompt injection:

  1. Delivery method — how the injected instructions reach the model (a tool-call result, an external website, an MCP connection, a document, an email, an image, etc.).
  2. Encoding — the obfuscation applied to the payload, if any (Base64, leetspeak, invisible Unicode tag characters, homoglyphs, …). Blank when the payload is plain text or the report doesn't say.
  3. Propagation behavior — whether the injection is designed to spread or persist (delivered to anyone who connects to a poisoned MCP server, persisted in an agent's long-term/project memory, carried along a chain of tool calls, made to emit an email carrying further instructions, …). Blank when there is no propagation.

Each entry also records the models it was confirmed to work against (if any), a link to the reporting source, and — where known — the attack source (the researcher, red team, or in-the-wild actor it originated from).

Live dashboard: https://cybershujin.github.io/Prompt-Injection-in-the-Wild/


Scope & methodology

  • In scope: techniques for injecting adversarial instructions into an LLM or LLM-powered agent that have been publicly reported — by security researchers, red teams, vendors, or as observed in-the-wild activity. Both direct and indirect (data-borne) prompt injection are included.
  • Out of scope: generic jailbreak wordlists with no delivery/propagation mechanism, pure model-alignment complaints, and marketing with no technical substance.
  • Never guessed. Every non-blank cell is taken from an explicit statement in the cited source. If a report does not state the encoding, the propagation behavior, the confirmed models, or the attack source, that cell is left blank — a blank means "not stated," never an inferred "none."
  • Vetting. Each entry is marked Confirmed or Not fully vetted. "Not fully vetted" flags an entry whose source is vague, unconfirmed, or whose mechanism is unclear — it is surfaced rather than dropped, so a reviewer can judge it.
  • Evidence class — in-the-wild vs. research. Each entry is tagged In-the-wild (observed real-world abuse or a real production incident), Research / red-team (a security-researcher or red-team demonstration / responsible disclosure — a real, working technique, but not observed being abused by an attacker), Vendor advisory, or Unclear. This is a separate axis from vetting: a technique can be Confirmed (verified and working) yet only ever demonstrated in a lab. Be aware: genuine in-the-wild malicious prompt injection is still rarely documented publicly, so the large majority of entries here are research / red-team disclosures — at the time of the initial backfill, 29 of 32 were research/red-team and only 3 were in-the-wild. Use the Evidence filter on the dashboard to isolate the real-world cases.
  • Updates. New reporting is swept monthly (Perplexity sonar-deep-research, wide net) and proposed as a draft pull request for maintainer review. Nothing is auto-merged. See the sibling Threat-Actors-use-of-Artifical-Intelligence tracker for the same workflow applied to threat-actor AI use.

How the data is built

The data lives only in the table below (this file is the single source of truth). A deterministic, dependency-free generator (tools/build_exports.py) compiles it on every commit into:

  • index.html — the interactive dashboard (served via GitHub Pages),
  • tracker.json — normalized machine-readable data,
  • stix/prompt-injection-stix2.1.json — a STIX 2.1 bundle (each technique as an attack-pattern, tagged with its MITRE ATLAS ID and a Not fully vetted → low-confidence mapping).

Do not hand-edit those three files; edit the table and let CI rebuild them.


Techniques


Appendix A — Delivery methods (controlled vocabulary)

How the injected instructions reach the model. Extensible; add a new term here when a report describes a genuinely new vector.

  • Direct prompt — attacker-controlled text typed straight into the model's input.
  • Indirect – website / HTML — instructions embedded in a web page the model browses or summarizes.
  • Indirect – document / file — payload inside a PDF, DOCX, spreadsheet, or other file the model ingests.
  • Indirect – email — instructions inside an email an agent reads or triages.
  • Indirect – RAG / retrieved content — payload planted in a knowledge base, vector store, or search result the model retrieves.
  • Tool-call / function result — instructions returned in the output of a tool/function the agent invokes.
  • MCP server / connection — payload served by a Model Context Protocol server or tool description.
  • Multimodal – image — instructions in an image (visible text, low-contrast text, or pixel/metadata payload).
  • Multimodal – audio — instructions carried in an audio input.
  • Code / repository content — payload in source code, comments, issues, or CI logs an agent reads.
  • Calendar / invite — instructions inside a calendar event, invite, or meeting note.

Appendix B — Encodings (controlled vocabulary)

Obfuscation applied to the payload. Blank in the table means the payload was plain text or the report did not specify.

  • Base64
  • Hex
  • ROT13
  • Leetspeak
  • Unicode tag characters (invisible) — U+E0000-range "tag" glyphs that render invisibly.
  • Zero-width characters — zero-width space/joiner used to hide or split text.
  • Homoglyphs — look-alike Unicode substitutes for ASCII letters.
  • Emoji / variation-selector smuggling
  • HTML / Markdown comment — payload hidden in comments or non-rendered markup.
  • Metadata / EXIF — instructions in file or image metadata.
  • Multi-layer — more than one of the above, stacked.

Appendix C — Propagation behaviors (controlled vocabulary)

Whether the injection is designed to spread or persist. Blank in the table means no propagation behavior was reported.

  • Self-propagating / worm (AI-to-AI) — output is crafted to become the next system's injected input.
  • Persists in agent / project memory — written into long-term or project memory so it re-triggers on later sessions.
  • Spreads via MCP to connectors — a poisoned MCP server delivers the payload to every client that connects.
  • Moves through tool-call chain — carried forward across a sequence of tool calls within one agent run.
  • Emits outbound email / message with further instructions — causes the agent to send a message that itself carries the injection.
  • Poisons shared data store / RAG — plants the payload where other users' or agents' retrievals will pick it up.
  • Spreads via shared config / rules files — malicious agent rules/config propagate through shared or central rule repositories into derived projects (CREDIT: Rachel James, based on the Pillar Security "Rules File Backdoor" report).
  • Cross-agent / cross-session — reaches other agents or later sessions beyond the initial context.

Appendix D — MITRE ATLAS crosswalk

Techniques are tagged with MITRE ATLAS technique IDs where one applies. IDs are validated on each update against MITRE's canonical mitre-atlas/atlas-data source (the data that generates the live matrix; the atlas.mitre.org site is a JS app that blocks automated fetch). Behaviors with no clean ATLAS mapping are noted with a coined label (CREDIT: Rachel James, based on the cited report). IDs used in this tracker:

  • AML.T0051 LLM Prompt Injection — AML.T0051.000 Direct, AML.T0051.001 Indirect
  • AML.T0053 AI Agent Tool Invocation (supersedes the retired "LLM Plugin Compromise" title)
  • AML.T0054 LLM Jailbreak
  • AML.T0057 LLM Data Leakage
  • AML.T0068 LLM Prompt Obfuscation

Contributions welcome — see CONTRIBUTING.md, or submit a technique directly. Every proposed row must cite an explicit source for each non-blank field; unclear entries are marked "Not fully vetted" rather than dropped.

Download Tool
TechniqueDelivery MethodEncodingPropagationConfirmed ModelsAttack SourceEvidenceVettingBriefATLASReportedLink
ASCII smuggling across LLMs (FireTail)Calendar / invite; Indirect – emailUnicode tag characters (invisible)Google Gemini; Grok; DeepSeekResearcher: Viktor Markopoulos (FireTail)Research / red-teamConfirmedInvisible Unicode tag characters hidden in ordinary calendar invites and emails were interpreted by Gemini, Grok and DeepSeek but not shown to the user; ChatGPT, Copilot and Claude were found to scrub them. Google responded "no action."AML.T0051.001; AML.T0068Oct 2025https://www.firetail.ai/blog/ghosts-in-the-machine-ascii-smuggling-across-various-llms
CamoLeak (GitHub Copilot Chat)Code / repository contentHTML / Markdown commentGitHub Copilot ChatResearcher: Omer Mayraz (Legit Security)Research / red-teamConfirmedCVE-2025-59145 (CVSS 9.6): invisible HTML-comment prompt injection in a pull request made Copilot Chat search a private repo for secrets and exfiltrate them character-by-character via attacker-pregenerated GitHub Camo image URLs; fixed by disabling image rendering.AML.T0051.001; AML.T0068; AML.T0057Oct 2025https://www.legitsecurity.com/blog/camoleak-critical-github-copilot-vulnerability-leaks-private-source-code
Unseeable screenshot-OCR injectionMultimodal – imagePerplexity Comet; Fellou; Opera NeonResearcher: Artem Chaikin, Shivan Kaul Sahib (Brave)Research / red-teamConfirmedPrompt-injection instructions rendered as near-invisible low-contrast text inside on-page images are recovered by an AI browser's OCR when it processes a screenshot, so a human sees nothing while the agent obeys. Demonstrated across multiple agentic browsers.AML.T0051.001; AML.T0068Oct 2025https://brave.com/blog/unseeable-prompt-injections/
ChatGPT Atlas omnibox injectionDirect prompt; Indirect – website / HTMLChatGPT AtlasResearcher: NeuralTrustResearch / red-teamConfirmedA string that looks like a URL but fails URL parsing makes Atlas's omnibox treat the embedded text as a trusted prompt; pasted or delivered behind a "Copy link" button, it can drive the agent to visit attacker sites or delete Google Drive files in the user's authenticated session.AML.T0051.000; AML.T0051.001Oct 2025https://neuraltrust.ai/blog/openai-atlas-omnibox-prompt-injection
Invitation Is All You Need (Gemini)Calendar / invite; Indirect – emailPersists in agent / project memory; Moves through tool-call chain; Cross-agent / cross-sessionGoogle Gemini (web, mobile app, Android assistant)Researcher: Or Yair, Ben Nassi, Stav Cohen (SafeBreach / Technion)Research / red-teamConfirmedA Google Calendar invite (or email) whose fields carry an indirect prompt injection hijacks Gemini when the user interacts with their calendar; 14 demonstrated attacks span short/long-term memory poisoning, tool misuse and automatic agent/app invocation, reaching connected apps and smart-home devices.AML.T0051.001; AML.T0053Aug 2025https://www.safebreach.com/blog/invitation-is-all-you-need-hacking-gemini/
MCPoison (Cursor MCP rug-pull)MCP server / connection; Code / repository contentCursor IDE (< v1.3)Researcher: Check Point ResearchResearch / red-teamConfirmedCVE-2025-54136: Cursor trusted an approved MCP config permanently, so an attacker who gets a benign mcp.json approved in a shared repo can later swap in a malicious command that executes silently on every subsequent project open.AML.T0051.001; AML.T0053Aug 2025https://research.checkpoint.com/2025/cursor-vulnerability-mcpoison/
GitHub Copilot RCE / "YOLO mode"Indirect – website / HTML; Code / repository content; Tool-call / function resultUnicode tag characters (invisible)GitHub Copilot (VS Code — Windows, macOS, Linux)Researcher: Johann Rehberger (Embrace The Red)Research / red-teamConfirmedCVE-2025-53773: an injected instruction makes Copilot edit .vscode/settings.json to enable chat.tools.autoApprove ("YOLO mode"), removing command-approval prompts and enabling arbitrary code execution; one variant used invisible Unicode tags.AML.T0051.001; AML.T0053Aug 2025https://embracethered.com/blog/posts/2025/github-copilot-remote-code-execution-via-prompt-injection/
CurXecute (Cursor RCE via MCP)Tool-call / function resultMoves through tool-call chainCursor (fixed v1.3)Researcher: Aim Labs (Aim Security)Research / red-teamNot fully vettedCVE-2025-54135: a prompt injection delivered via an external MCP data source (e.g. a Slack message returned through a tool) makes Cursor rewrite its own mcp.json, and auto-run executes the attacker's command with no approval. Primary Aim Labs page was unreachable at verification; corroborated by secondary reporting.AML.T0051.001; AML.T0053Aug 2025https://www.catonetworks.com/blog/curxecute-rce/
AgentFlayer (ChatGPT Connectors)Indirect – document / fileChatGPT (Connectors)Researcher: Tamir Ishay Sharbat (Zenity Labs)Research / red-teamConfirmedAn invisible payload hidden in a shared document instructs ChatGPT — via Connectors such as Google Drive — to render a markdown image whose URL parameters carry stolen data; rendering fires the request with no click.AML.T0051.001; AML.T0057Aug 2025https://labs.zenity.io/post/agentflayer-chatgpt-connectors-0click-attack-5b41
Perplexity Comet Reddit injectionIndirect – website / HTMLPerplexity CometResearcher: Artem Chaikin, Shivan Kaul Sahib (Brave)Research / red-teamConfirmedSummarizing a Reddit page whose comment hid instructions behind a spoiler tag caused the Comet browser to read the user's email and a Gmail OTP from authenticated sessions and exfiltrate them by replying to the comment.AML.T0051.001; AML.T0057Aug 2025https://brave.com/blog/comet-prompt-injection/
Amazon Q Developer wiper promptCode / repository contentAmazon Q Developer (VS Code extension)In-the-wild: actor "lkmanka58"In-the-wildNot fully vettedAn attacker merged a PR into the Amazon Q Developer extension planting a prompt instructing the assistant to wipe local files and AWS resources; it shipped in v1.84.0 before removal (reportedly would not execute due to formatting). Verified via aggregated reporting; primary source not directly confirmed.AML.T0051.001Jul 2025https://www.scworld.com/news/amazon-q-extension-for-vs-code-reportedly-injected-with-wiper-prompt
EchoLeak (M365 Copilot, LLM Scope Violation)Indirect – emailMicrosoft 365 CopilotResearcher: Aim Labs (Aim Security)Research / red-teamConfirmedCVE-2025-32711 (CVSS 9.3): a single crafted email made M365 Copilot's RAG engine pull attacker instructions into context alongside privileged data ("LLM Scope Violation") and exfiltrate it with zero user interaction, bypassing the XPIA classifier and link/image redaction; patched server-side.AML.T0051.001; AML.T0057Jun 2025https://www.aim.security/lp/aim-labs-echoleak-m365
GitHub MCP toxic agent flowCode / repository content; MCP server / connectionMoves through tool-call chainClaude 4 Opus (Claude Desktop + GitHub MCP)Researcher: Invariant LabsResearch / red-teamConfirmedA prompt injection planted in a public GitHub issue, reached through the GitHub MCP server, coerces the agent into pulling private-repo data into context and leaking it in an autonomously-created public pull request; no component malfunctions.AML.T0051.001; AML.T0057; AML.T0053May 2025https://invariantlabs.ai/blog/mcp-github-vulnerability
Character-injection guardrail evasionDirect promptZero-width characters; Homoglyphs; Emoji / variation-selector smuggling; Multi-layerAzure Prompt Shield; Meta Prompt Guard; ProtectAI Prompt Injection v1/v2; NVIDIA NeMo Guard; VijilResearcher: Mindgard / Lancaster University (Hackett et al.)Research / red-teamConfirmedSystematic study: non-printing zero-width characters, homoglyph substitution and emoji variation-selector smuggling evade commercial prompt-injection/jailbreak guardrail classifiers (the confirmed targets are the detection systems, not the LLMs); zero-width averaged 44–76% evasion, emoji smuggling highest.AML.T0068; AML.T0051Apr 2025https://arxiv.org/html/2504.11168v1
MCP tool poisoningMCP server / connectionMoves through tool-call chainCursorResearcher: Invariant LabsResearch / red-teamConfirmedMalicious instructions embedded in an MCP tool description are invisible to the user but read by the model; a poisoned "add" tool silently made Cursor read and exfiltrate the developer's SSH key while returning a correct result. Anthropic, OpenAI and Zapier named as affected clients.AML.T0051.001; AML.T0053Apr 2025https://invariantlabs.ai/blog/mcp-security-notification-tool-poisoning-attacks
MCP line jumpingMCP server / connectionClaude DesktopRed team: Trail of BitsResearch / red-teamConfirmedBecause MCP clients load every tool description into the model's context as soon as a server is listed, a malicious description can alter model behavior before any tool is invoked, bypassing the user's tool-call approval step.AML.T0051.001; AML.T0053Apr 2025https://blog.trailofbits.com/2025/04/21/jumping-the-line-how-mcp-servers-can-attack-you-before-you-ever-use-them/
MCP rug pullMCP server / connectionResearcher: Invariant LabsResearch / red-teamConfirmedA malicious MCP server presents a benign tool to gain approval, then silently swaps in poisoned instructions afterward; clients do not re-prompt because the tool identity is unchanged.AML.T0051.001; AML.T0053Apr 2025https://invariantlabs.ai/blog/mcp-security-notification-tool-poisoning-attacks
Rules File Backdoor (Cursor / Copilot)Code / repository contentZero-width characters; Unicode tag characters (invisible)Spreads via shared config / rules filesCursor; GitHub CopilotResearcher: Ziv Karliner (Pillar Security)Research / red-teamConfirmedInvisible-Unicode instructions hidden in AI coding "rules"/config files silently steer Cursor and GitHub Copilot to insert backdoors into generated code, with nothing shown in chat or logs; the hidden characters are invisible even in GitHub's PR-review view.AML.T0051.001; AML.T0068Mar 2025https://www.pillar.security/blog/new-vulnerability-in-github-copilot-and-cursor-how-hackers-can-weaponize-code-agents
Gemini memory persistence (delayed tool invocation)Indirect – document / filePersists in agent / project memory; Cross-agent / cross-sessionGemini AdvancedResearcher: Johann Rehberger (Embrace The Red)Research / red-teamConfirmedA malicious uploaded document poisons the chat so that when the user later says a trigger word, Gemini invokes its memory tool "on the user's behalf" ("delayed tool invocation") and writes attacker-chosen false long-term memories that persist across future sessions.AML.T0051.001; AML.T0053Feb 2025https://embracethered.com/blog/posts/2025/gemini-memory-persistence-prompt-injection/
ZombAIs (Claude Computer Use C2)Indirect – website / HTMLClaude Computer UseResearcher: Johann Rehberger (Embrace The Red)Research / red-teamConfirmedA malicious web page injects instructions that make Claude Computer Use download and run a binary that connects back to the researcher's server — a full prompt-injection-to-command-and-control chain on a computer-using agent.AML.T0051.001; AML.T0053Oct 2024https://embracethered.com/blog/posts/2024/claude-computer-use-c2-the-zombais-are-coming/
SpAIware (ChatGPT memory)Indirect – website / HTML; Indirect – document / filePersists in agent / project memory; Cross-agent / cross-sessionChatGPT (macOS app)Researcher: Johann Rehberger (Embrace The Red)Research / red-teamConfirmedPrompt injection from untrusted web/document content writes a persistent instruction into ChatGPT's long-term Memory, causing continuous exfiltration (via rendered image URLs) of everything the user types or receives in all future sessions until the memory is removed.AML.T0051.001; AML.T0057Sep 2024https://embracethered.com/blog/posts/2024/chatgpt-macos-app-persistent-data-exfiltration/
M365 Copilot ASCII smuggling exfiltrationIndirect – email; Indirect – document / fileUnicode tag characters (invisible)Moves through tool-call chainMicrosoft 365 CopilotResearcher: Johann Rehberger (Embrace The Red)Research / red-teamConfirmedA prompt injection hidden in a malicious email or shared document made M365 Copilot automatically search other emails/documents, then used ASCII smuggling (invisible Unicode tags) to embed harvested data (e.g. MFA codes) in clickable hyperlinks rendered to the user; patched ~Jul 2024.AML.T0051.001; AML.T0068; AML.T0057; AML.T0053Aug 2024https://embracethered.com/blog/posts/2024/m365-copilot-prompt-injection-tool-invocation-and-data-exfil-using-ascii-smuggling/
Slack AI indirect injection exfiltrationIndirect – RAG / retrieved contentPoisons shared data store / RAGSlack AIRed team: PromptArmorResearch / red-teamConfirmedAn attacker plants instructions in a public Slack channel; Slack AI ingests them into its RAG pipeline, and when a victim later queries it, the injected instruction renders a markdown link smuggling private-channel data (e.g. an API key) into the URL to the attacker.AML.T0051.001; AML.T0057Aug 2024https://www.promptarmor.com/resources/data-exfiltration-from-slack-ai-via-indirect-prompt-injection
GitHub Copilot Chat data exfiltrationCode / repository contentGitHub Copilot Chat (GPT-4)Researcher: Johann Rehberger (Embrace The Red)Research / red-teamConfirmedCrafted instructions in a source-code file made GitHub Copilot Chat emit a markdown image whose URL carried prior conversation data; when auto-rendered, the data was exfiltrated to the attacker.AML.T0051.001; AML.T0057Jun 2024https://embracethered.com/blog/posts/2024/github-copilot-chat-prompt-injection-data-exfiltration/
Morris II (self-replicating GenAI worm)Indirect – RAG / retrieved content; Indirect – email; Multimodal – imageSelf-propagating / worm (AI-to-AI); Poisons shared data store / RAG; Emits outbound email / message with further instructions; Cross-agent / cross-sessionGemini Pro; ChatGPT 4.0; LLaVAResearcher: Stav Cohen (Technion), Ron Bitton (Intuit), Ben Nassi (Cornell Tech)Research / red-teamConfirmedAn "adversarial self-replicating prompt" makes a RAG-based GenAI email assistant copy the prompt into its own output and deliver it to further agents, triggering a worm-like cascade of indirect prompt injections that spams and exfiltrates data. Demonstrated with text and image payloads.AML.T0051.001Mar 2024https://arxiv.org/abs/2403.02817
Hidden prompt injection against Claude (Unicode tags)Direct promptUnicode tag characters (invisible)Anthropic ClaudeResearcher: Johann Rehberger (Embrace The Red)Research / red-teamConfirmedClaude interpreted invisible Unicode tag code points pasted into its interface — the same hidden-instruction behavior shown against ChatGPT. Anthropic reviewed and marked it "Not Applicable" (no identified security impact), but the interpretation behavior was demonstrated.AML.T0051.000; AML.T0068Feb 2024https://embracethered.com/blog/posts/2024/claude-hidden-prompt-injection-ascii-smuggling/
ASCII smuggling / invisible Unicode tags (foundational)Indirect – website / HTML; Indirect – document / file; Direct promptUnicode tag characters (invisible)ChatGPT (GPT-4 / DALL·E)Researcher: Johann Rehberger (Embrace The Red)Research / red-teamConfirmedFoundational writeup and "ASCII Smuggler" tool: Unicode Tags-block code points (U+E0000 range) mirror ASCII but render invisibly, while LLMs still interpret them; hidden instructions caused ChatGPT to invoke DALL·E. Basis for the whole invisible-injection class.AML.T0051; AML.T0068Jan 2024https://embracethered.com/blog/posts/2024/hiding-and-finding-text-with-unicode-tags/
DPD support chatbot overrideDirect promptIn-the-wild: Ashley BeauchampIn-the-wildConfirmedA customer instructed DPD's support chatbot to disregard its rules, making it swear and write a poem disparaging DPD — direct instruction override; DPD disabled the bot the same day. Underlying model not disclosed. (User-driven manipulation of the bot they were chatting with; no third-party victim or exfiltration.)AML.T0051.000; AML.T0054Jan 2024https://www.theregister.com/2024/01/23/dpd_chatbot_goes_rogue
Chevrolet dealership chatbot override ("$1 Tahoe")Direct promptChatGPT-based dealership assistantIn-the-wild: Chris BakkeIn-the-wildConfirmedA user injected instructions making a Chevrolet dealership's ChatGPT-based website assistant "agree" to sell a 2024 Tahoe for $1 and call it legally binding — classic direct instruction override (non-binding in reality; user-driven, no third-party victim).AML.T0051.000Dec 2023https://the-decoder.com/people-buy-brand-new-chevrolets-for-1-from-a-chatgpt-chatbot/
Google Bard markdown-image exfiltrationIndirect – document / file; Indirect – emailGoogle BardResearcher: Johann Rehberger (Embrace The Red)Research / red-teamConfirmedAn indirect prompt injection in a shared Google Doc made Bard emit a markdown image whose URL embedded the user's chat data; the client auto-loaded the image, exfiltrating data with no user interaction. One of the first zero-click LLM exfiltration cases; fixed Oct 2023.AML.T0051.001; AML.T0057Nov 2023https://embracethered.com/blog/posts/2023/google-bard-data-exfiltration/
Multimodal image prompt injection (GPT-4V)Multimodal – imageGPT-4VResearcher: Riley Goodside (via Simon Willison)Research / red-teamConfirmedAn image that looks blank carries instructions in off-white text on a white background; GPT-4V's OCR reads and follows them (Goodside's demo made the model suppress its description and advertise a fake sale). Early multimodal prompt injection.AML.T0051.001Oct 2023https://simonwillison.net/2023/Oct/14/multi-modal-prompt-injection/
Base64 encoded-prompt jailbreakDirect promptBase64; Multi-layerGPT-4; Claude v1.3; GPT-3.5 TurboResearcher: Wei, Haghtalab, Steinhardt (UC Berkeley)Research / red-teamConfirmedEncoding a forbidden request in Base64 exploits "mismatched generalization" — models learn to decode Base64 in pretraining but safety training never covered such inputs — bypassing guardrails; combination attacks reached ~94% success on GPT-4. Published Jul 2023, just before the 2-year window; canonical primary source for encoded-payload jailbreaks.AML.T0054; AML.T0068; AML.T0051.000Jul 2023https://arxiv.org/abs/2307.02483