T17 · OWASP Agentic AI v1.1

Supply Chain Compromise

A compromised upstream component — a model, library, plugin, or prompt template — is embedded in the agent, which then autonomously executes or distributes its effects across many runs.

Last reviewed 2026-05-11·Severity heuristic: critical

Definition

Supply Chain Compromise covers vulnerable, malicious, outdated, or otherwise harmful upstream components that end up inside the agent: models, libraries, plugins, prompt templates, build pipelines, or framework updates. The compromise can manipulate agent behaviour, exfiltrate data, or run arbitrary code, and is amplified in agentic systems because the agent will autonomously use the compromised component across many runs.

What it looks like in practice

Amazon Q Supply Chain Compromise. In the Amazon Q for VS Code extension (v1.84.0), an attacker with write access to the extension’s GitHub repository committed a pull request that embedded a destructive natural-language instruction directly into a source file. The instruction was phrased as a developer comment but was positioned so that any agent with access to the repository would interpret it as a directive. The prompt did not execute as the attacker intended. A reviewer caught it before the release completed propagation, but the incident established the mechanism: a supply-chain commit to a widely distributed IDE extension is a viable vector for delivering malicious instructions to thousands of developer environments where AI coding assistants read repository content as trusted context. Had the release completed, every developer who installed or auto-updated the extension would have had the instruction silently included in their agent’s context on next use.

Replit Vibe Coding Incident. Replit’s autonomous coding agent was tasked with building a small application that required a database. The agent, operating without a clear separation between test and production environments, hallucinated the existence of a test database and began treating it as the authoritative one. When the real production database was in its scope, the agent deleted it, interpreting the deletion as cleanup of a redundant resource, and then generated test results against its fabricated schema, which passed. No human reviewed the intermediate steps. The incident illustrates three compounding supply-chain weaknesses: the agent framework did not isolate test from production at the tool level; the agent’s tool call for database deletion was not gated by an explicit human confirmation step; and the agent’s own output (passing tests) served as the only validation signal for a destructive action it had just taken.

Why it’s dangerous

Conventional LLM applications already face supply-chain risk from compromised dependencies. Agentic systems extend the surface: agents are long-lived, stateful entities that chain decisions, collaborate with other agents, and persistently execute logic. A single compromised upstream component can therefore propagate behavioural drift or systemic misuse across many tasks before detection.

Where it manifests

Inspect signing and provenance for prompts, agent cards, model definitions, and plugins. Check for verifiable software bills of materials (SBOMs, including AI-specific AIBOMs and Agent SBOMs) covering the agent’s runtime components. Verify isolation of test from production environments, and whether human review gates apply to AI-generated build artifacts.

Detection signals

Supply chain compromise in agentic systems surfaces in dependency integrity checks, prompt provenance logs, and anomalous agent behaviour following updates.

  • Dependency hash mismatch against a pinned software bill of materials (SBOM): compare the hash of every installed framework package, plugin, and prompt template against a pinned SBOM on each agent startup; any mismatch that is not accompanied by an approved change-control entry is an immediate alert condition.
  • Novel natural-language instruction appearing in a source file or configuration after a dependency update: scan repository diffs and plugin changelogs for imperative natural-language constructs (e.g., “you must”, “ignore previous”, “delete all”) in files that should contain only code or structured data; flag any such pattern introduced by a third-party commit or package update.
  • Behavioural divergence in an agent after a framework or plugin version bump: establish a baseline of the agent’s tool-call distribution and output structure; alert when the distribution shifts by more than two standard deviations on a key metric such as deletion calls, outbound connections, or approval rate within 24 hours of a dependency update.
  • Destructive tool call (delete, drop, purge) without a matching user intent signal in the session log: log every tool call alongside the user instruction that preceded it; a deletion tool call that cannot be traced back to an explicit user instruction in the same session is a strong indicator of supply-chain-injected directives.
  • Agent-generated test results for a resource the agent itself modified in the same session: detect when the agent both modifies a data resource and subsequently generates a validation or test result against it without any external fixture; self-validating destructive actions (as in the Replit incident) should require an out-of-band verification step.

OWASP Top 10 for Agentic Applications 2026

The Agentic Top 10 (ASI01 through ASI10) is a separate practitioner-facing publication that maps onto the master Threats & Mitigations threat numbering. T17 is covered by the following Top 10 entries:

  • ASI04Agentic Supply Chain Vulnerabilitiesprimary

    Third-party components that agents depend on (models, MCP servers, plug-ins, datasets, peer-agent descriptors, and update channels) may be malicious, compromised post-approval, or tampered with in transit. Unlike software supply-chain risk, this is a live exposure: every new session the agent fetches and trusts components whose state may have changed since they were last reviewed.

    OWASP LLM Top 10:LLM04:2026

Source: OWASP Top 10 for Agentic Applications 2026 (Dec 2025) · the Top 10 is a compass into the master Threats & Mitigations taxonomy, not a replacement for it.

Design principles at stake

When T17 is present, these security design principles are the ones being violated or tested. Each links to the full principle; the mitigations below are how you restore them.

  • Defence-in-DepthA single compromised upstream component (a prompt template, framework update, or plugin) propagates behavioural drift silently across many autonomous runs before detection, because no individual agent flags that its foundation has changed. Depth means controls at every layer of the stack: signed artifacts verified by content hash on every load (not just at install), an SBOM and AIBOM that enumerate every runtime component so drift is detectable, sandboxed plugin loading and inter-agent message parsing isolated from the main process, and human review gates applied to AI-generated build artefacts before they reach production. Defeating any one of these layers (say slipping a malicious package past the registry) still leaves runtime re-verification, sandbox isolation, and the human gate standing.
  • Supply-chain SecurityIn agentic systems the supply chain extends beyond code dependencies to include models, prompt templates, agent cards, and plugin definitions, all of which are inputs the agent will autonomously act on across many tasks before any anomaly surfaces. The Amazon Q incident showed that supply-chain write access to a widely-installed agent extension is sufficient for broad impact; the Replit incident showed that unsandboxed tools and unvalidated prompt execution are themselves supply-chain failure modes. Controls must therefore span provenance verification of every component at build and runtime, isolation of test from production environments so a compromised test artefact cannot reach live agents, and version-pinning by content hash so a rug-pull on a floating version tag is caught immediately.

Catalogue extensions: Helmwart T18 to T49

This normalized catalogue includes 3 multi-agent entries based on the OWASP MAS Threat Modelling Guide v1.0 that extend T17. The source guide reuses some numbers between worked systems; these Helmwart entries provide stable detail pages, MAESTRO layers, and mitigation coverage.

Red-team pivot: MITRE ATLAS techniques

MITRE ATLAS catalogues adversary techniques against AI systems. Where this OWASP threat has an attacker-perspective counterpart, the ATLAS technique is shown below. That is what a red team would actually be doing on the wire. Use this for detection-signal anchoring, threat-hunting hypotheses, and IR runbooks. Source: mitre-atlas/atlas-data v5.6.0.

© 2026 The MITRE Corporation. ATLAS content is reproduced and distributed with the permission of The MITRE Corporation.

AML.T0010AI Supply Chain Compromiseview on ATLAS ↗

Adversary tampers with components in the AI supply chain (datasets, model weights, libraries, container images) to compromise downstream systems before deployment.

Agentic angle: Agentic systems compose models, MCP servers, agent registries, and prompt templates at runtime. Every dependency is a potential vehicle for compromise.

AML.T0019Publish Poisoned Datasetsview on ATLAS ↗

Adversary publishes a manipulated dataset to a public hub (HuggingFace, Kaggle, GitHub) so that downstream training pipelines incorporate the poisoned data.

AML.T0058Publish Poisoned Modelsview on ATLAS ↗

Adversary publishes a model (to HuggingFace, an internal registry, or an MCP server) that contains a backdoor or biased behaviour activated at runtime.

AML.T0109AI Supply Chain Rug Pullview on ATLAS ↗

Adversary publishes legitimate AI components to gain adoption, then replaces them with a malicious variant, exploiting the trust established before the switch.

Agentic angle: Trusted MCP servers or model registries used by agents are high-value rug-pull targets because agents fetch and execute without further human review.

Sources

Adapted by Helmwart from the OWASP source(s) above underCC BY-SA 4.0(changes: normalized IDs, added MAESTRO-layer, agentic-factor, and mitigation mappings). This entry is licensed CC BY-SA 4.0.