Blue Marshal

AI visibility: which tool can actually see your AI?

An AI inventory that only lists what you approved misses most of what's running. The AI Visibility Map names the tool that sees each kind of AI in each part of the estate, and turns the gaps into an action list. With what Microsoft Defender, Palo Alto, CrowdStrike, Tanium and others can discover today, a worked example and a free template.

Drawn by
Blue Marshal
Post
3 of 3
Issued
Reading time
14 min
Revision
A

Ask a security team what AI is running in their environment and you'll usually get the list of approved tools. That list is the easy part. The hard part is everything nobody approved: a local model on a developer's laptop, a copilot agent a business user published on a Friday, an MCP server in someone's IDE config with a token to the ticketing system, a free-tier AI account signed up with a corporate email.

The better question is narrower and more useful: for each kind of AI asset, in each part of the estate, which tool can actually see it? If you can't name the tool, you don't have visibility, you have hope.

The AI Visibility Map is the worksheet I use to answer that question. This post explains how it works, walks through a fully worked example for a fictional company, shows what Microsoft Defender and other vendors can already discover, and ends with the free template.

The grid

The map crosses five classes of AI asset (the rows) with four environments (the columns), plus one governance band at the foot.

RowAI asset classThe question it answers
01Models and model endpointsWhich models run or are called, by whom, and with what data?
02Agents and copilotsWhat acts on its own, under whose identity, with what permissions?
03MCP servers and tool connectorsWhat can an AI reach into, and who approved that connection?
04AI pipelines and data flowsWhere does your data go to be embedded, trained on, or retrieved?
05AI tooling, runtimes and supply chainWhat AI code and dependencies are installed, and can you trust them?
GOVGovernance and assuranceFor whatever runs here: is it approved, is it audited, and can you enforce policy?

The four environments are the columns:

  • On-premises: workstations and servers, managed and unmanaged, including VDI, containers and engineering segments.
  • Cloud platforms: Azure, AWS and Google Cloud, including managed AI services.
  • SaaS, internal: AI inside the apps you license, such as Microsoft 365 Copilot and the agents people build in it.
  • SaaS, external and shadow: third-party AI reached over the network. Unsanctioned unless your policy says otherwise.

Sanctioned versus shadow AI is the column axis, so it isn't repeated as rows. That keeps the map to 24 cells, which is small enough to fill in a week.

What a cell asks for

Every cell comes with a short list of what to look for in that environment. Three examples show how different the same row looks across the columns.

CellWhat to look for
Models, on-premisesLocal runtimes such as Ollama, LM Studio and llama.cpp; model weight files on disk; listeners on ports 11434 and 1234; sustained GPU use; self-hosted inference servers like vLLM, Triton and TGI.
Agents, SaaS internalCopilots and agent builders in your suite, including agents and flows that end users publish; who published each one, and what knowledge and connectors it holds.
MCP, SaaS externalDesktop and IDE clients connecting to remote MCP endpoints on the internet; egress to MCP and SSE endpoints; tokens issued to external MCP servers.

The full list for all 24 cells is in the template.

The scoring rules

Each cell gets one of four coverage states.

CoverageMeaning
FullDiscovered, monitored, and the logs land in the SIEM
PartialSome assets or some signal only
NoneConfirmed blind spot
UnknownNot assessed yet, or the tool is unverified

Five rules keep the scoring honest. They're the part of the map that does the real work.

  1. A score needs a named tool. Every cell scored Full, Partial or None must name the tool behind it. A score with no tool is not coverage.
  2. Unverified tools get a question mark. If a tool is deployed and could cover the cell but nobody has confirmed it, write the tool name with a ? in front and leave the cell Unknown until someone checks.
  3. Blocking alone is Partial. A tool that blocks AI traffic but keeps no inventory and no logs gives you control without visibility.
  4. No SIEM, no Full. If a tool's logs don't reach the SIEM, its coverage is Partial, however good the tool is.
  5. Unknowns don't count. The score is (Full + half of Partial) divided by the cells you assessed. Unknown cells are left out, so a map full of Unknowns isn't a good score. It's an unfinished map.

The tool register also records how deep each tool goes: Discover (it sees the asset exists), Detect (it sees what the asset is doing), or Control (it can stop or restrict it). Most organizations find their tools stop at Discover for anything AI-specific.

A worked example: Northbridge Corp

Northbridge Corp is a fictional mid-size company. Every tool, score, gap and decision below is invented for teaching.

Scope. Microsoft 365 Copilot is the only sanctioned AI service, in a 200-seat pilot. Everything else, including AI features inside products Northbridge already licenses, is unsanctioned by policy. The estate is about 2,400 endpoints and 180 servers, a small Azure footprint, a customer portal, one Microsoft 365 tenant, and a recently acquired subsidiary that still runs its own network.

Coverage at a glance

AI asset classOn-premisesCloudSaaS internalSaaS external / shadow
01 Models and endpointsPartialPartialUnknownPartial
02 Agents and copilotsPartialPartialPartialUnknown
03 MCP and connectorsUnknownPartialPartialUnknown
04 Pipelines and data flowsUnknownPartialPartialPartial
05 Tooling and supply chainPartialPartialUnknownPartial
GOV GovernancePartialPartialPartialUnknown

Northbridge assessed 17 of 24 cells. All 17 are Partial and 7 are still Unknown. Nothing is Full and nothing is a confirmed None. The score is 50%, and it tells the real story: Northbridge can half-see its AI everywhere and fully see it nowhere.

What the tool register shows

Northbridge isn't short of tools. It runs Defender for Endpoint and Defender for Servers, Defender for Cloud, a next-generation firewall with URL filtering, Purview, the Microsoft 365 and Power Platform admin centres, and Sentinel. The register explains why that still adds up to Partial everywhere.

  • The endpoint agent sees processes, not agents. It can report that an agent binary ran. It can't say whose identity the agent used, what it was allowed to do, or what it connected to.
  • The firewall sees destinations, not content. It reports traffic to model API domains, but not what data left, and not which user sent it without joining to identity logs.
  • The SIEM receives the data and nothing reads it. Copilot audit logs and Defender telemetry reach Sentinel, but there are no AI-specific analytics rules.
  • Two rows in the register point at holes. The subsidiary's firewall is run by its own IT and its logs never reach Sentinel. And there's no CASB, so shadow AI can be detected but not governed.

The gaps and the decisions

Every Unknown and every weak Partial became a gap with an owner and a date. The top five:

  1. Shadow AI can be seen but not stopped. Detection without enforcement isn't a control. Decide the enforcement path: a CASB, tenant restrictions, or firewall blocking with an exception process.
  2. The subsidiary has no AI visibility at all. Onboard its endpoints to Defender, ship its firewall logs to Sentinel, and decide what AI use is allowed there until then.
  3. No tool gives an MCP inventory. MCP visibility depends on hunting queries nobody has written yet. Write them, schedule them, and alert on new MCP clients and servers.
  4. External agents could be granted rights in the tenant unnoticed. Run an OAuth consent-grant review for AI apps and make it recurring.
  5. Copilot audit data lands and nothing reads it. Build the first three rules: a new agent published, unusual Copilot data access, and a first-seen AI domain in egress.

The map ends with the decisions only leadership can make. For Northbridge there are six, and the third one explains the rest: assign an owner for AI visibility. Every gap on this map is unowned today, which is why they're all still open.

What your tools may already see

Before you buy anything, check what your existing tools found while you weren't looking. Several vendors shipped AI discovery in 2026, and some of it is already in licences people own.

Microsoft Defender: the AI agents inventory

In the Microsoft Defender portal, Assets, then AI agents (security.microsoft.com/ai-inventory) brings cloud and local AI agents into one inventory, on two tabs.

  • Agents lists cloud agents: agents built with Copilot Studio, Microsoft Foundry and Microsoft 365, plus supported non-Microsoft platforms through the Agent 365 registry. Each one shows its platform, publish status, tools, MCP servers, alerts and, with the right licence, a risk level.
  • Local agents lists AI agents that Defender for Endpoint found running or installed on devices. Microsoft's support list covers about 60 of them on Windows and macOS, including Claude Code, Claude Desktop, Codex, Cursor, GitHub Copilot, Gemini CLI, Ollama Desktop, LM Studio, OpenCode and OpenClaw. For many of them it also reports the MCP servers they're configured to use.

Here's the Local agents tab in my own lab, with device names and IDs replaced:

Microsoft Defender AI Agents page, Local agents tab: seven agents (Claude Code, Claude Desktop, Ollama Desktop, OpenCode) across one macOS workstation and two Linux servers, with device names replaced and device IDs redacted
Defender's Local agents tab in my lab. Device names are replaced and IDs redacted.

Each row is one agent on one device under one account, with the version, operating system, device type and the number of remote and local MCP servers. The detail pane goes further: the agent's vendor and model, the process hosting it, whether that process is trusted, and whether the agent approves its own actions without asking. That last field is the one I'd look at first. An agent that auto-approves runs tools with whatever the user's account can reach.

What it takes, from Microsoft's documentation:

NeedDetail
Licence for the inventoryDefender for Endpoint Plan 2 (included in Microsoft 365 E5 and E7)
Licence for risk levels and recommendationsMicrosoft 365 E7, or Agent 365 with Defender for Endpoint Plan 2
DevicesOnboarded to Defender for Endpoint, on a supported Windows or macOS version
MCP server discoveryDefender Antivirus in active mode with real-time protection
CloudCommercial cloud only. Sovereign and national clouds aren't supported

Three things to keep in mind. A running process is enough to create an entry, so an entry doesn't prove anyone used the agent. Installing an agent doesn't guarantee an entry either. And the documented support is Windows and macOS: in my lab it also listed Claude Code and OpenCode on two Linux servers, but Microsoft doesn't document native Linux yet, so treat that as a bonus rather than a promise.

On the map, this fills cells that were hard to fill before: models, agents and MCP connectors on endpoints (rows 01 to 03, on-premises), and agents in your Microsoft tenant and cloud (row 02, SaaS internal and cloud). It doesn't see AI used through a browser, data flows (row 04) or most of the supply chain (row 05). Northbridge's map was scored before this shipped. With Defender for Endpoint Plan 2 and active-mode antivirus, its gap 3 (no MCP inventory) and its on-premises agent cell would both be re-scored. That's why the map has a re-score date.

What other vendors offer

Every major security vendor now sells some form of AI discovery. They look from different places, and that decides which cells of the map they can fill.

VendorOfferingLooks fromWhat it findsStatus as of November 2026
MicrosoftDefender AI agents inventory, Agent 365Endpoints (Windows, macOS) and Microsoft's agent platformsLocal agents and their MCP servers; Copilot Studio, Foundry and Microsoft 365 agentsLocal discovery generally available on Windows and macOS
Palo Alto NetworksPrisma AIRS 3.0; Agentic Endpoint Security from the Koi acquisitionCloud, SaaS, endpoints and browsersAgents, models, MCP servers and plugins; a Cortex XDR module for AI software on endpointsAIRS 3.0 announced March 2026; Koi acquisition closed April 2026; AI Agent Gateway in limited preview
CrowdStrikeFalcon Guardian; AI Agent Discovery in Falcon Shield; AI discovery in Falcon for ITEndpoint sensor, SaaS connectors, DNS telemetryKnown and unknown agents, local model runtimes, SDKs and agent frameworks; agents in SaaS platformsFalcon Shield discovery generally available from March 2026
TaniumGuardian AI tools dashboard in the Tanium ConsoleManaged endpointsMCP servers configured in tools like VS Code and Claude Code, local inference engines, OpenClaw, and local model files such as .gguf, .safetensors and .onnxShown April 2026; the model file audit needs Threat Response and Index
ZscalerAI Asset Management; AI Broker with an agent registryNetwork (its security service edge) and endpointsAI apps, models, infrastructure and agents; on endpoints, agent config files, MCP servers and model filesAI Broker announced at Zenith Live 2026
NetskopeAI Command Center; AI discovery in the Netskope Client; Agentic BrokerEndpoint client, network proxy, and servers through an eBPF agentAgents, local model runtimes (Ollama, LM Studio, Jan, GPT4All), local MCP servers, browser and IDE AI extensions, and MCP trafficAnnounced June 2026, rolling out through Q3 2026
WizAI-SPM and AI-BOMCloud APIs, agentless (AWS, Azure, Google Cloud, Kubernetes)AI services, models, agents, MCP use, and AI SDKs and librariesGenerally available
SentinelOnePrompt Security for agentic AISaaS, desktops, browsers and developer toolsAgents and MCP servers, including shadow ones; an MCP gateway to govern themVendor material only

Read the table against the map's columns, and the pattern is clear.

  • Endpoint tools (Defender, CrowdStrike, Tanium, the Netskope and Zscaler clients) fill the on-premises column: local runtimes, agents, MCP configs and model files.
  • Network tools (Zscaler, Netskope, Palo Alto) fill the external and shadow column: who calls which AI service, and which MCP endpoints are reached over the internet.
  • Cloud posture tools (Wiz, Palo Alto, Defender for Cloud) fill the cloud column.
  • SaaS and agent platform connectors (Microsoft, CrowdStrike Falcon Shield) fill the SaaS internal column.

No single product fills the grid, which is why the map asks you to name a tool for every cell. Two cautions. Almost everything in this table is the vendor's own description, and I haven't found independent tests comparing them. And these products are changing fast, so check the vendor's current documentation before you score a cell against one of them.

Run it in a week

You don't need a project to start. You need a scope paragraph, your tool list and a few hours with the people who run those tools.

DayWork
MondayWrite the scope paragraph: approved AI services, estate size, cloud footprint, tenants, and any segments that are run separately. List every tool that could give AI visibility today.
TuesdayWalk the rows for on-premises and cloud. For each cell, name the tool that answers the question, or write ? before a tool nobody has confirmed.
WednesdayWalk the two SaaS columns and the governance band with whoever administers your suite and your identity platform.
ThursdayTest the ? cells. Install a known local runtime on a test machine and check that your tools see it. Publish a test agent and check that it shows up. Score each cell.
FridayTurn every Unknown and weak Partial into a gap with an owner and a date. Write the decisions for leadership. Set the date to score the map again.

Re-score on a schedule. Coverage drifts as fast as AI adoption does.

Download the map

The template and the worked example each come in three formats that hold the same map.

FileBlank templateNorthbridge example
Excel: dropdowns, live scores, tool register, gaps, decisionsai-visibility-map.xlsxai-visibility-map.xlsx
Markdown: fillable tables that render on GitHubai-visibility-map.mdai-visibility-map.md
HTML: a two-page printable map you can type intoai-visibility-map.htmlai-visibility-map.html

The HTML version keeps what you type in your own browser only, with export and import to a JSON file. It makes no network requests. The Markdown version is good for keeping the map in a repository next to your detection content, with its history in git.

Where this fits

Visibility comes before maturity. In the SANS AI Security Maturity Model, one of the steps out of Stage 1 is an inventory of the AI tools in use, and Stage 3 expects a complete AI asset inventory with owners. This map is how I get from the first to the second: it shows what the inventory is missing and which tool would close each gap.

Sources and credits