Industry Solutions Banking & Finance Healthcare Manufacturing Legal Government & Defense How It Works Cost Savings Knowledge Blog About Request Demo
5 min read

How to Detect Shadow AI Before an Auditor Does

Most organizations suspect unsanctioned AI is in the building. Very few have actually gone looking. Here's where it hides and how to find it.

A flashlight beam revealing hidden AI chat windows across a dark office network diagram
The tools are already in use. The question is whether you find them before an incident or an examiner does.

Here's an uncomfortable number. Among organizations that actually have an AI governance policy, only 34% regularly audit for unsanctioned AI, according to IBM's 2025 Cost of a Data Breach Report. That's the subset with a policy. Everyone else isn't looking at all.

So most shadow AI gets discovered one of three ways: by accident, by incident, or by an auditor. All three are worse than finding it yourself. This post is about the fourth way, going and looking. If you want the full risk picture first, the numbers live in our companion piece on the shadow AI compliance gap. If you already know what's out there and want to stop it recurring, that's the prevention playbook. This one falls between them.

Where shadow AI actually hides

The mental image is an employee with ChatGPT open in a browser tab. That's real, but it's only the most visible layer. Personal AI accounts on work machines are the obvious case. Less obvious: browser extensions with AI features that read page content, including whatever internal system is on screen. AI features quietly switched on inside SaaS tools you already approved for something else. A department running its own pilot with a tool nobody submitted for review. A developer calling a public model's API from a script that never went through procurement.

Each of these moves data, and none of them show up if your only detection method is asking IT what's installed.

Five signals that reveal it

A first pass you can run in 30 days

You don't need a program to start. Pull 30 days of DNS or proxy logs and count AI domains by department. While that runs, have finance search a year of expense lines for AI vendors. Send the amnesty survey in the same window. Then put the three lists side by side. The overlap is your confirmed inventory. The gaps between them are just as useful: tools in the logs that nobody admitted to tell you where trust is thin, and tools in the survey that don't appear in logs tell you people are using personal devices for work data, which is its own finding.

Write down what you found, including the data classes likely involved. In a regulated environment that record matters. An organization that found shadow AI, documented it, and acted on it looks very different to an examiner than one that never looked.

What to do with what you find

Resist the urge to fire off a warning memo. The inventory you just built is a map of unmet demand: every unsanctioned tool is a task someone needed help with, sorted by department and frequency. That's exactly the information you need to stand up a sanctioned alternative people will actually use, which is the only fix that has evidence behind it. For regulated organizations, that usually means a private AI environment where the data never leaves your network and every query is logged, so the next audit finds a system you can answer for instead of a browser history you can't.

Run the pass again in a quarter. The tool landscape shifts fast, and the inventory is how you find out what your people are already telling you with their workarounds. Look first. Then build.

Go deeper

The full data picture is in Your People Are Already Using AI. Your Compliance Program Can't See It. For closing the gap after you've found it, see How to Prevent Shadow AI at Work and the AI governance tools buyer's guide.

Replace the shadow tools with one you can audit

Book a short demo and see a private AI assistant working on your own documents, with logging, citations, and nothing leaving your network.

Request a Demo
Keith Kennedy

Keith Kennedy, CISSP

Founder & CEO, Cognetryx

Keith is an IT thought leader with nearly 20 years of experience architecting secure technology solutions for regulated industries. He holds a CISSP certification and advises institutions on secure AI architecture, access control, and keeping sensitive data inside the network. About Keith

Finding shadow AI before an auditor does

It goes well beyond an employee with a chatbot open in a browser tab. The less obvious spots are personal AI accounts on work machines, browser extensions with AI features that read whatever page is on screen, AI features quietly switched on inside SaaS tools you already approved, a department running its own unreviewed pilot, and a developer calling a public model's API from a script that never went through procurement. None of these show up if your only detection method is asking IT what's installed.

Five signals surface it. Network and DNS logs give a rough census of which AI tools are in use and how often. DLP and large paste or upload events show when someone moved real content into a chatbot. Expense and procurement records catch AI subscriptions bought on personal or department cards. Browser extension inventories flag anything with AI summarizing, writing, or page-reading capability. And an amnesty survey surfaces the human layer that no log file will.

You don't need a program to start. Pull 30 days of DNS or proxy logs and count AI domains by department, have finance search a year of expense lines for AI vendors, and send an amnesty survey in the same window. Put the three lists side by side: the overlap is your confirmed inventory, and the gaps tell you where trust is thin or where people are using personal devices for work data. Write down what you found, including the data classes likely involved, because that record matters in a regulated environment.