The Governing AI Playbook: A Practical Guide to AI Risk, Compliance and Control
AI-related attacks increased nearly 490% year over year. Read that again.
I have spent two decades in cybersecurity, and that number still caught me off guard. We are not talking about a slow drift upward. This is the edge of a cliff, and most organizations are still walking toward it while checking their phones.
Here is the problem in plain terms: only 8% of organizations globally have a comprehensive AI governance framework. Among small firms, that number drops to 2%. Meanwhile, 74% of companies plan to roll out agentic AI within the next two years. Most are building on a foundation that doesn’t yet exist.
That is what this playbook is about. Not theory. Not regulatory boilerplate. This is the practical, step-by-step governing AI playbook that tells you exactly what to put in place, in what order, and why it matters before something breaks in production and takes your company down with it.
Every section maps to a real control category, and every bullet point represents a decision someone must make. The frameworks supporting this include the NIST AI Risk Management Framework, the EU AI Act (high-risk obligations take effect August 2, 2026), and ISO/IEC 42001.
AI risk has just jumped from the 10th to the 2nd most significant business risk globally. The time to build your governing AI playbook is now.
1. Start With Ownership: Scope, Risk Classification and Accountability
- Assign a named business owner, technical owner, and security reviewer to every AI agent or system in your environment. If nobody owns it, nobody is accountable when it breaks.
- Document what the AI is allowed to do and, just as importantly, what it is not allowed to do. Scope creep turns small risks into large ones.
- Classify each AI system by risk level: informational, internal workflow, sensitive-data access, or production action-taking. The classification determines the depth of controls you need.
- Explicitly map high-impact actions: deletes, privilege changes, payments, external messages, customer-impacting changes, and production modifications. These are the actions that keep you up at night if they go wrong.
- Connect this to the EU AI Act’s four-tier risk framework (Unacceptable Risk, High Risk, Limited Risk, Minimal Risk) and the NIST AI RMF Govern function.
- Practitioner tip: treat the scope document as a living record, not a one-time artifact. Review it whenever the AI’s capabilities change.
2. Identity, Access and Privilege: Build the Fence Before You Open the Gate
- Give every AI agent its own dedicated identity. Sharing a human account with an AI system is a security risk waiting to happen. When that account is compromised, you will not know whether the human or the machine was responsible.
- Apply least-privilege permissions, scoped precisely to the systems, records, APIs, and repositories the agent actually needs. Nothing more.
- Use short-lived credentials wherever possible, and store them in an approved secrets manager. Hard-coded credentials in configuration files are not a governance strategy. They are a breach waiting to be found.
- Require step-up approval or a separate controlled workflow for any privileged action. Human sign-off should not be optional for high-impact operations.
- Schedule recurring access reviews and build in a formal retirement process so dormant agents do not become forgotten attack surfaces.
- Stat anchor: 97% of organizations breached in 2025 lacked proper AI access controls at the time of the incident.
- Reference the EU AI Act’s human oversight requirements and NIST AI RMF’s Manage function for framework alignment.
3. Data Protection: Know What Your AI Is Touching and Why
- Maintain a current, approved list of data sources the AI is permitted to access. Keep them separate from untrusted or public content that should never be in the same pipeline.
- Review exposure of sensitive data before indexing, embedding, retrieval, summarization, or sending to a model. The review happens upstream, not after the fact.
- Apply permission-filtered retrieval so users and agents receive only results they are authorized to see. Retrieval without permission filtering is data leakage by design.
- Address shadow AI directly: 35% of employees have entered proprietary company information into public AI tools. That is not a rogue employee problem. That is a gap in your AI policy and data governance.
- Map data flows across the entire AI pipeline so you can answer a simple question: exactly where does sensitive data go, and who or what can see it?
- Tie this to ISO/IEC 42001 data governance requirements and the EU AI Act’s technical documentation obligations for high-risk systems.
4. Prompt Injection and Untrusted Input Defenses: The Attack Vector Most Teams Miss
- Treat every untrusted input as potentially hostile. This is not paranoia. It is accurate. Prompt injection is now a documented and actively exploited attack vector against AI systems.
- Run prompt injection testing as part of your standard security testing cycle, not as a one-off exercise. Attackers iterate. Your defenses need to as well.
- Separate trusted internal instructions from external or user-supplied inputs at the architectural level. Do not let them share the same trust boundary.
- Log all inputs and model interactions so you have an audit trail when something looks wrong. Without logging, you are investigating blindfolded.
- Explain prompt injection to non-technical stakeholders: an attacker who cannot access your system directly can sometimes manipulate your AI into acting on their behalf by hiding instructions within content the AI reads and acts on.
- Refer to CISA’s AI secure-by-design guidance on input validation and to NIST AI RMF’s Map function for risk identification.
5. Tools, APIs and Automation Safety: Every Connection Is a Risk Surface
- Document every tool, API, and MCP server connected to your AI system. If you cannot list them all, you cannot secure them all.
- Log tool execution for every automated action the AI takes. This is your evidence trail for compliance, incident response, and debugging.
- Separate high-risk tools from standard ones and require additional controls or human approval before calling them. Not all tools carry equal risk.
- Review third-party integrations and vendor-supplied tools with the same scrutiny you apply to your own code. AI supply chain risk is real and growing.
- Set hard operational limits to prevent runaway or unintended behavior. An AI agent without rate limits and action caps can do significant damage in a short period of time.
- Practitioner note: the more tools you connect, the larger the blast radius when something goes wrong. Fewer connections with tighter controls beat many connections with loose ones.
6. Human Oversight and Operating Limits: AI Should Not Act Alone on Anything Critical
- Require explicit human approval for any AI action that is irreversible, financial, or customer-facing. Build the approval step into the workflow itself, not as an afterthought.
- Show users clear warnings when the AI is about to take a high-impact action. Informed consent is not just a regulatory concept. It is good product design.
- Configure operational limits: rate limits, action caps, time-based restrictions, and scope boundaries that prevent the AI from operating outside defined parameters.
- Map the human-in-the-loop requirement to the EU AI Act’s explicit human oversight mandate for high-risk AI systems and to NIST AI RMF’s Govern function.
- Stat anchor: 78% of enterprises are currently unprepared for their EU AI Act obligations, many of which center on exactly this requirement.
- Practitioner tip: design for the failure case. Ask what happens if the AI acts without approval, and then build controls that make that scenario physically impossible rather than merely policy-prohibited.
7. Testing, Monitoring and Incident Response: Governance Does Not Stop at Deployment
- Test AI systems against misuse cases, adversarial inputs, and known attack patterns before they reach production. Standard functional testing is insufficient.
- Run red team exercises that specifically target your AI systems. The AI threat model differs from that of traditional software, and testing must reflect that.
- Require formal production release approvals with documented sign-off from the business owner, technical owner, and security reviewer identified in Section 1.
- Implement logging and alerting that covers model inputs, outputs, tool calls, retrieved data, and actions taken. You cannot detect what you cannot see.
- Build an AI-specific incident response playbook before you need it. A general IR playbook will not account for how AI incidents unfold differently from traditional breaches.
- Maintain change control so that any modification to the AI system, its data sources, or its connected tools goes through a formal review.
- Reference the NIST AI RMF Measure and Manage functions and ISO/IEC 42001’s continual improvement requirements to meet ongoing governance obligations.
Conclusion
Here is the honest assessment: most organizations are moving faster on AI adoption than on AI governance. That gap is where breaches happen. That gap is where regulatory penalties land. That gap is where the board starts asking questions nobody wants to answer.
The good news is that a governing AI playbook does not have to be complicated. It has to be real. For anything that matters, you need real ownership, access controls, logging, and human oversight. The checklist exists. The frameworks exist. What most organizations lack is the decision to treat AI governance as a first-class operational priority, not a compliance task to handle later.
Later is now. The EU AI Act’s high-risk obligations take effect on August 2, 2026. Enforcement is coming. Organizations that built their governing AI playbook early will spend that time iterating on controls rather than scrambling to build them from scratch.
Start with one section. Assign an owner. Document what your AI is allowed to do and what it is not. Then work through the rest. The playbook is only useful if someone picks it up and runs with it.
Download the full checklist, share it with your security and AI teams, and book time this week to run through Section 1 together. That one meeting is worth more than any policy document that never gets implemented.
Discover more from Chad M. Barr
Subscribe to get the latest posts sent to your email.
