Control over AI
Blog
AI governance 6 min read

What is an AI governance framework, and do you need one?

ISO/IEC 42001, the NIST AI RMF and the AI Act are all called frameworks, and all three are something different. For most organisations a small framework of four questions about the AI use that already exists is enough.

Abstract circle with an orbit of points
Quick answer

An AI governance framework is a fixed structure of roles, processes and controls for handling AI responsibly. The best known are ISO/IEC 42001 (a certifiable management system standard), the NIST AI RMF (voluntary, four functions) and the AI Act, which is not a framework but a law. All three are written for organisations that build or deliberately deploy AI systems. If you mainly use existing AI tools, four questions are usually enough: which tools are used, what was decided per tool, do people know it at work, and can we show it. A formal framework becomes necessary once you supply AI, deploy high-risk applications or a client wants certifiable evidence.

01

A framework does not say what you decide, but how you organise the deciding

02

ISO/IEC 42001 and the NIST AI RMF assume an inventory you already have; with everyday use that inventory is the work itself

03

The AI Act is a law with obligations per role and risk class, not a framework you choose

04

Four questions cover the governance of everyday use: which tools, which decision, do people know, can you show it

05

A formal framework belongs once you supply AI, deploy high-risk applications or need certifiable evidence

A board member at a healthcare provider gets a question from the accountant: which AI governance framework does the organisation use? She has a three-page AI policy, a list of allowed tools and a training that was given last year. Whether that counts as a framework, she does not know.

The answer: almost. An AI governance framework is a fixed structure of roles, processes and controls through which an organisation handles AI responsibly. It does not say what you decide; it arranges how you arrive at decisions and how you show they are followed. The well-known frameworks are written for organisations that build AI systems or deploy them deliberately. If you mainly use existing AI tools, a small framework of four questions is enough, with an owner per question. The board member is missing two of the four.

What do we mean by a framework?

Three things run together under that word. There are principles: transparency, fairness, human oversight. There are management systems: a cycle of planning, doing, checking and adjusting, with roles, documentation and an audit. And there is legislation, which you do not choose but which applies.

A framework in the sense the accountant means is the second. It answers questions such as: who owns an AI application, how do we assess the risk, when do we look again, and what do we keep as evidence. An AI policy is an outcome of such a structure, not the structure itself. How to write that policy is in writing an AI policy.

Which frameworks exist, and what are they about?

FrameworkWhat it isFor whomWhat it means for everyday AI use
ISO/IEC 42001Certifiable management system standard for AI, built like ISO 27001: context, leadership, risk assessment, controls, improvementOrganisations that develop or deploy AI and want to manage it demonstrablyRequires an inventory of AI systems, a risk assessment per system and recorded roles; says nothing about one specific tool
NIST AI RMFVoluntary framework from the US NIST with four functions: Govern, Map, Measure, ManageAnyone; there is no certificationA way of thinking. Map and Measure ask exactly the questions that count here: which AI is there, and what do we measure about it
AI ActLaw, not a framework; obligations per role (provider, deployer) and per risk classAnyone who offers AI systems in the EU or deploys themAI literacy (Article 4) and the prohibited practices since 2 February 2025; high-risk rules for applications such as recruitment and evaluation
Four questionsA small framework for the use of existing AI toolsOrganisations that build no modelsWhich tools, which decision, do people know, can you show it

If you already run an ISMS under ISO 27001, you do not need to start a second system for AI use; the existing controls for policy, suppliers and awareness cover a lot, as ISO 27001 and AI shows. What the AI Act concretely asks of an employer, with the dates after the omnibus, is in the EU AI Act for employers.

Why do these frameworks only half fit everyday use?

Because they start from an inventory you already have. ISO/IEC 42001 and the NIST AI RMF assume the organisation knows which AI systems it deploys, and then help with assessing and managing them. That holds for a triage model you had built yourself. It does not hold for the transcription tool a team lead started using last month.

With everyday use of AI tools the inventory is not the starting point but the work. Tools arrive from below, in a browser tab, without a project and without an owner. A framework that starts at "assess every AI system" skips the question that comes before it: which systems are those, actually. What that use is and why a ban does not make it disappear is in what is AI governance and on the AI governance topic page.

What the large frameworks do teach, and what a small framework should take from them: an owner per question, a moment of reassessment, and evidence that consists of more than a signature.

Which four questions are enough?

  1. Which AI tools are really used here? Not which were bought, but which are opened. This is the question the large frameworks skip, and the only one you cannot answer with a meeting.
  2. What have we decided per tool, and about which not yet? Four outcomes: allowed, limited use, no decision yet, not allowed. The third is a real status, not a gap. Which fields go with it is in an AI register: what you record in it.
  3. Do people know that at the moment they open a tool? A decision in a document sent round last year is not a decision that works. It has to be visible where the work happens, with the alternative next to it.
  4. Can we show that this is how it goes? With figures at organisation level: the share of use through allowed tools, the number of tools without a decision, what happened after a notice. Without people, because none of the four questions needs a name. Why a dashboard is not yet evidence of that is in a dashboard is not evidence.
Detections over timeLast 30 days
12,438+18% vs the previous period
Detections by platform
ChatGPT
ChatGPT
78% adjusted
8,124
Gmail
81% adjusted
3,210
Gemini
74% adjusted
812
Most encountered data types
Name
4,212
Email address
2,930
Credit card
1,486
Account number
1,104
Diagnosis
612
SensitiveHighly sensitive
BeeSensible dashboard: aggregated detections and top sources, without monitoring individuals.

Put a name next to each question and a moment at which you ask it again, and you have a framework. Who carries which question is in AI governance roles: who does what.

When do you need a formal framework?

In four situations, and then it is no longer a choice.

If you build or supply AI systems yourself, you are a provider under the AI Act, with obligations of your own around documentation and risk management. If you deploy AI for recruitment, evaluation or access to services, that application falls under the high-risk rules and you need a structured risk process, with the dates that apply to it. If a client, a tender or a regulator asks for certifiable evidence, ISO/IEC 42001 is the standard that exists for that. And if the organisation is so large that roles across departments have to be on paper, a management system is the way to do it.

Even then the four questions remain the bottom layer. A standard that requires an inventory of AI systems cannot make that inventory itself.

How did it go at the healthcare provider?

The board member starts not with the standard but with question one. Copilot is allowed. Next to it, ChatGPT, a transcription tool for team meetings and a translation tool for patient letters turn out to be in use. Two of those have no decision.

The organisation decides per tool. The transcription tool gets limited use, on the condition that no patient data is discussed in meetings that are recorded. Copilot is designated the preferred route for text work, and that decision appears as soon as someone opens another tool. Six months later the accountant has an answer: four questions, an owner per question, and figures that show how it is going. ISO/IEC 42001 is on the list for the moment the provider starts deploying a triage model of its own.

BeeSensible supplies the observation for the first, second and fourth question: which AI tools are opened, checked against a catalog of 865 assessed tools, with no user id and no page content; a decision per tool that the admin records in the AI Tools module; and aggregated figures with an honest "Not substantiated" status where the figures do not carry a measure. Whether the organisation thereby complies with a standard or a law remains its own assessment.

Ask the first question this week, and write down the answer before you open a standard. The rest of the framework follows from what is on that list.

FAQ

Common questions

What is the difference between an AI governance framework and an AI policy?

A policy says what is allowed and what is not. A framework arranges how that policy comes about, who maintains it, how risks are assessed and how you show that it works. A policy fits on one page; a framework is the structure around it. Many organisations have the first and assume that gives them the second.

Is ISO/IEC 42001 mandatory?

No. It is a voluntary standard an organisation can be certified against, comparable to ISO 27001 for information security. A client or a tender can ask for it, and then it becomes a requirement in practice. For the everyday use of chat and writing tools, certification is rarely the first step.

Is the AI Act a framework?

No, it is a law. It imposes obligations per role (provider or deployer) and per risk class of the application. For most employers that has meant, since 2 February 2025, measures for AI literacy and the prohibited practices, and for certain applications such as recruitment the high-risk rules. A framework can help organise those obligations, but does not replace them.

Does an organisation of two hundred people need a framework?

A small one, yes. Four questions with an owner per question is already a framework: which AI tools are used, what was decided per tool, do staff know that at the moment they open a tool, and can you show it. A certifiable management system only becomes necessary once you supply AI yourself or a client asks for it.

Does BeeSensible help comply with ISO/IEC 42001 or the AI Act?

BeeSensible supplies observations and figures: which AI tools are opened, which decision was recorded about them, and how often a notice led to the alternative, all without a user id. That is material for an inventory and for substantiation. Whether an organisation complies with a standard or a law is the organisation's own assessment, with a lawyer or auditor where needed.

Portrait of Rens Timmermans of BeeSensible

Would you rather someone showed you?

Rens, BeeSensible

I am happy to give you a twenty-minute tour. Leave your details and I will find a moment that suits you. Calling or emailing works just as well.

Rather talk to someone first? Book a call.

Want a live demo, or a quote for 100+ users? Leave your details and we'll be in touch within one business day.