Control over AI
Blog
Compliance and AI 6 min read

How do you demonstrate AI literacy?

An attendance list says something about the day of the course. An auditor asks about the Monday after. Three kinds of evidence, what each does and does not show, and what you honestly call not substantiated.

Abstract skyline above hills
Quick answer

You demonstrate AI literacy with three kinds of evidence, each of which says something different. Training and attendance show that you explained to people what they need to know. Agreements and policy per role show what was decided and what is expected of whom. Behaviour at the moment of work, in aggregated figures, shows what happens afterwards: how often a notice was shown and what people did. The AI Act prescribes no certificate; your own records suffice. None of the three is enough on its own, and the third is usually missing. What you cannot substantiate, you call exactly that.

01

Three kinds of evidence: training and attendance, agreements per role, and behaviour at the moment of work in aggregated figures

02

An attendance list proves the day of the course, not the weeks after it

03

Figures on notices and highlights only count when they hang on a measure and a scope

04

Without a user id the figures say something about the organisation, never about a person

05

What you cannot substantiate goes in the overview as not substantiated

An HR manager at a care organisation put the whole organisation through an AI course in spring. Three hundred and forty staff, 96 percent attendance, the attendance lists neatly filed. In September she sits across from the auditor, who leafs through the folder and asks one question: how do you know it works in the work itself?

The answer consists of three kinds of evidence. Training and attendance show that you explained to people what they need to know. Agreements and policy per role show what was decided and what is expected of whom. Behaviour at the moment of work, in aggregated figures, shows what happens afterwards. None of the three is enough alone, and the third is usually missing.

What is the auditor actually asking?

Not "did you train", because that is in the folder. The question is whether the measure does what it is meant to do. Article 4 of the AI Act asks for measures towards a sufficient level of AI literacy among the people who use AI systems, matched to their role and context. What that involves is set out in AI literacy in 2026. The core for this piece: no certificate is prescribed, and the European Commission confirms in its questions and answers on Article 4 that your own record of the measures taken suffices.

Good news, but it only moves the question from "which document" to "what does this document actually prove". An auditor asks that of every document you put on the table.

Three kinds of evidence side by side

Kind of evidenceWhat it showsWhat it does not show
Training and attendance (attendance list, material, test)That people received an explanation on a given day of what is and is not allowedWhat they do afterwards, and whether the explanation fitted their role
Agreements and policy per role (register with statuses, instruction per system, who decided what)That the organisation thought it through and decided, and that decisions are traceableWhether those decisions reach the employee at the moment it matters
Behaviour at the moment of work (aggregated figures on notices and highlights)Whether the decision was visible when someone opened a tool, and what happened nextWhat happens outside the reach of the measurement, and why someone chose what they chose

The three complement each other because each describes a different moment. The first is about the day of the course. The second about the moment the organisation decided. The third about the ordinary working day, which is the moment Article 4 is ultimately about.

Why an attendance list is about the day of the course

A course makes people aware. What they do a month later, under time pressure, with a tool that did not exist on the day of the course, is a different question. Knowledge fades and habit wins, and that is not a reproach to the employee but a property of people. Why it works that way is covered in awareness training makes people aware, it does not change their behaviour.

For the evidence this means an attendance list says exactly one thing: on that day, this group heard this. That is valuable, because without that basis the rest helps less. But it is a statement about the day of the course. The auditor asks about the Monday after, and then the list is silent.

How do aggregated figures fit in?

The third kind of evidence is the least familiar and most often absent: figures that describe what happens when someone opens an AI tool and what happens when sensitive data is in a text. Not who, but how often, and with which outcome.

For a tool that has a decision, that decision appears in the browser. Every time such a notice is shown, it can be counted with what the person did: opened the approved alternative, or continued anyway. For sensitive data that got a highlight: masked, removed, or sent regardless. And the share of AI use that runs through approved tools has a trend.

Those figures carry no user id, so they describe the organisation and never a person, which is exactly why they belong here. The auditor does not want to know who continued, but whether the organisation's decision was present at the moment of work and how often people acted on it. That is the question the attendance list cannot answer.

Detections over timeLast 30 days
12,438+18% vs the previous period
Detections by platform
ChatGPT
ChatGPT
78% adjusted
8,124
Gmail
81% adjusted
3,210
Gemini
74% adjusted
812
Most encountered data types
Name
4,212
Email address
2,930
Credit card
1,486
Account number
1,104
Diagnosis
612
SensitiveHighly sensitive
BeeSensible dashboard: aggregated detections and top sources, without monitoring individuals.

Where the figures end, a boundary belongs. Notices appear in the browser, highlights in the supported apps. A conversation with a chatbot on a private phone falls outside it. Write that down, because a percentage without a scope does not survive the first question. What a number needs to become evidence is in a dashboard is not evidence.

BeeSensible counts notices and highlights with their outcome, without a user id, and the accountability view maps those figures onto measures per framework, today the GDPR and NIS2, with a status "Not substantiated" where the figures do not carry a measure. What was decided per tool sits in the register on the AI tools page.

What does this look like at the care organisation?

Back to the HR manager. She lays three things side by side. The attendance list from spring. The register: Copilot allowed, ChatGPT not allowed with Copilot as the alternative, a dictation tool on "no decision yet" since it was noticed in June. And the figures over the summer: how often the notice at ChatGPT was shown, how often the alternative was opened afterwards, and how often people continued.

What she sees is not a grade but a course of events. In June, people continue at ChatGPT more often than they open the alternative; in August that has reversed. The dictation tool still has no decision, with usage. That is not an incident. It is an open decision, and it is in her overview because the register showed it, not because someone reported it.

To the auditor she says: the course was given, here is what we agreed per role, and this is what happened in the browser afterwards. And on the dictation tool: not decided yet, it is open here.

What do you honestly call not substantiated?

Everything you do not measure and have not recorded. A few examples found in almost every organisation: AI use on private devices, a conversation outside the supported apps, a tool nobody recognised as AI, and the decision from 2024 that nobody remembers taking.

Put those rows in your overview, with their status. An accountability overview that is green everywhere tells an auditor the hard rows were left out, and the rest then counts for less. A row on "not substantiated" is not a weakness; it is the proof that you know where your measure ends. How to get from loose figures to such an overview is in what are all those AI metrics for, and the other pieces on this subject are under AI governance.

The next time someone asks whether the organisation is AI literate, you do not reach for the folder of attendance lists. You reach for three things: what we explained, what we decided, and what has happened since. Plus the row that is still open.

FAQ

Common questions

Do I need to show a certificate for AI literacy?

No. The AI Act names no certificate, and the European Commission states in its questions and answers on Article 4 that your own record of the measures taken suffices. A certificate is allowed, but it only proves that someone completed a course, not that it works in daily work.

Is an attendance list enough evidence?

It is part of the evidence. An attendance list shows who received an explanation on which day. It says nothing about what that person does three weeks later with a deadline. Combine it with the agreements per role and with figures on what happens at the moment of work.

May I track per employee whether someone follows the AI policy?

That is a different question from showing that the policy works, and it touches the GDPR and the rights of the works council. For accountability you do not need it: aggregated figures without a user id show whether the policy reaches the organisation, and that is what the auditor asks.

Which figures show that AI literacy works?

How often a notice about a tool was shown and what people did next: opened the alternative or continued anyway. How often sensitive data got a highlight and what the outcome was. And the share of AI use that runs through approved tools, with its trend. Always with the scope attached: the browser, the supported apps.

What if I cannot substantiate something?

Then you write that down. An overview that is green everywhere is one an auditor does not believe. AI use on a private phone, a conversation outside the supported apps, a decision nobody remembers taking: name it as not substantiated. That is not a shortcoming of your accountability, that is your accountability.

Portrait of Rens Timmermans of BeeSensible

Would you rather someone showed you?

Rens, BeeSensible

I am happy to give you a twenty-minute tour. Leave your details and I will find a moment that suits you. Calling or emailing works just as well.

Rather talk to someone first? Book a call.

Want a live demo, or a quote for 100+ users? Leave your details and we'll be in touch within one business day.