Control over AI
Blog
Compliance and AI 6 min read

How do you demonstrate AI literacy?

An attendance list covers the day of the course; an auditor asks about the Monday after. Three kinds of evidence for AI literacy and what each one shows.

Abstract skyline above hills
Quick answer

You demonstrate AI literacy with three kinds of evidence, each showing something different. Training and attendance show that you told people what they need to know. AI rules and policy for each role show what was decided and what is expected of whom. Behaviour during everyday work, in aggregated figures, shows what happens next: how often a notice was shown and what people did. The AI Act prescribes no certificate; your own records are enough. None of the three is sufficient on its own, and the third is usually missing. Anything you cannot substantiate, you label as exactly that.

01

Three kinds of evidence: training and attendance, AI rules for each role and aggregated figures on behaviour during everyday work

02

An attendance list covers the day of the course, not the weeks after it

03

Figures on notices and highlights only count when they are tied to a measure and a scope

04

Without a user ID the figures describe the organisation, never a person

05

Anything you cannot substantiate goes in the overview, listed as not substantiated

In spring an HR manager at a care organisation put the entire organisation through an AI course. Three hundred and forty staff, 96 per cent attendance, the attendance lists neatly filed. In September she sits opposite the auditor, who leafs through the folder and asks one question: how do you know it makes any difference to the day-to-day work?

The answer lies in three kinds of evidence. Training and attendance show that you told people what they need to know. AI rules and policy for each role show what was decided and what is expected of whom. Behaviour during everyday work, in aggregated figures, shows what happens next. None of the three is enough on its own, and the third is usually missing.

What is the auditor actually asking?

Not "did you train people?", because the answer is in the folder. The question is whether the measure does what it is meant to do. Article 4 of the AI Act asks for measures aimed at a sufficient level of AI literacy among the people who use AI systems, matched to their role and context. What that involves is set out in AI literacy in 2026. The key point for this piece: no certificate is prescribed, and the European Commission confirms in its questions and answers on Article 4 that your own record of the measures taken is enough.

That is good news, but it only shifts the question from "which document?" to "what does this document actually prove?" An auditor asks that of every document you put on the table.

Three kinds of evidence side by side

Kind of evidenceWhat it showsWhat it does not show
Training and attendance (attendance list, course materials, test)That on a given day people were told what is and is not allowedWhat they do afterwards, and whether the course suited their role
AI rules and policy for each role (register with statuses, instructions for each system, who decided what)That the organisation thought it through and made decisions, and that those decisions are traceableWhether those decisions reach the employee when it matters
Behaviour during everyday work (aggregated figures on notices and highlights)Whether the decision was visible when someone opened a tool, and what happened nextWhat happens beyond the reach of the measurement, and why someone made the choice they did

The three complement each other because each describes a different moment. The first covers the day of the course, the second the moment the organisation decided. The third covers the ordinary working day, which is what Article 4 is really about.

Why an attendance list only covers the day of the course

A course raises awareness. What people do a month later, under time pressure, with a tool that did not exist on the day of the course, is another matter. Knowledge fades and habit wins; that is no criticism of employees, just how people work. Why that is so is covered in our article on why awareness training does not change behaviour.

As evidence, then, an attendance list says exactly one thing: on that day, this group heard this. That has value: without that foundation, everything else achieves less. But it is a statement about the day of the course. The auditor asks about the Monday after, and on that the list is silent.

How do aggregated figures fit in?

The third kind of evidence is the least familiar and most often absent: figures that describe what happens when someone opens an AI tool and what happens when a text contains sensitive data. Not who, but how often and with what outcome.

When the organisation has made a decision about a tool, that decision appears in the browser. Every time such a notice is shown, it can be counted along with what the person did: opened the approved alternative or carried on anyway. For highlighted sensitive data, the outcome is counted too: masked, removed or sent regardless. And the share of AI use going through approved tools can be tracked over time.

Those figures carry no user ID, so they describe the organisation and never a person, which is exactly why they belong here. The auditor does not want to know who carried on, but whether the organisation's decision was there while people were working and how often they acted on it. That is the question the attendance list cannot answer.

Detections over timeLast 30 days
12,438+18% vs the previous period
Detections by platform
ChatGPT
ChatGPT
78% adjusted
8,124
Gmail
81% adjusted
3,210
Gemini
74% adjusted
812
Detected entity types
Name
4,212
Email address
2,930
Credit card number
1,486
Account number
1,104
Diagnosis
612
StandardCritical
The BeeSensible dashboard: detections in aggregate and where they occur most, without monitoring individuals.

Where the figures stop, you need to mark the boundary. Notices appear in the browser, highlights in the supported apps. A conversation with a chatbot on a personal phone falls outside that. Write it down, because a percentage without a scope will not survive the first question. What a number needs before it counts as evidence is covered in our article on why a dashboard is not evidence.

BeeSensible counts notices and highlights and their outcomes, without a user ID. The Accountability screen sets those figures against the provisions of the GDPR, NIS2 and the AI Act, and states for each provision what falls outside them. The decision on each tool is kept in the register, described on the AI tools page.

What does this look like at the care organisation?

Back to the HR manager. She puts three things side by side. The attendance list from spring. The register: Copilot allowed; ChatGPT not allowed, with Copilot as the alternative; a dictation tool marked "No decision yet" since it was spotted in June. And the figures for the summer: how often the notice on ChatGPT was shown, how often the alternative was opened afterwards and how often people carried on.

What she sees is not a score but a sequence of events. In June people carry on to ChatGPT more often than they open the alternative; by August that has reversed. The dictation tool still has no decision, yet it is being used. That is not an incident. It is an open decision, and it is in her overview because the register flagged it, not because someone reported it.

She tells the auditor: the course was given and here is what was decided for each role; this is what happened in the browser afterwards. And on the dictation tool: no decision yet, and it is listed here as open.

What should you honestly label as not substantiated?

Everything you do not measure and have not recorded. A few examples found in almost every organisation: AI use on personal devices, a conversation outside the supported apps, a tool nobody recognised as AI and the decision from 2024 that nobody remembers taking.

Put those rows in your overview, with their status. An accountability overview that is green across the board tells an auditor the difficult rows were left out, and then the rest counts for less. A row marked "not substantiated" is not a weakness; it proves you know where your measure stops. How to get from scattered figures to an overview like this is covered in our article on what all those AI metrics are for; there is more on the subject under AI governance.

The next time someone asks whether the organisation is AI literate, you do not reach for the folder of attendance lists. You reach for three things: what we explained, what we decided and what has happened since. Plus the row that is still open.

FAQ

Common questions

Do I need to show a certificate for AI literacy?

No. The AI Act does not mention a certificate, and the European Commission states in its questions and answers on Article 4 that your own record of the measures taken is enough. A certificate is allowed, but it only proves that someone completed a course, not that the course makes a difference in daily work.

Is an attendance list enough evidence?

It is part of the evidence. An attendance list shows who was briefed on which day. It says nothing about what that person does three weeks later with a deadline looming. Combine it with the AI rules for each role and with figures on what happens during everyday work.

Can I track whether each employee follows the AI policy?

That is a different question from showing that the policy works, and it raises GDPR issues and touches on the works council's rights. For accountability you do not need it: aggregated figures without a user ID show whether the policy reaches the organisation, and that is what the auditor is asking about.

Which figures show that AI literacy works?

How often a notice about a tool was shown and what people did next: opened the alternative or carried on anyway. How often sensitive data was highlighted and what the outcome was. And the share of AI use going through approved tools, with its trend. Always with the scope attached: the browser, the supported apps.

What if I cannot substantiate something?

Then you write that down. An auditor will not believe an overview that is green across the board. AI use on a personal phone, a conversation outside the supported apps, a decision nobody remembers taking: label each one as not substantiated. That is not a gap in your accountability; it is your accountability.

Portrait of Rens Timmermans from BeeSensible

Prefer someone to walk you through it?

Rens, BeeSensible

I'm happy to give you a twenty-minute tour. Leave your details and I'll find a time that suits you. You're also welcome to call or email.

Prefer to talk to someone first?

Want a live demo, or a quote for 100+ users? Leave your details and we'll be in touch within one working day.