Control over AI
Blog
AI governance 8 min read

Which data do you really need to measure AI use?

A proxy log holds every URL, every user and every timestamp. To answer which AI tools are in use, you need four fields from it, and the user is not one of them. Data minimisation applied to measurement.

Abstract spiral with data points in teal
Quick answer

To measure AI use you need four pieces of data: the domain of the service, the day it was opened, a count, and a category (what AI is used for, or how often). That answers which tools are in use, whether a decision has been taken on them, and whether use is moving towards allowed tools. What you do not need: a user id, the content of the prompt, the path after the domain, and the time to the second. Those four add nothing to the governance question and turn a count into a record of people. Data minimisation here is not a limit on the measurement; it is the design of it.

01

Domain, day, count and category answer the governance question in full

02

A user id adds nothing to the question of which tools are in use

03

The path after the domain and the content of the prompt do not belong in a measurement

04

A timestamp to the second makes a count in a small group traceable

05

What you do not record, you do not have to secure, retain or account for

An IT admin at an engineering firm is asked by the board how much AI is being used in the company. He has the proxy logs: every URL, every user, every timestamp, going back a year. He can answer the question. He just has to do it with a file that says far more than anyone asked.

The question needs four fields: the domain of the service, the day, a count, and a category. The user is not among them. Everything else in the proxy log is not merely surplus; it changes what kind of measurement this is.

Which question are you actually answering?

Before choosing data, it helps to state the question precisely. In practice there are three. Which AI services are opened in the organisation? Has a decision been taken on them? And is use moving towards the tools we have designated, or away from them?

All three are about services and about the organisation as a whole. None of them mentions a person. That is not a lucky turn of phrase; it is the reason measuring and tracking are two different things, as AI monitoring versus employee monitoring sets out. Which of the resulting figures are worth a board's time is covered in measuring AI adoption.

There is one question that does need a person: who did this, in a specific incident. That is an investigation, with its own procedure and its own legal basis. Keep it out of the measurement, or the measurement carries the requirements of the investigation from then on.

What does data minimisation mean for a measurement?

Article 5(1)(c) of the GDPR requires personal data to be adequate, relevant and limited to what is necessary for the purpose. It is usually read as a brake: collect less. For a measurement it works better the other way round. Start from the purpose, work out which fields that purpose needs, and record only those.

Something pleasant follows. A measurement that contains only domain, day, count and category says nothing about a person. You do not have to secure it like a personnel file, keep it short, or justify it as a record of behaviour. What you do not record cannot leak and cannot be requested.

Which data do you need, and which do you not?

Data itemNeeded?Why
Registrable domain of the serviceYesSays which tool it is, and links the observation to a decision in the register
Day of the observationYesMakes a trend possible: this week, last month, after a decision
CountYesHow widely a tool is used, and whether that is growing
Category: use case or frequency bucketYes, as a countSays where AI sits in the work and whether it is trial or routine
Status of the tool in the registerYesComes from the decision, not the measurement; together they give the share through allowed tools
User id or email addressNoAdds nothing to the three questions, turns a count into a behavioural record
Content of the promptNoSays something about the person and the client, nothing about the tool
Path after the domainNoOften contains a conversation id or part of the question
Time to the secondNoA day is enough for the trend; seconds make a small group traceable
DepartmentOnly with a floorUseful for targeted help, but a department of three is a person

The right-hand column is the point. Every field you add should come with an answer to which of the three governance questions it improves. If the answer is none, the field goes.

Why is the path worse than it looks?

The domain chatgpt.com says someone opened ChatGPT. The full address behind it contains, in many AI tools, a conversation id, and in search-style tools sometimes the question itself. Whoever logs "just the URL" logs which conversation someone had, and occasionally what it was about.

That is the difference between a count and a file, packed into one field that looks harmless. The registrable domain is enough to know whether a service is used. The rest of the address is about the person.

What does this look like in practice?

The engineering firm settles on the four fields. After a month the picture looks like this: Copilot is the most opened tool, but not the only one. ChatGPT and Perplexity show up daily, and three specialised tools appear that nobody knew about: one that summarises drawings, a translation tool and a meeting transcription tool. Two of them have no decision yet, simply because they were never on any list.

Nobody needs to know who opened them. The drawings tool processes client drawings, so a decision is coming. The transcription tool processes voices and names, so there too. The rest can wait. In three months the admin checks whether use has shifted towards the designated tools. All of it without a single name in the file.

It also shows why a one-off inventory falls behind quickly: the three unknown tools were in no questionnaire, because nobody knew to ask about them.

How does this fit the way BeeSensible is built?

The extension notices when someone opens an AI tool and reports only the registrable domain, at most once a day per device, with no user id, no path and no page content. How often someone uses AI (daily, weekly, occasionally) is determined on the device itself and reported once a month as an anonymous count per category. For what AI is used for, in cloud mode only the first prompt of a conversation is classified into one of seven categories, after which the text is discarded and only the category counts.

In the dashboard that reads as figures about the organisation: which tools, how many, what share through allowed tools, and what happened after a notice. Nowhere a breakdown per employee.

Detections over timeLast 30 days
12,438+18% vs the previous period
Detections by platform
ChatGPT
ChatGPT
78% adjusted
8,124
Gmail
81% adjusted
3,210
Gemini
74% adjusted
812
Most encountered data types
Name
4,212
Email address
2,930
Credit card
1,486
Account number
1,104
Diagnosis
612
SensitiveHighly sensitive
BeeSensible dashboard: aggregated detections and top sources, without monitoring individuals.

Insight per department is off by default. Whoever switches it on sees a department only from five people and seven days; smaller departments fold into "Other". That is the floor from the table, built in rather than agreed. The full reasoning, including what aggregated figures can and cannot promise, is in AI governance without monitoring employees and on the topic page for AI governance. What the register of tools and decisions looks like is on the AI tools page.

What do you ask a vendor, or your own log?

Walk through the table and ask the same question per field: is this recorded, and if so, what for? Watch for three answers in particular. A user id "for de-duplication" can usually be handled on the device. A full URL "for convenience" is the path from the paragraph above. And an export "for support" is where a count becomes readable per person after all.

The same questions apply to your own proxy log. It probably holds everything in the table, including the right-hand column. That is no reason to get rid of it; it is a reason not to turn it into a measurement of AI use, and to set that measurement up separately with the four fields it needs.

For your next measurement, take the table and cross out everything that answers none of the three questions. What remains is enough for the board, and it is the first thing you show the works council.

FAQ

Common questions

Can you measure AI use without a user id?

Yes. The questions an organisation wants answered are about tools and about the organisation: which services are opened, how often, and what share of that runs through allowed tools. None of those questions needs a person. A user id only adds the ability to speak to someone about it, and that is a different question with a different legal basis.

Why is the path after the domain a problem?

Because with many AI tools the path contains a conversation id, and sometimes part of the question itself. Whoever records the full address records which conversation someone had and can link it later. To know whether the service is used, the registrable domain is enough: chatgpt.com tells you what you want to know, the rest tells you something about the person.

Is a count per day not too coarse?

Not for the governance question. Whether a service was opened on a day, on how many devices, and how that shifts week by week is exactly the picture you need to decide and to see whether a decision lands. A timestamp to the second adds nothing to that, and it does make a count in a small team traceable to one person.

What is the difference between a count and a behavioural record?

A count says that something happened and how often: this domain, this day, this many times. A behavioural record says who did it. Technically the difference is one field in a database; legally it is the difference between organisational figures and a processing of personal data about employees, with everything that brings in legal basis, transparency and works council involvement.

How does BeeSensible record this?

The extension reports only the registrable domain of an AI tool, at most once a day per device, with no user id, no path and no page content. How often someone uses AI is determined on the device itself and reported as an anonymous count per category. Nowhere in the dashboard is there a breakdown per employee.

Portrait of Rens Timmermans of BeeSensible

Would you rather someone showed you?

Rens, BeeSensible

I am happy to give you a twenty-minute tour. Leave your details and I will find a moment that suits you. Calling or emailing works just as well.

Rather talk to someone first? Book a call.

Want a live demo, or a quote for 100+ users? Leave your details and we'll be in touch within one business day.