Control over AI
Blog
AI governance 8 min read

Which data do you really need to measure AI use?

A proxy log holds every URL, user and timestamp. To know which AI tools are in use you need four fields from it, and the user is not one of them.

Abstract spiral with data points in teal
Quick answer

To measure AI use you need four pieces of data: the domain of the service, the day it was opened, a count and a category (what AI is used for, or how often). Together they tell you which tools are in use, whether a decision has been taken on them and whether use is moving towards allowed tools. What you do not need: a user ID, the content of the prompt, the path after the domain or the exact time to the second. None of those adds anything to the governance question, and together they turn a count into a record of individuals. Data minimisation does not limit the measurement here; it is how the measurement is designed.

01

Domain, day, count and category answer the governance question in full

02

A user ID tells you nothing more about which tools are in use

03

The path after the domain and the content of the prompt have no place in a measurement

04

A timestamp to the second makes individuals in a small group identifiable

05

What you do not record, you do not have to secure, retain or account for

The board of an engineering firm asks its IT admin how much AI is being used in the company. He has the proxy logs: every URL, every user, every timestamp, going back a year. He can answer the question. He just has to do it with a file that reveals far more than anyone asked for.

The question needs four fields: the domain of the service, the day, a count and a category. The user is not among them. Everything else in the proxy log is more than surplus: it changes the nature of the measurement.

Which question are you actually answering?

Before choosing the data, pin down the question. In practice there are three. Which AI services are being opened across the organisation? Has a decision been taken on them? And is use moving towards the tools we have designated, or away from them?

All three are about services and about the organisation as a whole. None of them mentions a person. That is no accident of wording; it is why measuring and tracking are two different things, as AI monitoring versus employee monitoring explains. Which of the resulting figures deserve a board's attention is covered in measuring AI adoption.

There is one question that does involve a person: who did this, in a specific incident? That is an investigation, with its own procedure and its own legal basis. Keep it out of the measurement, or from then on the measurement carries all the requirements of an investigation.

What does data minimisation mean for a measurement?

Article 5(1)(c) of the GDPR requires personal data to be adequate, relevant and limited to what is necessary for the purpose. It is usually read as a brake: collect less. For a measurement it works better the other way round. Start from the purpose, work out which fields it needs and record only those.

There is a welcome side effect. A measurement that contains only domain, day, count and category says nothing about a person. You do not have to secure it like a personnel file, keep it only briefly or justify it as a record of behaviour. What you do not record cannot leak, and nobody can ask to see it.

What do you need, and what can you leave out?

Data itemNeeded?Why
Registrable domain of the serviceYesIdentifies the tool and links the observation to a decision in the register
Day of the observationYesLets you see a trend: this week, last month, since a decision
CountYesShows how widely a tool is used and whether that is growing
Category: use case or frequency bucketYes, as a countShows where AI fits into the work and whether it is experimentation or routine
Status of the tool in the registerYesComes from the decision, not the measurement; together they give the share of use through allowed tools
User ID or email addressNoAdds nothing to the three questions and turns a count into a behavioural record
Content of the promptNoSays something about the person and the client, nothing about the tool
Path after the domainNoOften contains a conversation ID or part of the question
Time to the secondNoA day is enough for the trend; seconds make people in a small group identifiable
DepartmentOnly above a minimum sizeUseful for targeted support, but a department of three might as well be a name

The right-hand column is what matters. For every field you add, you should be able to say which of the three governance questions it helps answer. If the answer is none, drop the field.

Why is the path worse than it looks?

The domain chatgpt.com tells you someone opened ChatGPT. In many AI tools the full address also contains a conversation ID, and in search-style tools sometimes the question itself. Log "just the URL" and you are logging which conversation someone had, and occasionally what it was about.

That is the difference between a count and a file on someone, packed into one harmless-looking field. The registrable domain is enough to know whether a service is used. The rest of the address is about the person.

What does this look like in practice?

The engineering firm settles on the four fields. After a month the picture is this: Copilot is the most frequently opened tool, but not the only one. ChatGPT and Perplexity show up every day, and three specialised tools appear that nobody knew about: one that summarises drawings, a translation tool and a meeting transcription tool. Two of them have no decision yet, simply because they were never on anyone's list.

Nobody needs to know who opened them. The drawings tool handles client drawings, so a decision will follow. So will one for the transcription tool, which processes voices and names. The rest can wait. In three months' time the admin will check whether use has shifted towards the designated tools. None of it needs a single name in the file.

It also shows why a one-off inventory soon goes out of date: none of the three unknown tools was in a questionnaire, because nobody knew to ask about them.

How does this fit the way BeeSensible is built?

The extension notices when someone opens an AI tool and reports only the registrable domain, at most once a day per device, with no user ID, no path and no page content. How often someone uses AI (daily, weekly, occasionally) is worked out on the device itself and reported once a month as an anonymous count per category. To show what AI is used for, cloud mode classifies only the first prompt of a conversation into one of seven categories; the text is then discarded and only the category is counted.

In the dashboard this appears as figures about the organisation: which tools, how many, what share goes through allowed tools and what happened after a notice. There is no breakdown per employee anywhere.

Detections over timeLast 30 days
12,438+18% vs the previous period
Detections by platform
ChatGPT
ChatGPT
78% adjusted
8,124
Gmail
81% adjusted
3,210
Gemini
74% adjusted
812
Detected entity types
Name
4,212
Email address
2,930
Credit card number
1,486
Account number
1,104
Diagnosis
612
StandardCritical
The BeeSensible dashboard: detections in aggregate and where they occur most, without monitoring individuals.

Department insights are off by default. Once they are switched on, a department appears only when it has at least five people and seven days of data; smaller departments are grouped under "Other". That is the minimum size from the table, built into the product rather than left to policy. The full reasoning, including what aggregated figures can and cannot promise, is in AI governance without monitoring employees and on the topic page for AI governance. You can see what the register of tools and decisions looks like on the AI tools page.

What should you ask a vendor, or check in your own log?

Go through the table and ask the same question for each field: is this recorded, and if so, why? Three answers deserve particular attention. A user ID "for de-duplication" can usually be handled on the device. A full URL "for convenience" is the path problem described above. And an export "for support" is where a count can end up identifying individuals after all.

The same questions apply to your own proxy log. It probably holds everything in the table, including every field marked "No". That is no reason to get rid of it. It is a reason not to use it as your measurement of AI use, and to set up that measurement separately with the four fields it needs.

For your next measurement, take the table and cross out everything that answers none of the three questions. What remains is enough for the board, and it is the first thing you show the works council.

FAQ

Common questions

Can you measure AI use without a user ID?

Yes. The questions an organisation wants answered are about tools and about the organisation: which services are opened, how often and what share of that use goes through allowed tools. None of them needs a name. A user ID only adds the ability to speak to someone about their use, and that is a different question with a different legal basis.

Why is the path after the domain a problem?

Because in many AI tools the path contains a conversation ID, and sometimes part of the question itself. Record the full address and you record which conversation someone had, which can be linked back to them later. The registrable domain is enough to know whether a service is used: chatgpt.com tells you what you need to know, and the rest tells you about the person.

Isn't a daily count too coarse?

Not for the governance question. Whether a service was opened on a given day, on how many devices and how that changes from week to week is exactly what you need to take a decision and to see whether it is having an effect. A timestamp to the second adds nothing to that, but in a small team it does make one person identifiable.

What is the difference between a count and a behavioural record?

A count says that something happened and how often: this domain, this day, this many times. A behavioural record says who did it. Technically the difference is one field in a database. Legally it is the difference between figures about the organisation and processing employees' personal data, with everything that entails: a legal basis, transparency and the involvement of the works council.

How does BeeSensible record this?

The extension reports only the registrable domain of an AI tool, at most once a day per device, with no user ID, no path and no page content. How often someone uses AI is worked out on the device itself and reported as an anonymous count per category. Nowhere in the dashboard is there a breakdown per employee.

Portrait of Rens Timmermans from BeeSensible

Prefer someone to walk you through it?

Rens, BeeSensible

I'm happy to give you a twenty-minute tour. Leave your details and I'll find a time that suits you. You're also welcome to call or email.

Prefer to talk to someone first?

Want a live demo, or a quote for 100+ users? Leave your details and we'll be in touch within one working day.