Control over AI
Blog
Compliance and AI 6 min read

Can one AI tool be both low and high risk?

Yes, and there is nothing contradictory about it. An AI tool's risk depends on what you use it for, which data goes in and which account it runs under. The AI Act looks at the purpose of an application, not the name of the tool.

Abstract translucent panels forming a skyline
Quick answer

Yes. An AI tool's risk does not sit in the tool itself but in three things that differ per situation: what you use it for, which data goes in and which account it runs under. A chatbot that drafts a job advert and the same chatbot ranking candidates are two different applications. The AI Act classifies applications by their intended purpose, not tools by their name: assessing candidates is listed in Annex III as high-risk, writing a text is not. So one tool often carries more than one decision, each with a status and a condition per use.

01

Risk attaches to use, data and account, not to the name of the tool

02

The AI Act classifies applications by intended purpose, so ChatGPT for a job advert and ChatGPT for assessing candidates fall into different categories

03

The GDPR question moves with the data that comes with each use

04

A free and a business account of the same tool are two separate assessments

05

One tool therefore often gets several decisions, each with a status and a condition

A privacy officer at a housing association gets two questions about the same tool in one week. Marketing wants to use ChatGPT to make job adverts read better. HR wants to use it to pre-sort the fifty applications for a vacancy, which saves a day of reading. Both teams expect the same answer, since it is the same tool.

The answer is different twice over, and that is not inconsistency. One AI tool can be low and high risk at the same time, because the risk does not attach to the tool but to the use, the data and the account. The AI Act does exactly the same: it classifies applications by their purpose, not tools by their name.

Why does the risk not attach to the tool?

An assessment of an AI tool has two halves. The first is about the vendor and the product: what happens to input, whether it is trained on, where processing takes place, whether a data processing agreement exists. That half is the same for every department. The second half is about the organisation: what the team will use the tool for and which personal data comes with that. That half differs per request, and it is the one most often skipped. How those dimensions relate is set out in how do you assess the risk of an AI tool.

Do only the first half and you end up with one verdict per tool. Do both and you end up with one verdict per use.

What changes with the purpose?

This is where the AI Act comes in, and the phrase that carries everything is "intended purpose". The regulation calls an AI system high-risk when the purpose it is intended for is listed in Annex III. Point 4 of that annex covers employment: filtering applications, evaluating candidates, deciding on promotion or dismissal, tracking performance. Drafting a job advert is not on it.

For the housing association that means marketing's request does not touch Annex III. HR's request does, with a nuance. A general chatbot is not intended by its provider as a selection system, so a recruiter who pastes individual CVs into it is not using a high-risk system in the sense of the law. If the organisation builds the model into the recruitment process and lets it decide who gets an interview, it has created a high-risk system itself and moves from deployer to provider. What that brings with it is in the EU AI Act for employers.

That nuance is not a free pass. Either way the recruiter is making a decision about people with a tool that was not assessed for it, and the GDPR and the organisation's own policy apply.

What changes with the data?

The GDPR asks the question from the other side: not what the system is, but which personal data is processed and on what basis. A job advert contains none. Fifty applications contain names, addresses, dates of birth, work histories and sometimes a line about health or family. What comes into play then, from lawful basis to human involvement, is in using AI safely in HR.

Same tool, two processing operations. For the second you want to know whether a data processing agreement exists, whether input is retained and whether it is trained on. Which brings in the account.

What changes with the account?

The recruiter uses ChatGPT through a free account that was already on her laptop. Marketing has a business licence through the department. That is not a detail: the free account runs under consumer terms, without a data processing agreement, and at most vendors with training on input as the default unless the user turns it off. The business account arranges all three differently. Why the line between account types weighs more than the line between brands is in free versus business AI accounts.

For classification under the AI Act the account makes no difference; the purpose decides. For the risk under the GDPR it is the difference between a processing operation you can account for and one you cannot. That is why free and business versions of the same tool sit as separate rows in a register.

What does that look like for one tool?

Put the three variables side by side and one tool splits into a few rows.

UseDataAccountAI ActGDPRDecision
Drafting a job advertNo personal dataBusiness licenceNot high-riskNo processing of personal dataAllowed
Summarising cover lettersCandidates' personal dataFree accountNot high-risk, but a decision about peopleProcessing without a data processing agreementNot allowed through this account
Ranking candidates as a fixed step in selectionPersonal data, possibly special categoriesBusiness licenceBecomes high-risk once built into the processHigh-risk processing, DPIA in scopeNo decision yet, assess first

The table answers the question in the title. The first row is low risk, the third is high, and it is the same tool. A register with a single row for ChatGPT has one of the three wrong.

How did it go on at the housing association?

The privacy officer gives marketing the go-ahead, with the business licence as the condition. HR gets a different answer: summarising applications is not allowed through the free account, and ranking candidates is first assessed as a separate application, with the question of who holds oversight and what the vendor has documented about how it works. Until then the status stays "no decision yet".

While working that out, an inventory shows that alongside Copilot, which was already allowed, Perplexity, ChatGPT and three specialised tools are in use, two of which are not yet in the register. That is not an incident. It shows that a one-off inventory falls behind quickly, and that the conversation about one tool usually starts with which tools there are at all.

BeeSensible links a catalogue of AI tools to the use observed in the organisation: only the domain, at most once a day per device, with no user id. Free and business versions of the same tool sit in it as separate rows, each with its own risk score and an EU AI Act indication. That score is advice about the tool; a catalogue cannot fill in the use and the data, which is why the organisation sets the status itself, with a condition under "limited use" that marks out the use. How that works is on the AI tools page.

Search tool, vendor or categoryโ€ฆ
865 tools
ChatGPT๐Ÿ‡บ๐Ÿ‡ธ
HighAllowed
Claude๐Ÿ‡บ๐Ÿ‡ธ
MediumAllowed
DeepSeek๐Ÿ‡จ๐Ÿ‡ณnew
CriticalNot allowed
Perplexity๐Ÿ‡บ๐Ÿ‡ธnew
MediumNo decision yet
Mistral๐Ÿ‡ซ๐Ÿ‡ท
LowNo decision yet
Midjourney๐Ÿ‡บ๐Ÿ‡ธ
MediumNo decision yet

Every tool, scored for risk

865 AI tools, each scored Low to Critical, with nothing pre-approved or pre-blocked until someone decides.

More about AI Tools

The decision is only finished when it reaches the recruiter at the moment she opens the tool. A condition in a circulated document is forgotten six months later; one that appears in the browser when the tool opens is not. The other pieces on this subject are under AI governance.

The next time someone asks whether a tool is allowed, the counter-question is not "which tool" but "for what, with which data, and through which account". Three answers, and usually more than one decision.

FAQ

Common questions

Is ChatGPT a high-risk system under the AI Act?

Not for writing, summarising and translating text. In the AI Act, high risk attaches to the intended purpose of an application, and those purposes are listed in Annex III: among them recruitment, selection, evaluating employees and access to education or credit. A general-purpose language model has no purpose that fits that list. It changes when an organisation builds such a model into a process that is on the list.

Why does the same tool score low in one department and high in another?

Because a risk assessment is partly about the tool and partly about the organisation. What the vendor does with input, where it processes and whether a data processing agreement exists are properties of the tool and the account. What the tool is used for and which personal data comes with that are properties of the use. Two departments share the first half and differ in the second.

Do you need a separate assessment per use?

Per use that differs in substance, yes. The part about the vendor only needs doing once. The part about the use, the data and the account is done per application. In practice that gives two or three rows per tool instead of one, each with its own status and, where needed, a condition.

How do you record that a tool is fine for one thing and not for another?

With the status limited use and a condition that marks out the use, for example: only through the business licence and not for assessing candidates. That condition belongs in the register and at the moment someone opens the tool. A decision that only lives in a document does not reach the recruiter who opens the tool on a Thursday afternoon.

Does the account type matter for classification under the AI Act?

Not for the classification: that attaches to the intended purpose, not to the subscription. For the risk under the GDPR it does. A free account runs under consumer terms, without a data processing agreement and often with training on input as the default. A business account arranges those three differently. That is why free and business versions of the same tool sit as separate rows in a register.

Portrait of Rens Timmermans of BeeSensible

Would you rather someone showed you?

Rens, BeeSensible

I am happy to give you a twenty-minute tour. Leave your details and I will find a moment that suits you. Calling or emailing works just as well.

Rather talk to someone first? Book a call.

Want a live demo, or a quote for 100+ users? Leave your details and we'll be in touch within one business day.