No. Employees should not be free to paste company data into whatever generative AI tool they find, but a flat ban is not a policy — it is a wish. The workable answer is a tiered one: define what counts as sensitive, decide which tools are approved for which tiers, and make the safe path easier to use than the risky one.
Why this is an operational problem, not just a policy one
Most "AI leaks" are not malicious. They are an engineer pasting a stack trace with a customer's email into a free chatbot to debug faster, or a support agent summarising a ticket that contains a patient's medical history. The tool did exactly what it was built to do. The failure is that nobody had told that employee, in a way that fit their workflow, what was off-limits and what alternative existed. If the only guidance is a PDF acceptable-use policy nobody reads, the policy will lose to the deadline every time.
A framework for deciding what is allowed
- Classify your data, not your tools. Build (or reuse) a simple three- or four-tier classification: public, internal, confidential, restricted (regulated/sensitive personal data, trade secrets, credentials). This should already exist if you have done a data inventory; if not, the data inventory and RoPA starter kit is a fast way to get one down on paper.
- Classify your tools by data handling terms, not by brand reputation. For each AI tool in use or requested, check: is there an enterprise/business agreement with no training on your inputs by default, is there a data processing agreement, where is data stored and for how long, and can logging/human review be turned off or restricted. Consumer-tier "free" accounts of the same product frequently have different (worse) terms than the paid enterprise tier of the exact same tool — this is the detail employees miss.
- Map tiers to permissions. A workable default: public and internal data can go into any approved enterprise tool; confidential data only into tools with a signed DPA and training disabled; restricted data goes nowhere near a general-purpose AI tool without a specific, reviewed use case (e.g., a retrieval system with access controls, not a chat box).
- Pick and publish the approved list. Employees should be able to answer "what can I use for this" in ten seconds. A one-page matrix (tool, tier allowed, link to request access) beats a long policy.
- Turn on the technical controls that back the policy. Enterprise settings to check on day one: disable training on inputs, set retention to the shortest useful period, restrict plugin/connector access, and enable admin-level logging of prompts and outputs for review — not to police individuals, but to catch systemic misuse patterns.
- Review logs and exceptions on a schedule, not just after an incident. Even a monthly spot-check of prompt logs for an approved tool will surface classification gaps you did not know about.
Enterprise vs consumer tooling: the distinction that gets missed
The single most common mistake in this area is treating "ChatGPT" or "Claude" or any other brand name as one thing with one risk level. In practice, the same underlying model is typically available through at least three different commercial arrangements, each with different data handling terms:
- Free consumer tier — often trains on inputs by default, retains data for unspecified periods, and has no contractual data processing agreement with your organisation at all, because there is no organisation-level relationship.
- Paid consumer/individual subscription — sometimes offers an opt-out of training, but the opt-out is usually a personal account setting, not something your IT team can enforce or audit centrally.
- Enterprise/business tier — typically includes a data processing agreement, training disabled by default or by contract, configurable retention, admin-level visibility into usage, and single sign-on so accounts can be deprovisioned when someone leaves.
Only the third category should be considered for anything above your "internal" data tier, and even then, retention and logging settings need to be checked and set deliberately rather than left on defaults.
Data classes worth naming explicitly
When you write the acceptable-use matrix, be specific about categories rather than relying on people's judgment of "sensitive":
- Customer personal data (names, contact details, account identifiers)
- Regulated categories (health, financial account numbers, government ID numbers, biometric data)
- Employee personal data (HR records, performance reviews, compensation)
- Credentials and secrets (API keys, passwords, access tokens)
- Trade secrets and unreleased product or financial information
- Anything under an NDA with a third party
Each of these should map to an explicit tier, because "use good judgment" is not a control that survives a busy Tuesday.
Logging and review, done proportionately
Turning on prompt logging is not the same as reading every prompt. A workable pattern for a small or mid-sized organisation: log at the admin level for all approved tools, run a lightweight periodic review (monthly) for patterns rather than individual policing — repeated attempts to use an unapproved tool, spikes in usage of a particular data type, or evidence that restricted data categories are being pasted into general-purpose tools. Treat findings as a training and access-provisioning signal first, and a disciplinary one only when the pattern shows disregard for a policy the person clearly knew about.
A realistic example
A 120-person fintech company had approved an enterprise plan of a major AI assistant for engineering and support, with training disabled and a 30-day retention limit. A marketing contractor, unaware the enterprise plan existed, used her personal free-tier account of the same underlying model to draft customer win-back emails using a CSV export of churned customers' names, emails and account values. Nothing malicious happened, but that data was now subject to the free tier's consumer terms, which permitted use for model improvement. The fix was not more policy — it was giving contractors provisioned enterprise accounts on day one and blocking the consumer domain at the network/browser-extension level for anyone handling customer data.
Common failure modes
- Treating "we have a policy" as equivalent to "we have a control." A policy nobody has read, or that contradicts what is fastest, will not change behaviour.
- Confusing consumer and enterprise tiers of the same product. They frequently have different training and retention defaults; the brand name is not the thing that matters.
- No approved alternative. Banning tools without provisioning a sanctioned one guarantees shadow use.
- Ignoring browser extensions and plugins that quietly pipe clipboard or document content to third-party AI services.
- Assuming redaction happens by magic. If a tool is approved for internal but not confidential data, someone still has to notice the confidential column before pasting.
Do this next
- Publish a one-page "what data, which tool" matrix and put it where people actually work (chat pinned message, not a wiki page nobody opens).
- Turn off training-on-inputs and tighten retention on every enterprise AI tool already in use.
- Provision enterprise accounts for anyone whose job requires using AI with company data, so there is no reason to reach for a personal account.
- Add AI tool use to new-hire and contractor onboarding, not just an annual training module.
- Run the AI privacy risk checklist against every tool currently in use, approved or not.
- If you want the fuller picture — vendor assessment, logging design, retrieval-system access controls — the AI privacy and data readiness course walks through it end to end, and the assessment can show you where your organisation's biggest gaps currently sit.
Official sources and further reading
- GDPR full text — relevant if any personal data reaches an AI tool; processing via a third-party AI vendor makes that vendor a processor, which brings Article 28 processor-contract requirements into play.
- California CPPA FAQ and CPPA regulations — relevant for organisations subject to the CCPA/CPRA, which has specific rules developing around automated decision-making technology.
This article is educational and does not constitute legal advice; whether a specific tool's terms satisfy your regulatory obligations depends on your contracts and jurisdiction, so have counsel review vendor agreements before rolling out access broadly.
Privacy Practice Lab publishes educational and technical guidance. Nothing on this site constitutes legal advice, and it should not be relied on as a legal determination for your organisation.