Skip to content

Resource

What Healthcare Practices Need to Know About AI Tools and Client Confidentiality

Clinical staff are already using AI to save time on documentation, whether or not the practice approved it. The question isn't whether AI is in your environment. It's whether it's touching PHI in ways that violate HIPAA and expose the practice to real fines and, in the worst cases, real prison time.

Dawn SizerDawn Sizer · CEO and Co-Founder, 3rd Element Consulting ·

The real pattern: personal AI, not sanctioned tools.

Most AI exposure in healthcare doesn't start with an approved enterprise tool. It starts with an individual provider or staff member pasting a patient note into a free AI tool to draft a summary faster, or using a personal AI scribing app that wasn't reviewed by anyone. It's not malicious. It's someone trying to get through their day. But the moment PHI is typed into a consumer AI tool with no Business Associate Agreement, the practice has almost certainly violated HIPAA, whether or not anyone intended to.

Industry guidance on AI use and patient confidentiality in healthcare

"It's just playing music" is not a defense.

Not every AI exposure comes from someone deliberately using a chatbot. A smart speaker sitting on the front desk to play music is still an always-listening device, and consumer models like Alexa, Google Home, or similar assistants are not HIPAA-compliant by default. These devices listen continuously for a wake word, which means ambient conversation, including a staff member discussing a patient at the front desk, can be captured even when nobody asked the device to do anything. Independent research has documented these devices activating on words that aren't the actual wake word, meaning just playing music doesn't reliably limit what gets picked up.

The recordings don't stay local. Standard consumer devices send audio to the manufacturer's cloud for processing, and that data may be reviewed by employees or contractors, and used to improve the product, with no Business Associate Agreement in place and no practical way for the practice to know what was captured or where it went. A dedicated HIPAA-eligible path exists for healthcare voice deployments, but it requires enterprise enrollment and specific configuration. A consumer device purchased for the front desk and plugged in doesn't qualify, regardless of intent. See Standards & Security Baseline, since this is a device and network segmentation issue as much as an AI policy one.

What actually happens to that data.

Most consumer and freemium AI tools' terms of service allow the company to use submitted data to improve or train future models. That means PHI entered into an unapproved tool isn't just briefly exposed, it may be retained and used to train a system with no way to un-train it or verify it was deleted. Once that happens, the practice has no way to fully account for where that data went or who it might be exposed to next. See AI Readiness & Governance.

What this actually costs.

HIPAA's civil penalties scale by culpability and can reach well into six and seven figures per violation category, adjusted annually. Criminal penalties are separate and apply to individuals, not just the organization: up to one year in prison for knowingly obtaining or disclosing PHI, up to five years if done under false pretenses, up to ten years if done for personal gain or malicious intent. An employee using an unapproved AI tool with patient data typically isn't prosecuted criminally unless intent is involved, but the practice still faces the full civil exposure, and a pattern of staff using ungoverned AI tools is exactly the kind of knew-or-should-have-known failure that pushes an incident toward the higher, willful-neglect penalty tier. See Governance, Risk & Compliance.

Why "we didn't approve it" isn't a defense.

A practice doesn't get to disclaim responsibility for what staff actually do with patient data, even if leadership never sanctioned the specific tool. HIPAA expects the practice to have a documented policy and enforcement mechanism covering exactly this scenario. Not having one is itself a compliance failure, separate from whatever the AI tool did with the data.

Common questions

Questions leadership usually asks first.

Can an employee personally be liable for using AI with patient data, or just the practice?
Both, depending on intent. The practice faces civil exposure regardless, and an employee can face separate criminal exposure if the use was knowing and unauthorized.
Is a smart speaker used just for music actually a HIPAA risk?
Yes. The device listens continuously for its wake word regardless of intended use, and consumer models aren't HIPAA-compliant by default. If it's in a space where PHI is discussed, that's a real exposure, not a theoretical one.
How do we actually stop staff from using personal AI tools?
Start with a written, enforced policy naming what's approved and what isn't, paired with a reviewed list of alternatives that actually meet the need staff are trying to solve for. A policy nobody can point to isn't enforceable.
Is any AI tool safe to use with patient data?
Only tools with a signed Business Associate Agreement and a reviewed data-handling arrangement. General consumer or freemium AI tools do not qualify by default.
What is an IT Environment Review?
The IT Environment Review is free and takes about 30 minutes by video or phone. We ask a set list of questions about your environment, answer yours, and send you a written summary afterward.

Next step

Get a clearer view of your IT environment.

Find out what is working, where the risks are, and what needs attention next.