The Third Listener in the Room: Why Your Therapist’s AI Scribe Is Sparking a Trust Crisis

 

 The Third Listener in the Room: Why Your Therapist’s AI Scribe Is Sparking a Trust Crisis

**Subheading:** *From Arkansas to New York, therapists are turning to artificial intelligence to catch up on paperwork. But when patients discover a hidden "ear" without consent, the therapeutic alliance can shatter—sometimes permanently.*

**Estimated Reading Time:** 6 minutes

**Target Keywords:** *AI therapy notes, therapist AI scribe, AI informed consent, AI progress notes mental health, ambient AI scribe therapy, HIPAA AI documentation, AI in behavioral health.*

## Part 1: The Human Touch – The Session That Ended Differently Than It Began

Let me tell you about a therapy appointment that didn't go as planned—and why the fallout is echoing across the mental health profession.

Molly Quinn, a 31-year-old librarian in Fayetteville, Arkansas, had been seeing her therapist for two years. She had shared things she hadn't told anyone else. Trust had been built. Walls had come down.

Then came the November session when something felt off.

It wasn't her therapist's tone or the topics they discussed. It was the iPad. Propped up on the desk, no longer being touched. Her therapist, who usually took notes throughout their time together, was just... listening.

Halfway through the session, Quinn realized the conversation was being recorded—automatically transcribed by an artificial intelligence note-taking tool .

"She wasn't taking notes like she usually did," Quinn later recalled. "The iPad was just propped up."

Quinn froze momentarily but kept talking. It wasn't until she walked out of the office that the weight of it landed.

"The more I thought about it, the more I just started getting more and more sick to my stomach," she says. "This person who I'm supposed to be able to trust with some very private and very intense emotions had just completely disregarded something I said I was not comfortable with. I felt completely violated."

She canceled her next appointment. When her therapist offered to stop using the tool, it was too late. "The trust was gone."

Quinn eventually found a new therapist—one who agreed from the start: no AI in the room .

Her story is not unique. Across the country, mental health clinicians are discovering AI ambient scribes—tools from companies like Berries, Blueprint, SimplePractice, Eleos, and others—that promise to slash paperwork and reduce burnout. But as these "third listeners" quietly enter the therapy room, a different kind of crisis is emerging: a crisis of consent, privacy, and the very foundation of the therapeutic relationship .

## Part 2: The Professional – Why Therapists Are Turning to AI

To understand the pressure driving this trend, you have to look at the numbers.

### The Documentation Burden: By the Numbers

Therapists face an administrative reality that most patients never see. According to research cited by behavioral health EHR company PIMSY, therapists who use AI documentation tools report saving 12 to 15 hours per month—nearly two full workdays every four weeks .

Before Hillsides, a California-based behavioral health organization, adopted AI, "we were asking our therapists to turn in their signed notes 48 hours after a session, and they were having a hard time hitting that benchmark," said Tom Foster, the organization's Director of IT .

Therapists were relying solely on memory to write notes—sometimes days after sessions—often leading to low-quality, incomplete, or copy-pasted notes that left the organization vulnerable to audit-related penalties .

Then California introduced CalAIM in July 2023, eliminating reimbursement for documentation time. With providers spending an average of 15–25 minutes per note, Hillsides couldn't afford not to find a better solution .

After implementing AI, the time to complete notes dropped from 15–25 minutes to 6–7 minutes .

### The Burnout Connection

The deeper driver isn't just efficiency—it's clinician wellbeing. A recent APA Practitioner Pulse Survey found that about a third of psychologists report burnout . Research published in JAMA Network Open found that patients treated by burned-out therapists achieve clinically meaningful improvement only 28.3% of the time, compared to 36.8% with non-burned-out clinicians—a roughly 30% gap in treatment outcomes .

The documentation burden is a primary driver of that burnout. As Kym Tolson, a therapist of 30 years, told NPR, "It helps us in so many ways. Just that—reducing the burnout and the amount of time we spent on the admin, it's giving therapists their lives back" .

## Part 3: The Creative – The "Black Box" in the Consultation Room

Let me give you the creative framing that explains why this technology feels so different from other health tech.

### The Third Listener

Therapy is different from a primary care visit. When your doctor records a visit, you know it's for your chart. When a therapist records a session, the stakes feel higher—because they are. Patients share trauma, shame, secrets they've never told anyone. The perception of absolute privacy is not a luxury; it is the mechanism that makes the work possible.

Marisa Cohen, a couples and sex therapist in New York, put it bluntly: "Even the presence of AI changes the therapeutic experience. Clients know or feel like something else is listening to them. That awareness can subtly alter their disclosure" .

When you introduce something being stored electronically, Cohen says, "it raises additional questions about trust and safety. It's essentially a third party" .

### The Consent Gap

Ethics researchers point to a fundamental problem with how AI is being introduced. Kellie Owens, a bioethics researcher at NYU Grossman School of Medicine, notes that "we have a wide body of research showing that a consent form on its own does not mean a person is making an informed choice. People scroll through them, don't read them, or feel pressured to agree" .

Owens argues that recordings should always be discussed directly: "Any time you are recording a conversation, that should require a verbal conversation that a recording is taking place" .

For Molly Quinn, that conversation never happened.

### The Hallucination Risk

Then there's the accuracy problem. AI systems "hallucinate"—they fabricate content that has no basis in the source material. A therapist in Houston, according to industry sources, once reviewed a free-tool-generated SOAP note and signed off without catching a fabricated safety plan discussion. That note documented a clinical event that didn't happen. That's a malpractice problem .

"Even low error rates pose risks in healthcare, where small inaccuracies can affect patient safety," note researchers in a recent family therapy publication. AI notes can include "critical omissions of symptoms or concerns, misinterpretations of context, and speaker attribution errors in multi-speaker settings" .

## Part 4: Viral Spread – The Landscape of AI Scribes

### Major Players

| Company | Key Features | Reported Compliance |

| :--- | :--- | :--- |

| **Berries** | Records, transcribes, drafts clinical notes | Claims HIPAA compliance, no client data used for training |

| **Blueprint** | Similar ambient scribe functionality | HIPAA-compliant |

| **SimplePractice** | EHR-integrated AI Note Taker | BAAs negotiated with partners |

| **Eleos Health** | EHR-native, claims 70% faster documentation | Offline capture, no transcript or audio saved |

| **PIMSY PAISLY** | Built into EHR, no external audio upload | ONC-certified, behavioral health specific |

### The Compliance Checklist

For therapists navigating this landscape, here's what actually matters :

1. **Signed Business Associate Agreement (BAA):** Not "HIPAA-eligible" or "HIPAA-ready"—an actual executed agreement.

2. **No-PHI-training policy:** In writing, not buried in FAQs.

3. **EHR integration:** Notes flow directly into the clinical record—no copy-paste, no second login.

4. **Behavioral health note formats:** SOAP, DAP, BIRP support—not just generic clinical templates.

5. **Data retention and deletion:** How long is audio stored? How do you get it deleted?

### What Patients Think

A national YouGov survey found that only about 11% of Americans would be open to using AI for mental health care, and just 8% trust it. Nearly half of respondents said they are reluctant to use the technology, citing lack of human understanding, fears about inaccurate advice, and privacy concerns .

Separately, a KFF survey found that about 77% of Americans are worried about how their health information would be stored and used by AI systems .

## Part 5: Pattern Recognition – The Path Forward

### Best Practices for Responsible AI Use

For therapists who choose to use AI scribes, several practices emerge as non-negotiable :

- **Transparent disclosure:** AI use should be discussed verbally, not buried in a consent form.

- **Opt-out mechanism:** Clients must be able to decline AI use without penalty.

- **Human-in-the-loop guarantee:** Every AI-generated note must be reviewed, edited, and approved by the clinician.

- **Emergency protocol:** AI tools are not crisis responders. Clients must know this.

- **Define the tool clearly:** The AI is a scribe, not a co-therapist. It does not diagnose, treat, or plan care.

### A Sample Consent Language

The SimplePractice guidelines offer this example:

"Our practice uses HIPAA-compliant AI tools to assist with administrative tasks such as documentation or communication. These systems do not replace human judgment or therapeutic care. You may decline the use of AI in your care at any time without it affecting the services you receive" .

### The "Black Box" Warning

Researchers caution that even with perfect compliance, questions remain. "AI tends to flatten nuance," one analysis notes. "Subtle relational bids, nonverbal cues visible only on video, cultural idioms, or shifts in power dynamics... may be overlooked or reframed in diagnostic terms" .

A review of AI-generated documentation versus clinician-authored notes found significant divergences. The AI summary reduced complex interactional sequences to internal states and generalized emotional descriptors. The clinician's version preserved verbatim statements, contextualized historical trauma, and captured the cyclical dynamics in the client's relationships .

## Conclusion: The Ear in the Room

Let me give you the bottom line.

Molly Quinn's story ended the only way it could: with a broken therapeutic relationship and a new therapist who agreed to keep AI out of the room.

"I do have this right to not have my privacy violated, especially in a very intimate setting like a therapist office," Quinn says. "This is something that is a private conversation" .

**Here's what I believe, friendly and straight:**

AI scribes are coming to therapy. The administrative burden is real, the burnout statistics are alarming, and the time savings are significant. But the technology is being adopted faster than the ethical frameworks to support it.

Kellie Owens of NYU put it best: "If patients feel that privacy has been compromised, that can do real damage to the therapeutic relationship" .

The question is not whether AI will be used in therapy. It will. The question is whether therapists will treat the introduction of a "third listener" with the same care and transparency they bring to every other intervention—or whether more patients will discover, mid-session, that someone else is in the room.

**What you should do right now:**

| If you are... | Takeaway |

| :--- | :--- |

| **A therapy client** | Ask your therapist directly: "Do you use AI to take notes? How does it work? Can I opt out?" You have the right to know. |

| **A therapist** | Before you hit record, update your informed consent. Have the verbal conversation. Offer opt-out clearly. Review every note. |

| **A practice owner** | Vet your vendors. Require BAAs. Ask about data retention. Don't assume compliance equals safety. |

| **Anyone considering therapy** | It's okay to ask about AI upfront. It's okay to say no. Your privacy matters. |

**The final word:**

Therapy works because of trust. That trust takes months to build and seconds to break. An AI scribe can be a tool—or it can be a violation. The difference is consent.

And consent is not a checkbox. It is a conversation.

---

## FREQUENTLY ASKING QUESTIONS (FAQ)

**Q1: Is my therapist allowed to record our sessions with AI without telling me?**

**A:** No. While laws vary by state, professional ethics require informed consent. Experts say a verbal conversation about recording is necessary, not just a line in a consent form. If you discover a session is being recorded without your knowledge, you can ask to stop and request that any recordings be deleted .

**Q2: How do I know if my therapist is using AI?**

**A:** Ask directly. You can say: "Do you use any AI tools to document our sessions? How does it work? Where does the data go?" A responsible therapist will explain the tool, its privacy protections, and your right to opt out .

**Q3: Is AI-generated therapy note data secure?**

**A:** It depends on the tool. HIPAA-compliant tools with signed Business Associate Agreements (BAAs) offer legal protections. However, experts caution that "HIPAA compliance does not eliminate the possibility of breaches" .

**Q4: Can AI make mistakes in my medical record?**

**A:** Yes. AI "hallucinations"—fabricated information—are a documented risk. Errors can include invented symptoms, interventions that never occurred, or misattributed statements. This is why clinicians are required to review and edit every AI-generated note before it becomes part of your permanent record .

**Q5: Can I opt out of AI use in my therapy sessions?**

**A:** Yes. You have the right to decline AI use at any time without penalty. A sample consent form used in the field states: "You may decline the use of AI in your care at any time without it affecting the services you receive" .

**Q6: What should I look for in a therapist who uses AI?**

**A:** Look for transparency. They should explain the tool verbally, offer clear opt-out options, guarantee human review of all notes, and be able to tell you how long data is stored and whether it is used for training models .

**Q7: Are there times when AI should never be used?**

**A:** Yes. Experts recommend avoiding AI during highly sensitive trauma disclosures, court-ordered therapy, or any situation where the client is uncomfortable. The therapist's clinical judgment and the client's consent should always guide use .

---

**Disclaimer:** This article is for informational purposes only and does not constitute legal or medical advice. Laws regarding recording therapy sessions and AI use vary by state. Please consult with a qualified attorney or ethics board for guidance specific to your practice or situation.