ClinicalTrials.gg
CompletedNCT07107880Updated Sep 28, 2026

Use of Artificial Intelligence to Assess Trainee Communication Compared to Human Assessment

An interventional study of Communication Assessment through AI and Human in Communication Skills, sponsored by Stanford University. Completed at 1 site in United States. Open to participants aged 18 Years to 99 Years, including healthy volunteers. Per ClinicalTrials.gov, last updated 2026-09-28.

Sponsored by Stanford University · Not applicable, Interventional, and Supportive care

How we know

Updated Sep 28, 2026Now CompletedPrimary completion moved+2 moreGo to Updates ↓

Help build ClinicalTrials.gg — short surveys, remote interviews or testing, in your language. Take part →

Phase
Not applicable
Study type
Interventional
Enrollment
30
Allocation
Not applicable
Ages
18 Years to 99 Years
Sex
All
01

Where this study stands

Counted across the records on this site · 2026-11-22

Among 370 studies in Communication with a site in United States — 74 open to participants now, 93 under way, 3 of them phase 3. Communication · United States.

Enrollment
271st of 320
30 · median 166
Started
2025
with 27 others
No phase
296 of 370
61 open now
Registered
330th of 370
by date
Lead sponsor
8 of 370
Stanford University

Among the 370 studies in Communication with a site in United States, this one is the 271st largest by enrollment of the 320 interventional ones that give a count, is one of 28 that started in 2025, is one of 296 with no phase, and was the 330th registered.

Communication

720 studies on the registry are indexed under Communication; 160 are open to participants now.

Browse Communication studies →

Open to participants now

74 of the 370 studies in Communication with a site in United States are open now. Recruiting first, the newest first:

69 more — sign in →

All 74 open studies →

A study can be open while its sites in United States have not opened yet or have stopped. Only those recruiting at a site in United States →

Who these studies take

Of the 88 Communication studies recruiting now, 53 (60%) set no upper age limit and 28 (32%) stop at 75 or younger; 32 take children under 18; 34 take healthy volunteers.

This study: 18 Years to 99 Years · all sexes · healthy volunteers too.

The full table on the hub →

This tab as a report to print or save as PDF → With an account.

Was this useful?
Get alerts for this landscapeDownload CSVNarrow it in search →With an account: a weekly mail of what changed among 370 studies in Communication with a site in United States, or all of them as a file.
02

Study summary

This study will evaluate whether a web-based artificial intelligence platform (AI) (Clinical Mind AI [CMAI] Stanford, CA), can assess communication skills in anesthesiology trainees, including residents and fellows, in the setting of disclosing medical errors. All participants will participate in an AI-generated simulation by using the platform remotely, and CMAI will assess trainee performance immediately after the simulation.

Read the detailed description

The goal of this study is to evaluate the accuracy of CMAI platform to assess participant performance following a voice-based AI simulation designed to help trainees practice disclosing medical errors. The platform will feature a custom clinical case, created using CMAI's patient creation tool, involving a discussion with the parent of a child who suffered a dental injury that occurred during intubation. The platform will provide an audio-based, simulated encounter with the parent enabling the participant to interact with, and then assess trainee communication performance, followed by the delivery of questionnaires to the trainee to determine usability and satisfaction. A human evaluator will also assess the trainees' performance using the same scales, and the investigators will compare the AI performance evaluation to the human evaluation. This study will allow the investigators to determine:

  1. Reliability of the performance assessments of the CMAI platform compared to human raters
  2. Usability for the CMAI audio voice model for simulated patient encounters
  3. Satisfaction related to an innovative, educational technique

By evaluating these domains, we aim to determine the educational value of using simulated voice communication for training in emotionally complex, clinical scenarios.

03

Conditions studied

  • Communication Skills

Browse trials for

Keywords

  • Voice Artificial Intelligence (AI)
  • Simulation
  • Clinical Mind Artificial Intelligence (CMAI)
  • Medical Error Disclosure
04

Who can participate

Ages eligible
18 Years to 99 Years
Sexes eligible
All
Accepts healthy volunteers
Yes

Go through the criteria one by one — yes, no or not sure — and take the list to your doctor or the study team. Kept in this browser only.

Inclusion criteria

  • Participant's must be 18 years of age or older
  • Graduate medical trainess such as residents and fellows at all levels of training excluding PGY1 trainees at Department of Anesthesiology, Perioperative, and Pain Medicine at Stanford University
  • Able to speak and understand English
  • Willing and able to provide consent to participate in research
  • Able to participate in Artificial Intelligence communication simulation

Exclusion criteria

Exclusion Criteria:

  • Non-English speaker
  • unable to provide consent to participate in research
  • individual with no access to the necessary technology (internet, computer/smart device) required for participating in the digital, voice-based interaction with the AI platform
05

Study design

Phase
Not applicable
Primary purpose
Supportive care
Allocation
Not applicable
Intervention model
Single group
Masking
None (open label)
Enrollment
30 participants (actual)

Study arms

  • Experimental
    Voice Artificial Intelligence (AI) Group

    Participants will remotely engage with an AI-simulated parent of a pediatric patient through a voice call, discussing a clinical scenario concerning their child. The participant's communication skills will be assessed using an artificial intelligence (AI) system and two human evaluators using the same rating scales.

    Other: Communication Assessment through AI and Human

Interventions

  • OtherCommunication Assessment through AI and Human

    Participants will remotely engage in an AI-generated simulation that presents an voice-based conversation with a simulated parent of a pediatric patient. The scenario involves discussing a clinical scenario concerning their child. Following the simulation, the participant's communication skills will be assessed using an artificial intelligence (AI) system trained to evaluate the key aspects of communication using standardized rating scales. In addition, two human evaluators will assess the participant's communication skills using the same rating scales.

06

What researchers measure

Primary outcomes

  1. Reliability of AI Conversational Performance Assessment

    The primary outcome is to evaluate the reliability of the Clinical Mind AI (CMAI) platform in accurately assessing the communication skills of medical education trainees during a simulated interaction. To measure this outcome, the CMAI will use the Breaking Bad News Assessment Schedule (BBAS), a validated tool assessing participant's communication skills in five domains: 1) Setting the scene, 2) Breaking the news, 3) Eliciting concerns, 4) Informative giving, and 5) Empathy and Support. It includes 17 items, each with sub questions, rated on a 5-point Likert scale from (1-5), where score meanings may vary by each question. The scoring will be guided by Breaking Bad News Rubric, which outlines performance criteria for each item on the BBAS. In addition, two trained human evaluators will independently asses the participant's communication skills using the same BBAS tool and rubric. Lastly, both CMAI and human scores will be compared to determine the reliability of the CMAI platform.

    Time frame: Immediately after the simulation

Secondary outcomes

  1. Usability of CMAI Simulation Platform

    The perceived usability of the CMAI platform will be evaluated using a usability questionnaire. This questionnaire consists of 14 items, each offering five different response options. Participants will rate each item on a scale from 1 - 5, where score meanings may vary by each question.

    Time frame: immediatley after the simulation

  2. Satisfaction of CMAI Simulation

    Participant's satisfaction levels will be evaluated using a modified version of the Questionnaire on Satisfaction with Teaching Innovation (QSTI) Survey. The survey consists of five items, each rated on a scale of 1-5, where 1= Strongly Disagree and 5 = Strongly Agree. Higher scores indicate increased satisfaction levels.

    Time frame: immediately after the simulation

07

Study locations

1 site
  • Lucile Packard Children's Hospital Stanford
    Palo Alto, California 94304, United States
08

Timeline

1 registry update since Sep 25, 2026
ElapsedEstimatedEstimated, not yet reachedDate before it movedWhere the date was before it movedSimilar studies: half by the dot; the band is the middle halfHalf of similar studies reached it by the dot; the band is the middle half, from a quarter to three quarters

Ran from Nov 2025 to primary completion in Aug 2026, 9 months.

Of 389 non-industry interventional studies with no phase under Communication, half reached primary completion within 18 months of starting (the median), counting those still running; a quarter within 6 and three quarters within 36. This study's 9 months is below that.

Counting every sponsor, half of 393 studies reached it within 18 months; a quarter within 6 and three quarters within 36.

Since we started tracking on Sep 25, 2026, the dates moved once, on Sep 28, 2026: primary completion Sep 2026 → Aug 2026 and completion Nov 2026 → Aug 2026.

Earlier changes are on the record history on ClinicalTrials.gov ↗

How these figures are worked out, and which studies are left out of them.

Registered
Jul 23, 2025
First posted
Aug 6, 2025
StartActual
Nov 10, 2025
Primary completionActual
Aug 11, 2026was Sep 2026
CompletionActual
Aug 11, 2026was Nov 2026
Last update
Sep 28, 2026
What these dates mean
Start.
When the first participant enrolled; while estimated, when the study expects to open to recruitment.
Primary completion.
When the last participant was examined or treated to collect data for the study's main question, its primary outcome. A study that stopped early gives the date its data collection stopped.
Completion.
When the last participant's last visit took place, for every outcome, secondary ones and side effects included: the end of the study. Often later than primary completion, sometimes the same day.
Actual and Est.
Actual means the registry says the date has happened. Est. (estimated) is a date the sponsor plans or expects. It can still move, and the sponsor is expected to change it to actual once it has passed.
Status
Recruiting→Completed
changed Sep 28, 2026
Primary completion
Sep 14, 2026→Aug 11, 2026 (actual)
Sep 28, 2026
Study completion
Nov 14, 2026→Aug 11, 2026 (actual)
Sep 28, 2026
Enrollment
45 (estimated)→30 (actual)
Sep 28, 2026
Show all 1 update
  1. Sep 28, 2026
    Recruiting→Completed
    Primary completion Sep 14, 2026→Aug 11, 2026 (now actual)
    Study completion Nov 14, 2026→Aug 11, 2026 (now actual)
    Enrollment 45 (estimated)→30 (actual)
    + 3 other changes: verification date, contact details and site details

From the registry record's own update history. This site started tracking changes on Sep 25, 2026; for anything earlier, see the record history on ClinicalTrials.gov ↗

09

Registry details

Key details

Study ID
NCT07107880
Responsible party
Thomas Caruso (Clinical Professor, Stanford University) — Principal investigator
First posted
Aug 6, 2025
Start date
Nov 10, 2025
Primary completion
Aug 11, 2026
Completion
Aug 11, 2026
Last update
Sep 28, 2026

Study contacts

Thomas Caruso, MD, PhD
principal investigator · Stanford University

Oversight

Data monitoring committee
No
FDA-regulated drug
No
FDA-regulated device
No
View the source record on ClinicalTrials.gov ↗

Not currently enrolling

This study is completed, as verified in Sep 2026. You cannot join it, but the record below documents what was studied.

Follow this study

Get an email when the registry record changes — status, dates, results — or when someone posts here.

Sign in to follow

Discussion

Questions and observations about this study, from anyone following it. Not medical advice, and not a channel to the study team — their contact details are on the registry record.

Sign in to join the discussion. Reading takes no account; posting does. You choose a display name, and a pseudonym is the default.

Nothing here yet. If you are running this trial, taking part in it, or weighing whether to, this is the place to say so.

Start the discussion