ClinicalTrials.gg
CompletedNCT07414966SCOUTUpdated Nov 4, 2026

Scalable Clinical Oversight of Large Language Models Via Uncertainty Triangulation

An interventional study of SCOUT-Assisted Review Workflow and Standard Manual Review Workflow in Coronary Heart Disease (CHD), sponsored by China National Center for Cardiovascular Diseases. Completed at 1 site in China. Open to participants aged 18 Years and older. Per ClinicalTrials.gov, last updated 2026-11-04.

Sponsored by China National Center for Cardiovascular Diseases · Not applicable, Interventional, and Diagnostic

How we know

Updated Nov 4, 2026Now CompletedFirst site in China+5 moreGo to Updates ↓

Help build ClinicalTrials.gg — short surveys, remote interviews or testing, in your language. Take part →

Phase
Not applicable
Study type
Interventional
Enrollment
7
Allocation
Randomized
Ages
18 Years and older
Sex
All
01

Where this study stands

Counted across the records on this site · 2026-11-22

Among 25 studies in Coronary Disease by China National Center for Cardiovascular Diseases — 12 open to participants now, 13 under way, none of them phase 3. Coronary Disease · China National Center for Cardiovascular Diseases.

Enrollment
13th of 13
7 · median 240
Started
2026
with 3 others
No phase
7 of 25
5 open now
Registered
22nd of 25
by date

Among the 25 studies in Coronary Disease by China National Center for Cardiovascular Diseases, this one is the 13th largest by enrollment of the 13 interventional ones that give a count, is one of 4 that started in 2026, is one of 7 with no phase, and was the 22nd registered.

Coronary Disease

1,522 studies on the registry are indexed under Coronary Disease; 167 are open to participants now.

Browse Coronary Disease studies →

Open to participants now

12 of the 25 studies in Coronary Disease by China National Center for Cardiovascular Diseases are open now, in 1 country. Recruiting first, the newest first:

7 more — sign in →

By country, each count listing its studies:

All 12 open studies →

Where they have run

Who these studies take

Of the 106 Coronary Disease studies recruiting now, 64 (60%) set no upper age limit and 19 (18%) stop at 75 or younger; 8 take children under 18; 10 take healthy volunteers.

This study: 18 Years and older · all sexes · no healthy volunteers.

The full table on the hub →

This tab as a report to print or save as PDF → With an account.

Was this useful?
Get alerts for this landscapeDownload CSVNarrow it in search →With an account: a weekly mail of what changed among 25 studies in Coronary Disease by China National Center for Cardiovascular Diseases, or all of them as a file.
02

Study summary

This prospective, multi-reader, randomized crossover trial evaluates SCOUT (Scalable Clinical Oversight via Uncertainty Triangulation), a model-agnostic meta-verification framework that selectively defers unreliable large language model (LLM) predictions to clinicians by triangulating three orthogonal uncertainty signals: model heterogeneity, stochastic inconsistency, and reasoning critique. The trial assesses whether SCOUT-assisted review can reduce physician review time compared with standard manual review of AI-generated diagnoses while maintaining non-inferior diagnostic accuracy in coronary heart disease (CHD) subtyping.

Read the detailed description

Background: Large language models are increasingly deployed in clinical workflows, yet requiring clinician review of every AI output negates the efficiency gains that motivate their adoption. SCOUT addresses this efficiency-safety paradox through algorithmic meta-verification.

The SCOUT framework triangulates three orthogonal external signals to determine case-level uncertainty: (1) Model Heterogeneity - whether a structurally different auxiliary LLM agrees with the primary model; (2) Stochastic Inconsistency - whether repeated sampling from the same model yields divergent outputs; (3) Reasoning Critique - whether an external checker model identifies logical flaws in the chain-of-thought reasoning.

In this crossover trial, 7 clinicians of varying seniority (2 junior residents, 3 senior residents, 2 attending physicians) each review all 110 cases under both standard manual review and SCOUT-assisted review workflows. The study evaluates workflow efficiency (primary endpoint) and diagnostic accuracy (secondary endpoint).

03

Conditions studied

  • Coronary Heart Disease (CHD)

Browse trials for

Keywords

  • artificial intelligence
04

Who can participate

Ages eligible
18 Years and older
Sexes eligible
All
Accepts healthy volunteers
No

Go through the criteria one by one — yes, no or not sure — and take the list to your doctor or the study team. Kept in this browser only.

Inclusion criteria

  • Board-certified or in-training cardiologists at Fuwai Hospital
  • Spanning three experience strata: junior residents, senior residents, attending physicians

Exclusion criteria

Exclusion Criteria:

  • Clinicians involved in the development or optimization of the SCOUT framework
  • Clinicians involved in the gold-standard adjudication process
05

Study design

Phase
Not applicable
Primary purpose
Diagnostic
Allocation
Randomized
Intervention model
Crossover assignment
Masking
None (open label)
Enrollment
7 participants (actual)

Study arms

  • Active comparator
    Control (Standard Manual Review)

    Physicians manually review all cases in the control set (n=54) with access to AI predictions and reasoning. No selective deferral.

    Diagnostic Test: Standard Manual Review Workflow

  • Experimental
    Experimental (SCOUT-Assisted Review)

    Physicians process the intervention set (n=56) through the SCOUT framework. Low-uncertainty cases are auto-accepted; high-uncertainty cases undergo physician review with full audit trail.

    Diagnostic Test: SCOUT-Assisted Review Workflow

Interventions

  • Diagnostic testSCOUT-Assisted Review Workflow

    SCOUT-Assisted Review (Intervention Arm): Physicians review 56 cases processed through the SCOUT framework. For cases classified as low-uncertainty (D(x)=0), the AI prediction is auto-accepted without physician review. For high-uncertainty cases (D(x)=1), the physician reviews the case with access to the main model's chain-of-thought reasoning and the meta-verification audit results. The main model is DeepSeek-V3.1 with chain-of-thought prompting.

  • Diagnostic testStandard Manual Review Workflow

    Physicians perform a full manual review of 54 cases using raw medical records with access to the AI model's predictions and reasoning, but without SCOUT uncertainty stratification or selective deferral.

06

What researchers measure

Primary outcomes

  1. Mean physician review time per case (minutes)

    Mean time spent by each clinician reviewing and rendering a diagnostic decision per case under each arm. Measured in minutes.

    Time frame: Through study completion, an average of 2 hours.

Secondary outcomes

  1. Diagnostic accuracy (%)

    Proportion of correct CHD subtype classifications (STEMI, NSTEMI, unstable angina, chronic coronary syndromes) under each arm.

    Time frame: Through study completion, an average of 2 hours.

  2. Computational Return on Investment (ROI)

    Ratio of physician time savings (valued at standardized minute-wages from Sanming healthcare reform benchmarks) to computational cost of SCOUT inference, stratified by clinician seniority level.

    Time frame: Through study completion, an average of 2 hours.

07

Study locations

1 site
  • Fuwai Hospital
    Beijing, Beijing Municipality 100037, China
08

References and documents

Individual participant data

Plan to share: Yes — De-identified individual participant data underlying the results reported in this study will be made available.

Supporting information: Study protocol, Statistical analysis plan, Informed consent form, Clinical study report, Analytic code

Time frame: Beginning 1 months after publication of the primary results and available for up to 60 months.

Access criteria: Data are available from the corresponding author upon reasonable request. Requestors will need to provide a methodologically sound research proposal and sign a data use agreement.

No publications or documents are linked to this record.

09

Timeline

1 registry update since Sep 25, 2026
ElapsedEstimatedEstimated, not yet reachedSimilar studies: half by the dot; the band is the middle halfHalf of similar studies reached it by the dot; the band is the middle half, from a quarter to three quarters

Ran from Feb 2026 to primary completion in Feb 2026, 0 months.

Of 180 non-industry interventional studies with no phase under Coronary Disease, half reached primary completion within 26 months of starting (the median), counting those still running; a quarter within 15 and three quarters within 51. This study's 0 months is below that.

Counting every sponsor, half of 202 studies reached it within 25 months; a quarter within 14 and three quarters within 51.

How these figures are worked out, and which studies are left out of them.

Registered
Feb 9, 2026
First posted
Feb 17, 2026
StartActual
Feb 15, 2026
Primary completionActual
Feb 18, 2026
CompletionActual
Feb 18, 2026
Last update
Nov 4, 2026
What these dates mean
Start.
When the first participant enrolled; while estimated, when the study expects to open to recruitment.
Primary completion.
When the last participant was examined or treated to collect data for the study's main question, its primary outcome. A study that stopped early gives the date its data collection stopped.
Completion.
When the last participant's last visit took place, for every outcome, secondary ones and side effects included: the end of the study. Often later than primary completion, sometimes the same day.
Actual and Est.
Actual means the registry says the date has happened. Est. (estimated) is a date the sponsor plans or expects. It can still move, and the sponsor is expected to change it to actual once it has passed.
Status
Not yet recruiting→Completed
changed Nov 4, 2026
Sites
1 site added — first site in China
Show site
  • Fuwai Hospital · Beijing, China
Nov 4, 2026
Start date
Feb 19, 2026→Feb 15, 2026 (actual)
Nov 4, 2026
Primary completion
Feb 28, 2026→Feb 18, 2026 (actual)
Nov 4, 2026
Study completion
Feb 28, 2026→Feb 18, 2026 (actual)
Nov 4, 2026
Show all 1 update
  1. Nov 4, 2026
    Not yet recruiting→Completed
    1 site added — first site in China
    Show site
    • Fuwai Hospital · Beijing, China
    Start date Feb 19, 2026→Feb 15, 2026 (now actual)
    Primary completion Feb 28, 2026→Feb 18, 2026 (now actual)
    Study completion Feb 28, 2026→Feb 18, 2026 (now actual)
    + 1 other change: contact details

From the registry record's own update history. This site started tracking changes on Sep 25, 2026; for anything earlier, see the record history on ClinicalTrials.gov ↗

10

Registry details

Key details

Study ID
NCT07414966
Responsible party
Sponsor
First posted
Feb 17, 2026
Start date
Feb 15, 2026
Primary completion
Feb 18, 2026
Completion
Feb 18, 2026
Last update
Nov 4, 2026

Oversight

Data monitoring committee
Yes
FDA-regulated drug
No
FDA-regulated device
No
View the source record on ClinicalTrials.gov ↗

Not currently enrolling

This study is completed, as verified in Feb 2026. You cannot join it, but the record below documents what was studied.

Follow this study

Get an email when the registry record changes — status, dates, results — or when someone posts here.

Sign in to follow

Discussion

Questions and observations about this study, from anyone following it. Not medical advice, and not a channel to the study team — their contact details are on the registry record.

Sign in to join the discussion. Reading takes no account; posting does. You choose a display name, and a pseudonym is the default.

Nothing here yet. If you are running this trial, taking part in it, or weighing whether to, this is the place to say so.

Start the discussion