ClinicalTrials.gg
RecruitingNCT07760051Updated Sep 28, 2026

Effects of Agent-assisted, LLM-assisted and Traditional Workflows on Diagnosis and Management Planning at Admission

An interventional study of Agent-assisted workflow and LLM-assisted workflow in Clinical Decision Support Systems, Diagnostic Reasoning and Artificial Intelligence (AI), sponsored by Second Affiliated Hospital, Zhejiang University, School of Medicine. Recruiting at 1 site in China. Open to participants aged 18 Years and older, including healthy volunteers. Per ClinicalTrials.gov, last updated 2026-09-28.

Sponsored by Second Affiliated Hospital, Zhejiang University, School of Medicine · Not applicable, Interventional, and Health services research

From the registry’s dates

  • Started Sep 2026; still recruiting 2 months later.

Help build ClinicalTrials.gg — short surveys, remote interviews or testing, in your language. Take part →

Phase
Not applicable
Study type
Interventional
Enrollment
180
Allocation
Randomized
Ages
18 Years and older
Sex
All
01

Study summary

The goal of this clinical trial is to evaluate whether AI-assisted workflows improve physicians' admission diagnosis and management planning performance on standardized simulated inpatient cases, among practicing internal medicine and surgery physicians across all seniority levels and across three tiers of the Chinese healthcare system.

The main questions it aims to answer are:

  • Does the Agent-assisted workflow yield better structured admission diagnosis and management planning scores than standalone LLM assistance?
  • Does the Agent-assisted workflow outperform the traditional workflow without AI tools? Researchers will compare three parallel groups (traditional workflow group, LLM-assisted group, Agent-assisted group) to determine whether the Agent tool can improve diagnostic accuracy and efficiency.

The goal of this clinical trial is to evaluate whether AI-assisted workflows improve physicians' admission diagnosis and management planning performance on standardized simulated inpatient cases, among practicing internal medicine and surgery physicians across all seniority levels and across three tiers of the Chinese healthcare system.

The main questions it aims to answer are:

  • Does the Agent-assisted workflow yield better diagnosis and management planning scores than the LLM-assisted workflow?
  • Does the Agent-assisted workflow yield better diagnosis and management planning scores than the conventional workflow without AI assistance? Researchers will compare three parallel groups (traditional workflow group, LLM-assisted group, Agent-assisted group) to determine whether the agent tool can improve diagnostic and management planning performance and efficiency.

Participants will:

  • Be recruited from 15 hospitals in China and participate remotely under video proctoring
  • Be randomly assigned to one of the three fixed workflows, with randomization stratified by hospital tier, specialty and seniority
  • Work through 6 anonymized simulated HIS admission cases and complete as many as they can.
  • Submit structured answers for each case covering principal diagnosis, secondary diagnoses, differential diagnoses, diagnostic justification, next diagnostic or therapeutic steps, consultation and referral decisions, and diagnostic confidence.
  • Have their operation logs and time consumption recorded automatically by the study platform.
  • Complete a post-session questionnaire after submitting all cases.
02

Conditions studied

  • Clinical Decision Support Systems
  • Diagnostic Reasoning
  • Artificial Intelligence (AI)

Keywords

  • AI agent
  • Large Language Model
  • Clinical Decision Support
  • Admission Diagnosis
  • Diagnostic Accuracy
  • Diagnostic Reasoning
  • Randomized Controlled Trial
  • Management Planning
03

In context

Lead sponsor

Second Affiliated Hospital, Zhejiang University, School of Medicine is the lead sponsor of 100 studies on the registry; 68 are open to participants now.

Counted across the registry records on this site, refreshed daily.

04

Who can participate

Ages eligible
18 Years and older
Sexes eligible
All
Accepts healthy volunteers
Yes

Go through the criteria one by one — yes, no or not sure — and take the list to your doctor or the study team. Kept in this browser only.

Inclusion criteria

  • Hold a Medical Practitioner Qualification Certificate and/or Medical License, or be a recognized standardized resident physician; able to independently read electronic medical records, laboratory and imaging reports on an HIS.
  • Currently engaged in clinical work in internal medicine or surgery at one of the 15 participating hospitals.
  • Able to complete the case assessment in one continuous hour without breaks.
  • Able to participate remotely under video proctoring, with a stable internet connection and a working camera.
  • Voluntarily agree to participate and sign the form, including the declaration not to use unauthorized AI tools during the assessment.
  • Have not participated in case drafting, review, rubric development, or any activity that may leak the reference standard.

Exclusion criteria

Exclusion Criteria

  • Have previously accessed the official test cases or reference standard of this study.
  • Unable to complete the training module, qualification test, or all experimental tasks.
  • Have conflicts of interest, e.g. participation in developing core algorithms of the tested system.
  • Unwilling to comply with remote proctoring, including keeping the camera on throughout.
  • Judged unsuitable by the investigators.
Terms in these criteria, in plain language(1)

Underlined terms in the criteria open these too. Explained by clinicaltrials.gg, not part of the registry record. The study team decides who can take part.

Informed consent

Before you join, the study team explains what taking part involves — its purpose, what happens, the risks and possible benefits — and answers your questions, so you can decide freely. Consent is usually recorded on a form (the informed consent form, ICF) signed by you or, where the law allows, by someone legally authorized to decide for you.

You can keep asking questions during the study, you are told of new information that matters, and you can choose to leave at any time.

05

Study design

Phase
Not applicable
Primary purpose
Health services research
Allocation
Randomized
Intervention model
Parallel assignment
Masking
Single (Outcomes assessor)
Enrollment
180 participants (estimated)

Study arms

  • Experimental
    Agent-assisted group

    Other: Agent-assisted workflow

  • Experimental
    LLM-assisted group

    Other: LLM-assisted workflow

  • Active comparator
    Traditional group

    Other: Traditional Workflow

Interventions

  • OtherAgent-assisted workflow

    Conventional resources (the pre-admission clinical record, conventional search engines, permitted conventional non-generative clinical information resources) plus an in-system Agent entry that automatically reads the full record and report images, produces a structured summary with source-text tracing, and supports multi-turn Q\&A and one-click editable drafts.

  • OtherLLM-assisted workflow

    Conventional resources (the pre-admission clinical record, conventional search engines, permitted conventional non-generative clinical information resources) plus an in-system multi-turn AI dialogue entry. The AI does not automatically read the record; participants paste text or send partial screenshots.

  • OtherTraditional Workflow

    Conventional resources only: the pre-admission clinical record, conventional search engines, permitted conventional non-generative clinical information resources. No AI assistance.

06

What researchers measure

Primary outcomes

  1. Mean Normalized Structured Score

    Mean of the rescaled case scores (each case rescaled to 100), divided by the number of cases completed; range 0 to 100.

    Time frame: Within one-hour study

Secondary outcomes

  1. Active Response Time per Case

    Active response time in seconds for each case, recorded automatically by the platform.

    Time frame: Within one-hour study

  2. Degree of Adherence to AI-Generated Recommendations

    Degree to which the submitted answer incorporates AI output. Assessed in the Agent-assisted group and LLM-assisted group only.

    Time frame: Within one-hour study

07

Study locations

1 of 1 sites recruiting
08

References and documents

Individual participant data

Plan to share: No

No publications or documents are linked to this record.

09

Timeline

1 registry update since Sep 25, 2026
ElapsedEstimatedEstimated, not yet reached

Started Sep 2026 (actual). Primary completion is estimated for Dec 2026, 3 months after the start.

How these figures are worked out, and which studies are left out of them.

Registered
Jul 29, 2026
First posted
Aug 12, 2026
StartActual
Sep 6, 2026
Primary completionEst.
Dec 2026
CompletionEst.
Dec 2026
Last update
Sep 28, 2026
What these dates mean
Start.
When the first participant enrolled; while estimated, when the study expects to open to recruitment.
Primary completion.
When the last participant was examined or treated to collect data for the study's main question, its primary outcome. A study that stopped early gives the date its data collection stopped.
Completion.
When the last participant's last visit took place, for every outcome, secondary ones and side effects included: the end of the study. Often later than primary completion, sometimes the same day.
Actual and Est.
Actual means the registry says the date has happened. Est. (estimated) is a date the sponsor plans or expects. It can still move, and the sponsor is expected to change it to actual once it has passed.
Secondary outcomes
2 description edited
What changed in the outcomes
  • DescriptionActive Response Time per Case: how it is measured was reworded
  • DescriptionDegree of Adherence to AI-Generated Recommendations: how it is measured was reworded
Sep 28, 2026
Show all 1 update
  1. Sep 28, 2026
    Secondary outcomes 2 description edited
    What changed in the outcomes
    • DescriptionActive Response Time per Case: how it is measured was reworded
    • DescriptionDegree of Adherence to AI-Generated Recommendations: how it is measured was reworded
    + 4 other changes: identifiers, description, design details and arm descriptions

From the registry record's own update history. This site started tracking changes on Sep 25, 2026; for anything earlier, see the record history on ClinicalTrials.gov ↗

10

Registry details

Key details

Study ID
NCT07760051
Collaborators
Shangrao People's Hospital
Responsible party
Sponsor
First posted
Aug 12, 2026
Start date
Sep 6, 2026
Primary completion
Dec 2026 (estimated)
Completion
Dec 2026 (estimated)
Last update
Sep 28, 2026

Study contacts

Yixin Zhang
Contact
12518552@zju.edu.cn
+86 19157950225
Yuan Ding
study chair · Second Affiliated Hospital, Zhejiang University, School of Medicine

Oversight

Data monitoring committee
No
FDA-regulated drug
No
FDA-regulated device
No
View the source record on ClinicalTrials.gov ↗

Interested in this study?

Eligibility is decided by the study team. Share this record with your doctor or contact the team directly.

Contact study team

Follow this study

Get an email when the registry record changes — status, dates, results — or when someone posts here.

Sign in to follow

Discussion

Questions and observations about this study, from anyone following it. Not medical advice, and not a channel to the study team — their contact details are on the registry record.

Sign in to join the discussion. Reading takes no account; posting does. You choose a display name, and a pseudonym is the default.

Nothing here yet. If you are running this trial, taking part in it, or weighing whether to, this is the place to say so.

Start the discussion