CClinicalTrials.gg
CompletedNCT07592338KITuKoUpdated May 18, 2026

Agreement Between Large Language Model-Generated Treatment Recommendations With Guideline-Based and Tumor Board Decisions in Gastrointestinal Cancer

An observational study in Gastric Cancer (GC), Colorectal Cancer and Pancreatic Cancer, sponsored by Medizinische Hochschule Brandenburg Theodor Fontane. Completed at 1 site in Germany. Open to participants aged 18 Years and older. Per ClinicalTrials.gov, last updated 2026-05-18.

Sponsored by Medizinische Hochschule Brandenburg Theodor Fontane · Observational

Study type
Observational
Model
Cohort
Time perspective
Retrospective
Enrollment
30
Ages
18 Years and older
Sex
All
01

Study summary

The goal of this observational study is to learn whether a computer program can suggest cancer treatments that match expert recommendations for people with gastrointestinal cancer (cancer of the pancreas, stomach, or colon and rectum).

The main questions it aims to answer are:

  • Do the treatment suggestions from the computer program match current medical guidelines?
  • Do these suggestions match decisions made by a multidisciplinary tumor board (a team of cancer specialists)?

Researchers will review existing medical records from people who have already been treated for these cancers. They will enter key clinical information into a computer program that uses artificial intelligence (AI). The program will generate treatment suggestions for each case.

Researchers will then compare these suggestions with:

  • guideline-based treatment recommendations
  • decisions made by the tumor board

This study will help researchers understand whether AI tools could support doctors in making cancer treatment decisions in the future.

Read the detailed description

Gastrointestinal cancers require complex treatment planning that often involves surgery, systemic therapy, and multidisciplinary coordination. Clinical decision-making is typically guided by evidence-based recommendations and discussed in multidisciplinary tumor boards. However, the increasing complexity of treatment strategies and guideline frameworks can make consistent and reproducible decision-making challenging in routine clinical practice.

Recent advances in artificial intelligence have enabled the development of large language models (LLMs) that can process structured clinical information and generate text-based recommendations. These systems may offer a scalable approach to support clinical workflows, but their ability to produce reliable and clinically appropriate treatment suggestions in oncology remains uncertain.

This study evaluates the performance of an LLM-based system in the context of gastrointestinal oncology using retrospectively collected clinical case data. Structured case summaries derived from routine clinical documentation are used as standardized input. The model generates treatment recommendations under controlled conditions, allowing systematic comparison with established clinical reference standards.

The analysis focuses on the level of agreement between model-generated recommendations and established decision-making frameworks. In addition, the study explores how model performance varies across different clinical scenarios, including varying levels of disease complexity. Particular attention is given to situations in which recommendations differ, in order to better understand potential limitations of the model and identify patterns that may be clinically relevant.

Furthermore, the study examines the consistency of model outputs when the same clinical information is processed multiple times. This provides insight into the stability and reproducibility of the system, which are important considerations for potential real-world use.

The findings of this study are intended to inform the potential role of LLM-based tools as supportive systems in clinical decision-making. The study does not evaluate clinical outcomes or patient benefit, but instead focuses on agreement with established standards and expert-driven decisions as an initial step in assessing feasibility and safety.

02

Conditions studied

  • Gastric Cancer (GC)
  • Colorectal Cancer
  • Pancreatic Cancer

Keywords

  • Colorectal Neoplasms
  • Stomach Neoplasms
  • Pancreatic Neoplasms
  • Artificial Intelligence
  • Clinical Decision Support Systems
03

In context

Stomach Neoplasms

2,851 studies on the registry are indexed under Stomach Neoplasms; 864 are open to participants now.

This study's enrollment of 30 is below the median of 274 across 670 observational studies indexed under Stomach Neoplasms.

Browse Stomach Neoplasms studies →

Lead sponsor

Medizinische Hochschule Brandenburg Theodor Fontane is the lead sponsor of 17 studies on the registry; 2 are open to participants now.

Counted across the registry records on this site, refreshed daily.

04

Who can participate

Ages eligible
18 Years and older
Sexes eligible
All
Accepts healthy volunteers
No
Sampling method
Non-probability sample

Study population

The study population consists of adult patients with gastrointestinal adenocarcinoma treated at a tertiary care academic center in the Federal State of Brandenburg, Germany. The population is derived from routine clinical practice and includes patients whose cases were evaluated in a multidisciplinary tumor board.

Inclusion criteria

  • Histologically confirmed pancreatic, gastric, or colorectal adenocarcinoma
  • Treatment discussed in a multidisciplinary tumor board

Exclusion criteria

Exclusion Criteria:

  • Non-adenocarcinoma histology
05

Study design

Observational model
Cohort
Time perspective
Retrospective
Enrollment
30 participants (actual)
Patient registry
No

Groups and cohorts

  • Pancreatic cancer

    Patients with pancreatic cancer

    Other: Treatment recommendation according to official German cancer guideline · Other: Treatment recommendation of a LLM · Other: Treatment recommendation of a multidisciplinary tumor board

  • Gastric cancer

    Patients with gastric cancer

    Other: Treatment recommendation according to official German cancer guideline · Other: Treatment recommendation of a LLM · Other: Treatment recommendation of a multidisciplinary tumor board

  • Colorectal cancer

    Patients with colorectal cancer

    Other: Treatment recommendation according to official German cancer guideline · Other: Treatment recommendation of a LLM · Other: Treatment recommendation of a multidisciplinary tumor board

Interventions

  • OtherTreatment recommendation according to official German cancer guideline

    Detailed treatment recommendation according to the official guideline of the Association of the Scientific Medical Societies in Germany (AWMF; Arbeitsgemeinschaft der Wissenschaftlichen Medizinischen Fachgesellschaften),

  • OtherTreatment recommendation of a LLM

    Structured clinical case summaries were analyzed by a GPT-4-class large language model to generate treatment recommendations.

  • OtherTreatment recommendation of a multidisciplinary tumor board

    Detailed treatment recommendation according to the case-specific postoperative tumor board review.

06

What researchers measure

Primary outcomes

  1. Concordance with guideline-based management

    Agreement between LLM-generated recommendations and AWMF guideline-supported treatment strategies

    Time frame: At the time of multidisciplinary tumor board evaluation up to 4 weeks after surgery

Secondary outcomes

  1. Concordance with multidisciplinary tumor board decisions

    Agreement between LLM-generated recommendations and tumor board treatment strategies

    Time frame: At the time of multidisciplinary tumor board evaluation up to 4 weeks after surgery

  2. Reproducibility of LLM recommendations across repeated runs

    Structured clinical case vignettes were entered into ChatGPT using a standardized prompt template. To assess within-model reproducibility, each clinical vignette was analyzed in 3 independent model sessions performed on different days using identical clinical input.

    Time frame: At the time of multidisciplinary tumor board evaluation up to 4 weeks after surgery

  3. Characterization of discordant recommendations (e.g., overtreatment, undertreatment)

    Overtreatment was defined as an LLM-generated recommendation exceeding the intensity of the reference recommendation. Undertreatment was defined as omission of a recommended treatment or recommendation of a less intensive strategy.

    Time frame: At the time of multidisciplinary tumor board evaluation up to 4 weeks after surgery

07

Study locations

1 site
  • University Hospital Brandenburg
    Brandenburg an der Havel, Brandenburg 14770, Germany
08

References and documents

Individual participant data

Plan to share: No — Individual participant data will not be shared. The dataset consists of retrospective, pseudonymized clinical data from a single institution, and sharing is restricted due to data protection regulations and institutional policies.

No publications or documents are linked to this record.

09

Updates

Tracking since Sep 25, 2026
No changes since tracking began. The registry record was last updated on May 18, 2026, before this site started recording changes on Sep 25, 2026. Its history is on ClinicalTrials.gov ↗
10

Registry details

Key details

Study ID
NCT07592338
Lead sponsor
Medizinische Hochschule Brandenburg Theodor Fontane
Responsible party
Rene Mantke (Principal investigator, Medizinische Hochschule Brandenburg Theodor Fontane) — Principal investigator
First posted
May 18, 2026
Start date
Jan 1, 2025
Primary completion
Jan 1, 2026
Completion
Feb 25, 2026
Last update
May 18, 2026

Oversight

Data monitoring committee
No
FDA-regulated drug
No
FDA-regulated device
No
View the source record on ClinicalTrials.gov ↗

Not currently enrolling

This study is completed, as verified in May 2026. You cannot join it, but the record below documents what was studied.

Follow this study

Get an email when the registry record changes — status, dates, results — or when someone posts here.

Sign in to follow

Discussion

Questions and observations about this study, from anyone following it. Not medical advice, and not a channel to the study team — their contact details are on the registry record.

Sign in to join the discussion. Reading takes no account; posting does. You choose a display name, and a pseudonym is the default.

Nothing here yet. If you are running this trial, taking part in it, or weighing whether to, this is the place to say so.

Start the discussion