CClinicalTrials.gg
Not yet recruitingNCT07468357Updated Mar 12, 2026

Human-AI Uncertainty Callibration for Improved Skin Lesion Segmentation

An interventional study of Base Model and FDM in Skin Lesions, sponsored by Copenhagen Academy for Medical Education and Simulation. Not yet recruiting. Per ClinicalTrials.gov, last updated 2026-03-12.

Sponsored by Copenhagen Academy for Medical Education and Simulation · Not applicable, Interventional, and Diagnostic

Phase
Not applicable
Study type
Interventional
Enrollment
50
Allocation
Randomized
Sex
All
01

Study summary

The goal of this randomized controlled study is to compare the effect of a new, personalized uncertainty-aware decision model (FDM) to a standard image recognition model in improving the diagnostic accuracy while reducing diagnostic uncertainty in experienced dermatologists tasked with differentiating between melanomas, moles and other benign skin lesions. The main question it aims to answer: Is the FDM a feasible method for an improved human AI partnership in which trust is build, misdiagnoses are avoided, and uncertainty is duly introduced or reduced.

The investigators expect to see only a slight increase in collective diagnostic accuracy for both interventions as the the human participants are skilled dermatologist and thus have high accuracies pre-intervention.

The investigators expect to see a higher increase in diagnostic certainty for the FDM intervention compared to the diagnostic certainty in the Base Model intervention.

The investigators expect to see a higher amount of diagnosis changes from incorrect to correct in the FDM group compared to the Base Model group.

The investigators do not expect any learning effect during the study.

Participants will start by answering a series of training cases consisting of images of skin lesions. These are used to train their individual FDM (only for the FDM-intervention group). From here, the participants will be randomized into two arms determining which of the two interventions they are exposed to. The participants will solve each case withouth any intervention first, and this reply will act as a control.

Read the detailed description

A detailed description of the FDM is presented in the references.

02

Conditions studied

  • Skin Lesions

Keywords

  • Dermatology
  • AI
  • Artificial Intelligence
  • Uncertainty Calibration
  • Dermoscopy
  • Bayesian Deep Learning
  • Human-AI Decision Model
03

Who can participate

Ages eligible
Child (0–17), Adult (18–64), Older adult (65+)
Sexes eligible
All
Accepts healthy volunteers
Yes

Inclusion criteria

  • Board certified dermatologists with clinical experience in dermoscopic diagnosis.

Exclusion criteria

Exclusion Criteria:

  • Doctors who have not yet finished their specialization and dermatologists.
  • Dermatologists without clinical experience in dermoscopic diagnosis.
04

Study design

Phase
Not applicable
Primary purpose
Diagnostic
Allocation
Randomized
Intervention model
Parallel assignment
Masking
None (open label)
Enrollment
50 participants (estimated)

Study arms

  • Active comparator
    Base Model

    The study participant is presented with a patient case including patient demographics (gender, age, placement of lesion) and two lesion images: 1 overview image, and 1 dermoscopic image. They are asked first to indicate an initial diagnosis along with their self-perceived uncertainty for this specific case before they receive Intervention 1. This initial diagnosis will act as the control. Intervention 1 is AI-generated multi-class probabilities (from a model trained on a large dataset of dermoscopic and overview images similar to the ones used for testing) and only the most likely diagnosis is presented accompanied by uncertainty estimates in percent. After the AI input, the study participant is given the chance to change their diagnosis and indicate any potential shift in uncertainty.

    Other: Base Model

  • Experimental
    FDM

    The initial diagnosis and indication of self-perceived uncertainty follows the same procedure as for Intervention 1. Intervention 2 is the most likely diagnosis accompanied by a calibrated uncertainty generated by the FDM model (i.e. trained on the study participants previous answers + the crowd annotations on the training data + the base model prediction). After the AI input, the study participant is given the chance to change their diagnosis and indicate any potential shift in uncertainty.

    Other: FDM

Interventions

  • OtherBase Model

    See arm description.

    Also known as: Intervention 1

  • OtherFDM

    See arm description

    Also known as: Final Decision Model, Intervention 2

05

What researchers measure

Primary outcomes

  1. Accuracy

    Diagnostic accuracy in differentiating between melanoma, nevus, and benign keratosis. Defined as the percentage of correct diagnoses. Ground truth is based on histopathologically verified diagnoses.

    Time frame: Immediately after the intervention.

Secondary outcomes

  1. Uncertainty

    Changes in self-assesed uncertainty ranging from 0 (very uncertain) to 10 (very certain) from pre- to post-intervention.

    Time frame: Immediately after the intervention.

  2. Cut-off uncertainty

    The self-assessed uncertainty of cases where the participant has clicked a "would you like to discuss this case with a collegue"-button.

    Time frame: Immediately after the intervention.

Other outcomes

  1. Time

    Time from the start to finish of each case with a split time corresponding to the end of the control phase (the time "Show AI input"-button is clicked).

    Time frame: Immediately after the intervention.

06

Study locations

No study locations are listed for this record.

07

References and documents

Publications

  • Kampen, P.J.T. et al. (2026). Uncertainty-Aware Classification: A Human-Guided Bayesian Deep Learning Framework. In: Sudre, C.H., et al. Uncertainty for Safe Utilization of Machine Learning in Medical Imaging. UNSURE 2025. Lecture Notes in Computer Science, vol 16166. Springer, Cham. https://doi.org/10.1007/978-3-032-06593-3_19
08

Registry details

Key details

Study ID
NCT07468357
Lead sponsor
Copenhagen Academy for Medical Education and Simulation
Collaborators
Technical University of Denmark
Responsible party
Julie Renata Bjerremand (Principal Investigator, Copenhagen Academy for Medical Education and Simulation) — Principal investigator
First posted
Mar 12, 2026
Start date
Mar 1, 2026 (estimated)
Primary completion
Jul 2026 (estimated)
Completion
Nov 2026 (estimated)
Last update
Mar 12, 2026

Study contacts

Julie Renata Bjerremand
Contact
julierenata@outlook.com
+45 53593700
Martin Tolsgaard, Professor
study chair · Copenhagen Academy for Medical Education and Simulation

Oversight

Data monitoring committee
No
FDA-regulated drug
No
FDA-regulated device
No
View the source record on ClinicalTrials.gov ↗

Not currently enrolling

This study is not yet recruiting, as verified in Mar 2026. You cannot join it, but the record below documents what was studied.

Follow this study

Get an email when the registry record changes — status, dates, results — or when someone posts here.

Sign in to follow

Discussion

Questions and observations about this study, from anyone following it. Not medical advice, and not a channel to the study team — their contact details are on the registry record.

Sign in to join the discussion. Reading takes no account; posting does. You choose a display name, and a pseudonym is the default.

Nothing here yet. If you are running this trial, taking part in it, or weighing whether to, this is the place to say so.

Start the discussion