ClinicalTrials.gg
CompletedNCT06221397LEGIT_MC_EVCDAUpdated Mar 16, 2026Results posted

AI-based Medical Device Validation for Early Melanoma Detection

An observational study in Melanoma and Melanoma, Skin, sponsored by AI Labs Group S.L. Completed at 1 site in Spain. Open to participants aged 18 Years and older. Per ClinicalTrials.gov, last updated 2026-03-16.

Sponsored by AI Labs Group S.L · Observational

Study type
Observational
Model
Case-only
Time perspective
Cross-sectional
Enrollment
105
Ages
18 Years and older
Sex
All
01

Study summary

The goal of this observational study is to learn if a computer-aided diagnosis (CAD) system can help identify skin cancer (cutaneous melanoma). The research focuses on adults who have skin spots that a doctor thinks might be cancerous. The main questions the study aims to answer are:

Can the artificial intelligence (AI) tool accurately identify melanoma in skin images?

How does the tool's accuracy compare to the clinical judgment of expert skin doctors (dermatologists)?

Researchers will compare the results from the AI tool to the final diagnosis made by doctors or through a skin biopsy. A biopsy is a medical test where a small piece of skin is removed and checked in a lab.

Participants will:

Have their skin spots photographed using a special camera attached to a smartphone.

Allow researchers to use their clinical data and biopsy results for the study.

The study does not change the medical care participants receive. Doctors will continue to treat participants as they normally would. By testing this tool, researchers hope to find a way to detect skin cancer earlier and more accurately

Read the detailed description

This study is designed to clinically validate a computer-aided diagnosis (CAD) system that utilizes artificial intelligence (AI) and machine vision to assist in the detection of cutaneous melanoma in its early stages. Cutaneous melanoma is a form of skin cancer that is treatable when identified early; however, differentiating early melanoma from benign skin lesions during visual examination presents a challenge for healthcare professionals.

Study Design and Methodology The research is a prospective, observational, and cross-sectional study conducted at Hospital Universitario Cruces and Hospital Universitario Basurto in Spain. The protocol evaluates the diagnostic performance of an AI device using clinical images without interfering with routine patient care.

  • Participant Selection: The study focuses on adults with skin lesions suspected of malignancy during regular clinical visits.
  • Image Acquisition: Researchers capture photographs of skin lesions using a smartphone equipped with a specialized dermoscopic camera.
  • Data Collection: Clinical and demographic data, such as age and sex, are collected alongside the digital images.
  • Preprocessing: All images undergo a standardized preprocessing step where the lesion is cropped to minimize background noise for the algorithm.
  • AI Analysis: The system processes the cropped images to generate a malignancy probability and a list of possible disease categories.
  • Reference Standard: AI predictions are compared against a composite "Gold Standard." This standard is based on pathological anatomy results from a biopsy or, where a biopsy is not clinically indicated, the consensus diagnosis of expert dermatologists with extensive clinical experience.

Study Phases and Sample Size Plan

The investigation was planned in two phases to ensure a representative dataset:

  • Initial Phase: An initial pilot phase to assess the preliminary workflow.
  • Extension Phase: A second phase intended to broaden the sample to include a wider range of benign lesions, such as nevi, to better reflect the distribution of cases seen in daily clinical practice.
  • Sample Size Target: The study was designed to recruit participants until a sufficient number of confirmed melanoma cases were achieved to provide the statistical power required to validate the device's performance metrics.

Performance Evaluation Measures

The device's effectiveness is evaluated through the following pre-specified statistical metrics:

  • Primary Metrics: Area Under the ROC Curve (AUC), sensitivity, and specificity for the detection of melanoma.
  • Secondary Metrics: Top-K accuracy (evaluating if the correct diagnosis is within the top 1, 3, or 5 predictions) and malignancy prediction values, including Positive Predictive Value (PPV) and Negative Predictive Value (NPV).
  • Safety Assessment: The protocol includes the systematic recording of any adverse events or product deficiencies encountered during the use of the device to evaluate its safety profile as a clinical decision-support tool.
02

Conditions studied

  • Melanoma
  • Melanoma, Skin

Keywords

  • melanoma
  • primary care
  • dermatology
  • diagnosis
  • Artificial Intelligence
  • Severity
03

In context

Melanoma

3,370 studies on the registry are indexed under Melanoma; 578 are open to participants now.

This study's enrollment of 105 is below the median of 187 across 488 observational studies indexed under Melanoma.

Browse Melanoma studies →

Lead sponsor

AI Labs Group S.L is the lead sponsor of 8 studies on the registry; 1 is open to participants now.

Counted across the registry records on this site, refreshed daily.

04

Who can participate

Ages eligible
18 Years and older
Sexes eligible
All
Accepts healthy volunteers
No
Sampling method
Non-probability sample

Study population

Patients with skin lesions with suspected malignancy seen at the Dermatology Department of the Hospital Universitario Cruces and Hospital Universitario Basurto.

Go through the criteria one by one — yes, no or not sure — and take the list to your doctor or the study team. Kept in this browser only.

Inclusion criteria

  • Patients with skin lesions with suspected
  • Age over 18 years old
  • Patients who consent to participate in the study by signing the form

Exclusion criteria

Exclusion Criteria:

  • Patients under 18 years of age
Terms in these criteria, in plain language(2)

Underlined terms in the criteria open these too. Explained by clinicaltrials.gg, not part of the registry record. The study team decides who can take part.

Cancer (malignancy)

Malignancy means cancer. Criteria about another or earlier malignancy ask whether you have had a different cancer, usually within a set number of years.

Some are commonly allowed, such as treated skin cancers other than melanoma and early cancers removed completely — check the exceptions this study lists.

Informed consent

Before you join, the study team explains what taking part involves — its purpose, what happens, the risks and possible benefits — and answers your questions, so you can decide freely. Consent is usually recorded on a form (the informed consent form, ICF) signed by you or, where the law allows, by someone legally authorised to decide for you.

You can keep asking questions during the study, you are told of new information that matters, and you can choose to leave at any time.

05

Study design

Observational model
Case-only
Time perspective
Cross-sectional
Enrollment
105 participants (actual)
Target follow-up
1 Day
Patient registry
Yes

Groups and cohorts

  • Patients with suspected cutaneous malignancy

    Group/Cohort Description The study group consists of adult patients (over 18 years old) who presented at the Dermatology Departments of Hospital Universitario Cruces and Hospital Universitario Basurto with skin lesions suspected of being malignant. As this is an observational study, participants were not assigned to any new medical interventions, drugs, or treatments as part of the research protocol.

    Device: AI-based Computer-Aided Diagnosis (CAD) Software for Skin Lesion Analysis.

Interventions

  • DeviceAI-based Computer-Aided Diagnosis (CAD) Software for Skin Lesion Analysis.

    The intervention is a software-only medical device that utilizes artificial intelligence and machine vision algorithms to analyze digital images of the skin. Unlike traditional diagnostic tools, this system is designed to provide quantitative data on visible clinical signs and an interpretative distribution of possible disease categories (ICD codes). Key Distinguishing Features Non-Invasive Diagnostic Support: It acts as a clinical decision-support tool to help practitioners prioritize patients based on malignancy risk, rather than providing a standalone or confirmatory diagnosis. Broad ICD Recognition: While many tools focus only on melanoma, this system is capable of recognizing a variety of ICD categories, including basal cell carcinoma, nevi, and dermatofibroma Advanced Image Preprocessing: The system includes a Dermatology Image Quality Assessment (DIQA) algorithm to ensure images have sufficient visual quality before analysis.

06

What researchers measure

Primary outcomes

  1. Area Under the ROC Curve (AUC) for Melanoma Detection

    Measures the device's ability to distinguish between melanoma and non-melanoma cases using predicted probabilities.

    Time frame: At the time of the single clinical visit (Baseline).

  2. Accuracy for Melanoma Detection

    Accuracy represents the percentage of all cases where the AI software's primary (top-ranked) prediction correctly matched the confirmed medical diagnosis. The "confirmed diagnosis" was determined by either a laboratory biopsy (the gold standard) or a consensus of expert dermatologists. To calculate this, the AI analyzed high-resolution dermoscopic images of skin lesions. The software succeeded if its highest-probability diagnosis category matched the actual disease category of the lesion. Only images meeting a minimum visual quality score (DIQA ≥ 5) were included in this analysis to ensure the results reflect performance in a professional clinical setting.

    Time frame: At the time of the single clinical visit (Baseline)

  3. Sensitivity for Melanoma Detection

    The percentage of true positive melanoma cases correctly identified by the device.

    Time frame: At the time of the single clinical visit (Baseline).

  4. Specificity for Melanoma Detection

    The percentage of true negative (benign) cases correctly identified by the device.

    Time frame: At the time of the single clinical visit (Baseline).

Secondary outcomes

  1. Top-1 Accuracy for Multiple ICD Categories

    Evaluates if the correct diagnosis is within the Top-1 predictions across various skin disease categories (International Classification of Diseases).

    Time frame: At the time of the single clinical visit (Baseline).

  2. Top-3 Accuracy for Multiple ICD Categories

    Evaluates if the correct diagnosis is within the Top-3 predictions across various skin disease categories (International Classification of Diseases).

    Time frame: At the time of the single clinical visit (Baseline).

  3. Top-5 Accuracy for Multiple ICD Categories

    Evaluates if the correct diagnosis is within the Top-5 predictions across various skin disease categories (International Classification of Diseases).

    Time frame: At the time of the single clinical visit (Baseline).

  4. Area Under the ROC Curve (AUC) for Malignancy Detection

    Includes AUC, Sensitivity, and Specificity for detecting any malignant lesion (not limited to melanoma).

    Time frame: At the time of the single clinical visit (Baseline).

  5. Sensitivity for Multiple Malignant Conditions Detection

    The percentage of true positive malignant cases correctly identified by the device.

    Time frame: At the time of the single clinical visit (Baseline).

  6. Specificity for Multiple Malignant Conditions Detection

    The percentage of true negative (benign) cases correctly identified by the device.

    Time frame: At the time of the single clinical visit (Baseline).

  7. Predictive Values (PPV and NPV) for Malignancy

    Measures the Positive Predictive Value (PPV) and Negative Predictive Value (NPV) to determine the probability that a "malignant" or "benign" result from the device is correct.

    Time frame: At the time of the single clinical visit (Baseline).

07

Results

Posted Mar 16, 2026
Limitations and caveats
The study's primary limitation was a smaller final sample size (105 participants) compared to the initial target (200), primarily due to the COVID-19 pandemic's impact on clinical recruitment. Additionally, the reliance on a specific hardware setup (DermLite Foto X and smartphones) means results may not generalize to all photographic equipment. Lastly, the exclusion of low-quality images (DIQA \< 5) implies the AI's performance depends on the user's ability to capture clear photos.

Participant flow

Recruitment took place at the Dermatology Departments of Hospital Universitario Cruces and Hospital Universitario Basurto. Starting September 17, 2020, researchers used consecutive sampling to find adult patients with skin lesions suspected of malignancy. The process ended on November 13, 2023, after reaching a target ratio of melanoma cases. Investigators assessed eligibility during routine clinical visits.

Participant flow — Overall Study
MilestonePatients With Suspected Cutaneous Malignancy
Started105
Completed103
Not completed2
Withdrew: Two participants were excluded from the final analysis due to non-conclusive clinical diagnoses.2

Outcome measures

PrimaryArea Under the ROC Curve (AUC) for Melanoma Detection

Measures the device's ability to distinguish between melanoma and non-melanoma cases using predicted probabilities.

Time frame:
At the time of the single clinical visit (Baseline).
Reported as:
Number · Probability area (value from 0 to 1)
Area Under the ROC Curve (AUC) for Melanoma Detection
Probability area (value from 0 to 1)Patients With Suspected Cutaneous Malignancy
Area Under the ROC Curve (AUC) for Melanoma Detection0.8482 (0.7629 to 0.9222)
PrimaryAccuracy for Melanoma Detection

Accuracy represents the percentage of all cases where the AI software's primary (top-ranked) prediction correctly matched the confirmed medical diagnosis. The "confirmed diagnosis" was determined by either a laboratory biopsy (the gold standard) or a consensus of expert dermatologists. To calculate this, the AI analyzed high-resolution dermoscopic images of skin lesions. The software succeeded if its highest-probability diagnosis category matched the actual disease category of the lesion. Only images meeting a minimum visual quality score (DIQA ≥ 5) were included in this analysis to ensure the results reflect performance in a professional clinical setting.

Time frame:
At the time of the single clinical visit (Baseline)
Reported as:
Number · Proportion of correct cases
Accuracy for Melanoma Detection
Proportion of correct casesPatients With Suspected Cutaneous Malignancy
Accuracy for Melanoma Detection0.81 (0.65 to 0.94)
PrimarySensitivity for Melanoma Detection

The percentage of true positive melanoma cases correctly identified by the device.

Time frame:
At the time of the single clinical visit (Baseline).
Reported as:
Number · Proportion of true positives
Sensitivity for Melanoma Detection
Proportion of true positivesPatients With Suspected Cutaneous Malignancy
Sensitivity for Melanoma Detection0.93 (0.88 to 0.98)
PrimarySpecificity for Melanoma Detection

The percentage of true negative (benign) cases correctly identified by the device.

Time frame:
At the time of the single clinical visit (Baseline).
Reported as:
Number · Proportion of true negatives
Specificity for Melanoma Detection
Proportion of true negativesPatients With Suspected Cutaneous Malignancy
Specificity for Melanoma Detection0.80 (0.69 to 0.82)
SecondaryTop-1 Accuracy for Multiple ICD Categories

Evaluates if the correct diagnosis is within the Top-1 predictions across various skin disease categories (International Classification of Diseases).

Time frame:
At the time of the single clinical visit (Baseline).
Reported as:
Number · Proportion of correct matches
Top-1 Accuracy for Multiple ICD Categories
Proportion of correct matchesPatients With Suspected Cutaneous Malignancy
Top-1 Accuracy for Multiple ICD Categories0.55 (0.45 to 0.65)
SecondaryTop-3 Accuracy for Multiple ICD Categories

Evaluates if the correct diagnosis is within the Top-3 predictions across various skin disease categories (International Classification of Diseases).

Time frame:
At the time of the single clinical visit (Baseline).
Reported as:
Number · Proportion of correct matches
Top-3 Accuracy for Multiple ICD Categories
Proportion of correct matchesPatients With Suspected Cutaneous Malignancy
Top-3 Accuracy for Multiple ICD Categories0.7569 (0.67 to 0.83)
SecondaryTop-5 Accuracy for Multiple ICD Categories

Evaluates if the correct diagnosis is within the Top-5 predictions across various skin disease categories (International Classification of Diseases).

Time frame:
At the time of the single clinical visit (Baseline).
Reported as:
Number · Proportion of correct matches
Top-5 Accuracy for Multiple ICD Categories
Proportion of correct matchesPatients With Suspected Cutaneous Malignancy
Top-5 Accuracy for Multiple ICD Categories0.8422 (0.76 to 0.9)
SecondaryArea Under the ROC Curve (AUC) for Malignancy Detection

Includes AUC, Sensitivity, and Specificity for detecting any malignant lesion (not limited to melanoma).

Time frame:
At the time of the single clinical visit (Baseline).
Reported as:
Number · Probability area (value from 0 to 1)
Area Under the ROC Curve (AUC) for Malignancy Detection
Probability area (value from 0 to 1)Patients With Suspected Cutaneous Malignancy
Area Under the ROC Curve (AUC) for Malignancy Detection0.90 (0.84 to 0.94)
SecondarySensitivity for Multiple Malignant Conditions Detection

The percentage of true positive malignant cases correctly identified by the device.

Time frame:
At the time of the single clinical visit (Baseline).
Reported as:
Number · Proportion of true positives
Sensitivity for Multiple Malignant Conditions Detection
Proportion of true positivesPatients With Suspected Cutaneous Malignancy
Sensitivity for Multiple Malignant Conditions Detection0.81 (0.72 to 0.88)
SecondarySpecificity for Multiple Malignant Conditions Detection

The percentage of true negative (benign) cases correctly identified by the device.

Time frame:
At the time of the single clinical visit (Baseline).
Reported as:
Number · Proportion of true negatives
Specificity for Multiple Malignant Conditions Detection
Proportion of true negativesPatients With Suspected Cutaneous Malignancy
Specificity for Multiple Malignant Conditions Detection0.86 (0.77 to 0.94)
SecondaryPredictive Values (PPV and NPV) for Malignancy

Measures the Positive Predictive Value (PPV) and Negative Predictive Value (NPV) to determine the probability that a "malignant" or "benign" result from the device is correct.

Time frame:
At the time of the single clinical visit (Baseline).
Reported as:
Number · Proportion of correct predictions
Predictive Values (PPV and NPV) for Malignancy
Proportion of correct predictionsPatients With Suspected Cutaneous Malignancy
Positive Predictive Value (PPV)0.9247 (0.85 to 0.97)
Negative Predictive Value (NPV)0.6789 (0.54 to 0.81)

Adverse events

Collected over At the baseline visit. Non-serious events are listed at a 0% frequency threshold.

Adverse event summary by group
GroupDeathsSeriousOther
Patients With Suspected Cutaneous Malignancy0/105 (0%)0/105 (0%)0/105 (0%)

Baseline characteristics

Age, Continuous
Age, Continuous(years)Patients With Suspected Cutaneous Malignancy
Mean62.1 ± 17.6
Sex: Female, Male
Sex: Female, Male(Participants)Patients With Suspected Cutaneous Malignancy
Female53
Male52
Race (NIH/OMB)
Race (NIH/OMB)(Participants)Patients With Suspected Cutaneous Malignancy
American Indian or Alaska Native0
Asian0
Native Hawaiian or Other Pacific Islander0
Black or African American0
White102
More than one race3
Unknown or Not Reported0
Region of Enrollment
Region of Enrollment(Participants)Patients With Suspected Cutaneous Malignancy
Spain105
Baseline Image Quality (DIQA Score)
Baseline Image Quality (DIQA Score)(Units on the DIQA Scale.)Patients With Suspected Cutaneous Malignancy
Median71.4 (22.8 to 87)
08

Study locations

1 site
  • University Hospital of Cruces
    Barakaldo, Biscay 48903, Spain
09

References and documents

Study documents

PDFs hosted by the registry, ClinicalTrials.gov.

Individual participant data

Plan to share: Undecided

10

Timeline

Tracking since Sep 25, 2026
ElapsedEstimatedEstimated, not yet reached

Ran from Sep 2020 to primary completion in Nov 2023, 37 months.

Results were first posted in Mar 2026, 2 years 4 months after primary completion.

How these figures are worked out, and which studies are left out of them.

Registered
Jan 15, 2024
First posted
Jan 24, 2024
StartActual
Sep 17, 2020
Primary completionActual
Nov 13, 2023
CompletionActual
Nov 13, 2023
Results first posted
Mar 16, 2026
Last update
Mar 16, 2026
What these dates mean
Start.
When the first participant enrolled; while estimated, when the study expects to open to recruitment.
Primary completion.
When the last participant was examined or treated to collect data for the study's main question, its primary outcome. A study that stopped early gives the date its data collection stopped.
Completion.
When the last participant's last visit took place, for every outcome, secondary ones and side effects included: the end of the study. Often later than primary completion, sometimes the same day.
Actual and Est.
Actual means the registry says the date has happened. Est. (estimated) is a date the sponsor plans or expects. It can still move, and the sponsor is expected to change it to actual once it has passed.
No changes since tracking began. The registry record was last updated on Mar 16, 2026, before this site started recording changes on Sep 25, 2026. Its history is on ClinicalTrials.gov ↗
11

Registry details

Key details

Study ID
NCT06221397
Lead sponsor
AI Labs Group S.L
Collaborators
Servicio Vasco de Salud Osakidetza, Spain, Osakidetza, Hospital de Basurto, Hospital de Cruces
Responsible party
Sponsor
First posted
Jan 24, 2024
Start date
Sep 17, 2020
Primary completion
Nov 13, 2023
Completion
Nov 13, 2023
Results posted
Mar 16, 2026
Last update
Mar 16, 2026

Study contacts

Jesús Gardeazabal, PhD
principal investigator · Hospital de Cruces
Rosa María Ize, PhD
principal investigator · Hospital Universitario Basurto

Oversight

Data monitoring committee
No
FDA-regulated drug
No
FDA-regulated device
No
View the source record on ClinicalTrials.gov ↗

Not currently enrolling

This study is completed, as verified in Feb 2026. You cannot join it, but the record below documents what was studied.

Follow this study

Get an email when the registry record changes — status, dates, results — or when someone posts here.

Sign in to follow

Discussion

Questions and observations about this study, from anyone following it. Not medical advice, and not a channel to the study team — their contact details are on the registry record.

Sign in to join the discussion. Reading takes no account; posting does. You choose a display name, and a pseudonym is the default.

Nothing here yet. If you are running this trial, taking part in it, or weighing whether to, this is the place to say so.

Start the discussion