CClinicalTrials.gg
CompletedNCT06576232REALITYUpdated Aug 28, 2024

Standalone Observational Study Assessing the Performance of an AI/ML Tech-based SaMD on Chest LDCT Images (REALITY)

An observational study in High Risk Cancer, sponsored by Median Technologies. Completed at 5 sites in 2 countries. Open to participants aged 50 Years to 80 Years, including healthy volunteers. Per ClinicalTrials.gov, last updated 2024-08-28.

Sponsored by Median Technologies · Observational

Study type
Observational
Model
Cohort
Time perspective
Retrospective
Enrollment
1,147
Ages
50 Years to 80 Years
Sex
All
01

Study summary

This is a Multinational, Multicenter, retrospective study for the evaluation of the standalone efficacy and safety of an Artificial Intelligence/Machine Learning (AI/ML) technology-based end-to-end Computer assisted Detection/Computer Assisted Diagnosis (CADe/CADx) Software as a Medical Device (SaMD) developed to detect, localize and characterize malignant, and suspicious for lung cancer nodules on Low Dose Computed Tomography (LDCT) scans taken as part of a Lung Cancer Screening (LCS) program.

LDCT Digital Imaging and Communications in Medicine (DICOM) images of patients who underwent lung cancer screening were selected and included into the study. Selected scans will then be analyzed by the CADe/CADx SaMD and compared to radiologist generated reference standards including lesions localization and lesion cancer diagnosis.

Figures of merit at patient level and lesion level detection and diagnostic efficacy will be calculated as well as sub-class analysis to ensure algorithm performance generalizability.

02

Conditions studied

  • High Risk Cancer
03

In context

Lead sponsor

Median Technologies is the lead sponsor of 3 studies on the registry; none are open to participants now.

Counted across the registry records on this site, refreshed daily.

04

Who can participate

Ages eligible
50 Years to 80 Years
Sexes eligible
All
Accepts healthy volunteers
Yes
Sampling method
Probability sample

Study population

High risk lung cancer population from Radiology or Pneumology hospital departments.

Patients enrolled in this study were retrospectively collected from centers across the EU and USA where they were enlisted into lung cancer screening due to high risk of lung cancer according to established lung cancer screening guidelines.

The cohort used for testing the efficacy and safety of the device will be an "enriched cohort" with a 1:2 distribution of cancer positive and benign patients

Inclusion criteria

  • ≥50-80 Years of age;
  • Current or ex-smoker (>=20 pack years);
  • Patient screened and surveilled for lung cancer screening following lung cancer screening guidelines (equivalent to United States Preventive Services Task Force (USPSTF) 2021 Criteria);
  • Received LDCT due to inclusion in high-risk category for lung cancer.

Exclusion criteria

Exclusion Criteria:

  • Prior lung resection;
  • Pacemaker or other indwelling metallic medical devices in the thorax that interfere with CT acquisition;
  • Patients/images used during AI model development;
  • Patients with only hilar and/or mediastinal cancer(s);
  • Patients with only ground glass cancer(s);
  • Patients with nodules, solid or part-solid >30mm (masses);
  • Patients that are not accompanied with the required clinical information;
  • Patients with imaging with any of the following: missing slices, slice thickness >3mm;
  • Partial cover of the lung.
05

Study design

Observational model
Cohort
Time perspective
Retrospective
Enrollment
1,147 participants (actual)
Patient registry
No

Interventions

  • DeviceMedian LCS

    End-to-end processing of chest LDCT DICOM images by an AI/ML tech-based SaMD to detect, localize, and characterize (assign a malignancy score) each detected pulmonary nodule. The output of the device is a DICOM File (Median LCS result report) summarizing results per patient.

    Also known as: eyonis LCS

06

What researchers measure

Primary outcomes

  1. AUROC (Area under ROC curve) at patient level

    AUROC that measures Median LCS performance at patient level is strictly superior to 0.8. Support for Primary Endpoint: Derived from the patient level AUROC at the product fixed operating point : Sensitivity, Specificity, PPV, NPV.

    Time frame: 12 months

Secondary outcomes

  1. Sensitivity > 70% when Specificity=70%

    Time frame: 12 months

  2. Specificity > 70% when Sensitivity=70%

    Time frame: 12 months

  3. AUC of LROC > 0.75

    In contrast to the receiver operating characteristic (ROC) assessment paradigm, localization ROC (LROC) analysis provides a means to jointly assess the accuracy of localization and detection in an observational study.

    Time frame: 12 months

  4. Detection sensitivity>0.8 with average FP rate per scan<1

    Time frame: 12 months

  5. ICC>0.8 for average diameter

    Intraclass Correlation Coefficient (ICC), is a descriptive statistic that can be used when quantitative measurements are made on units that are organized into groups. It describes how strongly units in the same group resemble each other.

    Time frame: 12 months

  6. ICC>0.8 for long axis diameter

    Time frame: 12 months

  7. ICC>0.8 for short axis diameter

    Time frame: 12 months

  8. ICC>0.75 for Volume

    Time frame: 12 months

  9. DICE Coefficient >0.7

    Time frame: 12 months

07

Study locations

5 sites
  • University of Pennsylvania - Penn Center for Innovation
    Philadelphia, Pennsylvania 19104, United States
  • Baptist Clinical Research Institute
    Memphis, Tennessee 38120, United States
  • The University of Texas M.D. Anderson Cancer Center
    Houston, Texas 77030, United States
  • Fundacion instituto de investigacion sanitaria de la fundacion jimenez diaz (FJD)
    Madrid, 28040, Spain
  • Universidad de Navarra
    Pamplona, 31009, Spain
08

Updates

Tracking since Sep 25, 2026
No changes since tracking began. The registry record was last updated on Aug 28, 2024, before this site started recording changes on Sep 25, 2026. Its history is on ClinicalTrials.gov ↗
09

Registry details

Key details

Study ID
NCT06576232
Lead sponsor
Median Technologies
Responsible party
Sponsor
First posted
Aug 28, 2024
Start date
Sep 21, 2022
Primary completion
Jul 24, 2024
Completion
Aug 21, 2024
Last update
Aug 28, 2024

Study contacts

Anil VACHANI, MD
principal investigator · University of Pennsylvania

Oversight

Data monitoring committee
No
FDA-regulated drug
No
FDA-regulated device
Yes
View the source record on ClinicalTrials.gov ↗

Not currently enrolling

This study is completed, as verified in Aug 2024. You cannot join it, but the record below documents what was studied.

Follow this study

Get an email when the registry record changes — status, dates, results — or when someone posts here.

Sign in to follow

Discussion

Questions and observations about this study, from anyone following it. Not medical advice, and not a channel to the study team — their contact details are on the registry record.

Sign in to join the discussion. Reading takes no account; posting does. You choose a display name, and a pseudonym is the default.

Nothing here yet. If you are running this trial, taking part in it, or weighing whether to, this is the place to say so.

Start the discussion