CClinicalTrials.gg
CompletedNCT07246018Updated Nov 24, 2025

Accuracy and Reliability of Artificial Intelligence Cephalometric Analysis Software Compared to Manual Tracing

An observational study in Cephalometry, Orthodontic and Cephalometric Analysis, sponsored by International Islamic University Malaysia. Completed at 1 site in Malaysia. Per ClinicalTrials.gov, last updated 2025-11-24.

Sponsored by International Islamic University Malaysia · Observational

Study type
Observational
Model
Cohort
Time perspective
Prospective
Enrollment
40
Sex
All
01

Study summary

This study compares the accuracy and reliability of artificial intelligence (AI) software for analyzing dental X-rays to the traditional manual tracing method used by dentists.

Lateral cephalometric radiographs are special X-rays of the head used in orthodontics (teeth straightening) to measure jawbone positions, tooth angles, and facial proportions. Traditionally, orthodontists manually trace these X-rays using pencil and paper to identify key landmarks and make measurements. This manual method is time-consuming and can vary between different practitioners or even when the same practitioner measures twice.

AI-based software can automatically identify these landmarks and perform measurements instantly. This study examined 40 dental X-rays to determine if the AI software (WeDoCeph) is as accurate and more reliable than manual tracing.

Each X-ray was measured twice - once manually by a trained examiner and once by AI software - at two different times (4 weeks apart). The researchers compared 15 different measurements, including 8 angles and 7 distances, to assess accuracy and reliability.

Read the detailed description

Lateral cephalometric analysis is essential for orthodontic diagnosis and treatment planning. The traditional manual tracing method involves identifying anatomical landmarks on radiographs using pencil, ruler, and protractor, which is subjective, time-consuming, and prone to intra- and inter-observer variability.

This diagnostic accuracy study evaluated the WeDoCeph AI-based cephalometric analysis software against conventional manual tracing. The study used a comparative repeated-measures design where each radiograph was analysed by both methods at two time points (T₀ and T₁, separated by 4 weeks) to assess both accuracy and reliability.

Sample size calculation was based on 95% power and a 0.05 significance level, resulting in 40 lateral cephalometric radiographs. All measurements included angular parameters (SNA, SNB, ANB, FMPA, MMPA, UIA, LIA, IIA) and linear parameters (A-N perpendicular, POG-N perpendicular, ANS-Me, SN, UFH, MxPI, MnPI).

Paired T-Test will be employed as the statistical analysis method for comparisons and Intraclass Correlation Coefficient (ICC) for reliability assessment. The study aimed to determine whether AI-based cephalometric analysis provides sufficient accuracy and superior reliability for clinical application in orthodontic practice.

02

Conditions studied

  • Cephalometry
  • Orthodontic
  • Cephalometric Analysis
03

In context

Lead sponsor

International Islamic University Malaysia is the lead sponsor of 16 studies on the registry; 4 are open to participants now.

Counted across the registry records on this site, refreshed daily.

04

Who can participate

Ages eligible
Child (0–17), Adult (18–64), Older adult (65+)
Sexes eligible
All
Accepts healthy volunteers
No
Sampling method
Non-probability sample

Study population

The study population consisted of radiographs from orthodontic patients at various stages of treatment, including both pretreatment (initial diagnostic) and post-treatment radiographs. All radiographs were high-quality digital or digitized lateral cephalograms suitable for landmark identification and measurement. Patients with surgical rigid fixations, orthodontic appliances visible on radiographs, or dental prostheses were excluded to ensure clear visualization of anatomical landmarks. Additionally, radiographs of very poor quality or from patients with diagnosed syndromes or craniofacial deformities were excluded to maintain consistency in anatomical structure assessment.

The unit of analysis is the cephalometric radiograph rather than individual patients, as each radiograph represents a single diagnostic assessment.

Inclusion criteria

  • Pretreatment/post-treatment lateral cephalometric radiographs
  • High-quality cephalograms with visible anatomical landmarks

Exclusion criteria

Exclusion Criteria:

  • Patients with surgical rigid fixations, orthodontic appliances and dental prostheses visible on radiographs
  • Very poor quality/diagnostically unacceptable radiographs
  • Patients with syndromes or with craniofacial deformities
05

Study design

Observational model
Cohort
Time perspective
Prospective
Enrollment
40 participants (actual)
Target follow-up
6 Months
Patient registry
Yes

Groups and cohorts

  • Orthodontic Patients with Lateral Cephalometric Radiographs

    Lateral cephalometric radiographs from 40 orthodontic patients collected between January 2023 and June 2023 from the Orthodontic Specialist Clinic. Each radiograph was analyzed using both manual tracing and AI-based software (WeDoCeph) at two time points (initial and 4 weeks later)

    Diagnostic Test: Manual Cephalometric Tracing · Diagnostic Test: AI-Based Cephalometric Analysis (WeDoCeph Software)

Interventions

  • Diagnostic testManual Cephalometric Tracing

    Conventional manual cephalometric analysis performed by trained examiner using traditional tracing technique. Lateral cephalometric radiographs are hand-traced in a darkened room using a view box for transillumination. A 25cm x 18cm radiographic film is used as the base, with a 21cm x 16cm matte acetate tracing paper taped over it. Hard and soft tissue cephalometric landmarks are manually identified and traced using a 0.3mm 2HB pencil. Angular measurements are obtained using a protractor, and linear measurements using a ruler. All 15 cephalometric measurements (8 angular: SNA, SNB, ANB, FMPA, MMPA, UIA, LIA, IIA; and 7 linear: A-N perpendicular, POG-N perpendicular, ANS-Me, SN, UFH, MxPI, MnPI) are calculated manually. Each radiograph is traced and analyzed twice at 4-week intervals by the same examiner to assess intra-examiner reliability.

  • Diagnostic testAI-Based Cephalometric Analysis (WeDoCeph Software)

    Automated cephalometric analysis using WeDoCeph artificial intelligence-based software. Digital lateral cephalometric radiographs are imported as high-quality JPEG images into the software platform. The AI system automatically identifies and traces cephalometric landmarks using deep learning algorithms, then instantly generates all measurements based on the predefined parameters. The same 15 cephalometric measurements obtained in manual tracing (8 angular: SNA, SNB, ANB, FMPA, MMPA, UIA, LIA, IIA; and 7 linear: A-N perpendicular, POG-N perpendicular, ANS-Me, SN, UFH, MxPI, MnPI) are automatically calculated by the software. Each radiograph is analyzed twice at 4-week intervals using the previously uploaded digital images to assess reproducibility and consistency of the AI system. No manual landmark identification or measurement calculation is required.

06

What researchers measure

Primary outcomes

  1. Intraclass Correlation Coefficient (ICC) for repeated manual measurements

    ICC calculated for all 15 cephalometric measurements (8 angular and 7 linear) performed manually at two time points to assess intra-examiner reliability

    Time frame: Baseline (T₀) and 4 weeks later (T₁)

  2. Intraclass Correlation Coefficient (ICC) for repeated AI measurements

    ICC calculated for all 15 cephalometric measurements performed by WeDoCeph software at two time points to assess consistency

    Time frame: Baseline (T₀) and 4 weeks later (T₁)

  3. Mean differences between manual and AI-based measurements at T₀

    Paired T-Test comparison of all 15 measurements between manual tracing and AI analysis at initial time point

    Time frame: Baseline (T₀)

  4. Mean differences between manual and AI-based measurements at T₁

    Paired T-Test comparison of all 15 measurements between manual tracing and AI analysis at 4-week time point

    Time frame: 4 weeks

Secondary outcomes

  1. Angular Measurements

    Comparison of angular cephalometric measurements between methods

    Time frame: Baseline (T₀) and 4 weeks (T₁)

  2. Linear Measurements

    Comparison of linear cephalometric measurements between methods

    Time frame: Baseline (T₀) and 4 weeks (T₁)

  3. Inter-examiner Reliability

    10% of radiographs were analyzed by three examiners to ensure inter-examiner agreement

    Time frame: During calibration phase

07

Study locations

1 site
  • Orthodontic Specialist Clinic, Kulliyyah of Dentistry
    Kuantan, Pahang 25200, Malaysia
08

References and documents

Publications

  • Alqahtani H. Evaluation of an online website-based platform for cephalometric analysis. J Stomatol Oral Maxillofac Surg. 2020 Feb;121(1):53-57. doi: 10.1016/j.jormas.2019.04.017. Epub 2019 May 3. PubMed 31059836 ↗
  • Kazimierczak W, Gawin G, Janiszewska-Olszowska J, Dyszkiewicz-Konwinska M, Nowicki P, Kazimierczak N, Serafin Z, Orhan K. Comparison of Three Commercially Available, AI-Driven Cephalometric Analysis Tools in Orthodontics. J Clin Med. 2024 Jun 26;13(13):3733. doi: 10.3390/jcm13133733. PubMed 38999299 ↗
  • Lee JH, Yu HJ, Kim MJ, Kim JW, Choi J. Automated cephalometric landmark detection with confidence regions using Bayesian convolutional neural networks. BMC Oral Health. 2020 Oct 7;20(1):270. doi: 10.1186/s12903-020-01256-7. PubMed 33028287 ↗

Study documents

  • Protocol, analysis plan and consent form · Nov 20, 2022

Documents are hosted by the registry — open the source record to download them.

Individual participant data

Plan to share: No — Individual participant data will not be made publicly available to protect patient privacy and confidentiality. The study involves radiographic images and associated measurements from orthodontic patients. Even with de-identification, radiographic images may be potentially identifiable. Data sharing was not included in the original ethics approval and informed consent process. Aggregate summary data and statistical results are available in the published manuscript.

09

Updates

Tracking since Sep 25, 2026
No changes since tracking began. The registry record was last updated on Nov 24, 2025, before this site started recording changes on Sep 25, 2026. Its history is on ClinicalTrials.gov ↗
10

Registry details

Key details

Study ID
NCT07246018
Lead sponsor
International Islamic University Malaysia
Responsible party
Siti Hajjar Nasir (Assistant Professor Dr., International Islamic University Malaysia) — Principal investigator
First posted
Nov 24, 2025
Start date
Jan 2, 2023
Primary completion
Jun 30, 2023
Completion
Jun 30, 2023
Last update
Nov 24, 2025

Oversight

Data monitoring committee
No
FDA-regulated drug
No
FDA-regulated device
No
View the source record on ClinicalTrials.gov ↗

Not currently enrolling

This study is completed, as verified in Jan 2023. You cannot join it, but the record below documents what was studied.

Follow this study

Get an email when the registry record changes — status, dates, results — or when someone posts here.

Sign in to follow

Discussion

Questions and observations about this study, from anyone following it. Not medical advice, and not a channel to the study team — their contact details are on the registry record.

Sign in to join the discussion. Reading takes no account; posting does. You choose a display name, and a pseudonym is the default.

Nothing here yet. If you are running this trial, taking part in it, or weighing whether to, this is the place to say so.

Start the discussion