ClinicalTrials.gg
Not yet recruitingNCT07947524ASA-AGREEUpdated Nov 19, 2026

Agreement of ASA Physical Status Classification Among Anesthesia Residents, a Large Language Model, and Senior Anesthesiologist Consensus

An observational study in Anesthesia, Risk Assessment and Preoperative Care, sponsored by Kayseri City Hospital. Not yet recruiting at 1 site in Turkey (Türkiye). Open to participants aged 18 Years and older. Per ClinicalTrials.gov, last updated 2026-11-19.

Sponsored by Kayseri City Hospital · Observational

How we know

Updated Nov 19, 2026Newly registeredGo to Updates ↓

Help build ClinicalTrials.gg — short surveys, remote interviews or testing, in your language. Take part →

Study type
Observational
Model
Cohort
Time perspective
Prospective
Enrollment
330
Ages
18 Years and older
Sex
All
01

Study summary

The ASA Physical Status Classification is widely used in preoperative risk assessment, but agreement between raters is limited, particularly between ASA II and III. This prospective observational study compares the ASA class assigned to the same patients by three types of raters: anesthesia residents working in the preoperative anesthesia clinic, a large language model (LLM), and a consensus of two senior anesthesiologists, which is the reference standard.

Residents complete the standard preoperative evaluation form and assign an ASA class as part of routine care. A copy of the completed form, with patient identifiers and the resident's ASA class removed, is then given independently to the LLM and to the two senior anesthesiologists. No intervention is applied to participants and routine care is not changed.

The primary aim is to measure how closely the residents and the LLM agree with the expert consensus (weighted kappa). Secondary aims are agreement among all three raters, agreement between the two senior anesthesiologists, the direction of misclassification, and how often the LLM matches the consensus when the resident does not.

Read the detailed description

Background The ASA Physical Status Classification is the most widely used tool for describing a patient's preoperative health status. It depends on clinical judgment, and agreement between raters is limited, especially between ASA II and III. In teaching hospitals many preoperative evaluations are done by residents. Large language models can read a structured clinical record and return a classification, and their agreement with anesthesiologists needs to be examined on real preoperative clinic data.

Design and setting Prospective, single-center, observational validation study with three rater groups, conducted in the preoperative anesthesia outpatient clinic of Kayseri City Hospital. Eligible adult patients scheduled for elective surgery are enrolled consecutively after written informed consent.

Procedures The resident takes the history, examines the patient, reviews laboratory results and consultation reports, completes the standard preoperative evaluation form and assigns an ASA class, as in routine care. The completed form is copied digitally. The resident's ASA class is stored in a locked field and is not shown to any other rater until all ratings are complete.

Two further copies are prepared in which patient identifiers (name, archive number, date) and the resident's ASA class, including any ASA checkbox and the free-text assessment, are masked. One copy goes to the LLM and the other to the two senior anesthesiologists.

The LLM is Claude Opus 5.5 (Anthropic), used through the Claude web interface (claude.ai), as a clinician would use it in practice. A dedicated study account is used, with memory and personalization turned off and no custom instructions. Each masked form image is entered in a new chat with the same fixed prompt. The model is queried once per patient, its response is saved verbatim with a screenshot, and the ASA class is entered into the database independently by two investigators. No patient identifiers are sent to the model.

The two senior anesthesiologists (more than 10 years of experience, not involved in the patient's perioperative care) classify each masked form independently. When they disagree, they discuss the case and record a consensus class and the reason. The consensus class is the reference standard. Agreement between the two experts before consensus is reported as a separate result.

Sample size Target enrollment is 330 patients, with 300 analyzable forms expected after allowing for 10% incomplete or excluded forms. The sample size was determined by Monte Carlo simulation for the primary comparison, the difference between two dependent quadratic weighted kappas (LLM vs consensus and resident vs consensus). Assuming a resident-consensus kappa of 0.45 and a clinically relevant difference of 0.15, 300 analyzable patients give 83% power at a two-sided alpha of 0.05.

Statistical analysis Agreement of the resident and of the LLM with the expert consensus is measured with quadratic weighted Cohen's kappa. The primary comparison is the difference between the two kappas, tested with a paired bootstrap 95% confidence interval (2000 resamples of patients). Agreement among all three raters is measured with Fleiss' kappa. Misclassification is described by direction (under- or over-classification) using confusion matrices. The ASA II-III boundary, resident training year and the inter-expert subgroup are pre-specified subgroup analyses. Predictors of resident misclassification are examined with logistic regression. All tests are two-sided at alpha 0.05; secondary comparisons are reported with 95% confidence intervals and treated as exploratory.

02

Conditions studied

  • Anesthesia
  • Risk Assessment
  • Preoperative Care

Keywords

  • ASA physical status
  • artificial intelligence
  • large language model
  • anesthesia residents
  • preoperative evaluation
  • interrater agreement
  • weighted kappa
03

In context

Lead sponsor

Kayseri City Hospital is the lead sponsor of 51 studies on the registry; 17 are open to participants now.

Counted across the registry records on this site, refreshed daily.

04

Who can participate

Ages eligible
18 Years and older
Sexes eligible
All
Accepts healthy volunteers
No
Sampling method
Non-probability sample

Study population

Adult patients scheduled for elective surgery who attend the preoperative anesthesia outpatient clinic of Kayseri City Hospital and whose standard preoperative evaluation form is completed by a resident.

Go through the criteria one by one — yes, no or not sure — and take the list to your doctor or the study team. Kept in this browser only.

Inclusion criteria

  • Age 18 years or older
  • Scheduled for elective surgery and evaluated at the preoperative anesthesia clinic
  • Standard preoperative evaluation form completed by a resident, with required laboratory results and consultation reports entered
  • Written

Exclusion criteria

Exclusion Criteria:

  • Emergency or semi-urgent surgery
  • Incomplete preoperative evaluation form
  • Unable to give (for example, because of a psychiatric disorder)
  • Refusal to participate
Terms in these criteria, in plain language(1)

Underlined terms in the criteria open these too. Explained by clinicaltrials.gg, not part of the registry record. The study team decides who can take part.

Informed consent

Before you join, the study team explains what taking part involves — its purpose, what happens, the risks and possible benefits — and answers your questions, so you can decide freely. Consent is usually recorded on a form (the informed consent form, ICF) signed by you or, where the law allows, by someone legally authorized to decide for you.

You can keep asking questions during the study, you are told of new information that matters, and you can choose to leave at any time.

05

Study design

Observational model
Cohort
Time perspective
Prospective
Enrollment
330 participants (estimated)
Patient registry
No

Groups and cohorts

  • Preoperative anesthesia clinic patients

    Adult patients scheduled for elective surgery who are evaluated at the preoperative anesthesia outpatient clinic. The anonymized preoperative form of each patient is rated for ASA class by a resident, an LLM and two senior anesthesiologists.

06

What researchers measure

Primary outcomes

  1. Agreement between resident and expert-consensus ASA classification (quadratic weighted kappa)

    Quadratic weighted Cohen's kappa between the ASA physical status class (I to V) assigned by the anesthesia resident and the consensus class assigned by two senior anesthesiologists who were blinded to the resident's class. The consensus class is the reference standard. A value of 1 indicates perfect agreement, 0 indicates chance agreement, and negative values indicate agreement below chance.

    Time frame: Once per patient, from the preoperative clinic evaluation until completion of the blinded ratings (up to 4 weeks)

  2. Agreement between large language model and expert-consensus ASA classification (quadratic weighted kappa)

    Quadratic weighted Cohen's kappa between the ASA class assigned by the large language model from the anonymized preoperative form and the consensus class of two senior anesthesiologists. The model does not see the resident's class or any patient identifier.

    Time frame: Once per patient, from the preoperative clinic evaluation until completion of the blinded ratings (up to 4 weeks)

Secondary outcomes

  1. Three-rater agreement of ASA classification (Fleiss' kappa)

    Fleiss' kappa across the resident class, the large language model class and the expert consensus class for each patient.

    Time frame: From the preoperative evaluation to completion of blinded ratings (up to 4 weeks per patient); assessed at the end of data collection (up to 8 months).

  2. Agreement between the two senior anesthesiologists before consensus (quadratic weighted kappa)

    Quadratic weighted kappa between the independent ASA classes of senior anesthesiologist A and B, calculated before any discussion between them.

    Time frame: From the preoperative evaluation to completion of blinded ratings (up to 4 weeks per patient); assessed at the end of data collection (up to 8 months).

  3. Agreement between resident and large language model ASA classification (quadratic weighted kappa)

    Quadratic weighted kappa between the ASA class assigned by the resident and the class assigned by the large language model.

    Time frame: From the preoperative evaluation to completion of blinded ratings (up to 4 weeks per patient); assessed at the end of data collection (up to 8 months).

  4. Direction of misclassification relative to expert consensus

    Proportion of patients classified lower (under-classification) or higher (over-classification) than the expert consensus, reported separately for residents and for the large language model. The ASA II-III boundary is analyzed as a pre-specified subgroup.

    Time frame: From the preoperative evaluation to completion of blinded ratings (up to 4 weeks per patient); assessed at the end of data collection (up to 8 months).

  5. Proportion of resident misclassifications in which the large language model matches expert consensus

    Among patients whose resident ASA class differs from the expert consensus, the proportion for whom the large language model class equals the consensus class. This is an exploratory measure of decision-support potential.

    Time frame: From the preoperative evaluation to completion of blinded ratings (up to 4 weeks per patient); assessed at the end of data collection (up to 8 months).

  6. Factors associated with resident misclassification

    Odds ratios from logistic regression of resident misclassification (yes or no) on age, body mass index, number of ASA-relevant comorbidities, resident training year and borderline ASA II-III status.

    Time frame: From the preoperative evaluation to completion of blinded ratings (up to 4 weeks per patient); assessed at the end of data collection (up to 8 months).

07

Study locations

1 site
08

References and documents

Individual participant data

Plan to share: No — Individual participant data will not be shared outside the study team. The consent form covers coded, confidential use of the data for this study only. Aggregate results will be published.

No publications or documents are linked to this record.

09

Timeline

1 registry update since Sep 25, 2026
ElapsedEstimatedEstimated, not yet reached

Start is estimated for Jan 2027; primary completion for Aug 2027, 7 months later.

How these figures are worked out, and which studies are left out of them.

Registered
Nov 12, 2026
First posted
Nov 19, 2026
StartEst.
Jan 2027
Primary completionEst.
Aug 2027
CompletionEst.
Aug 2027
Last update
Nov 19, 2026
What these dates mean
Start.
When the first participant enrolled; while estimated, when the study expects to open to recruitment.
Primary completion.
When the last participant was examined or treated to collect data for the study's main question, its primary outcome. A study that stopped early gives the date its data collection stopped.
Completion.
When the last participant's last visit took place, for every outcome, secondary ones and side effects included: the end of the study. Often later than primary completion, sometimes the same day.
Actual and Est.
Actual means the registry says the date has happened. Est. (estimated) is a date the sponsor plans or expects. It can still move, and the sponsor is expected to change it to actual once it has passed.
Registered
First appeared on the registry. No changes since
Nov 19, 2026
Show all 1 update
  1. Nov 19, 2026
    First appeared on the registry

From the registry record's own update history. This site started tracking changes on Sep 25, 2026; for anything earlier, see the record history on ClinicalTrials.gov ↗

10

Registry details

Key details

Study ID
NCT07947524
Lead sponsor
Kayseri City Hospital
Responsible party
Çiğdem Ünal Kantekin (Associate Professor, Department of Anesthesiology and Reanimation, Kayseri City Hospital) — Principal investigator
First posted
Nov 19, 2026
Start date
Jan 2027 (estimated)
Primary completion
Aug 2027 (estimated)
Completion
Aug 2027 (estimated)
Last update
Nov 19, 2026

Study contacts

Çiğdem Ünal Kantekin, MD
Contact
drcgdm@gmail.com
+90 352 315 77 00
Çiğdem Ünal Kantekin, MD
principal investigator · Kayseri City Hospital

Oversight

Data monitoring committee
No
FDA-regulated drug
No
FDA-regulated device
No
View the source record on ClinicalTrials.gov ↗

Not currently enrolling

This study is not yet recruiting, as verified in Nov 2026. You cannot join it, but the record below documents what was studied.

Follow this study

Get an email when the registry record changes — status, dates, results — or when someone posts here.

Sign in to follow

Discussion

Questions and observations about this study, from anyone following it. Not medical advice, and not a channel to the study team — their contact details are on the registry record.

Sign in to join the discussion. Reading takes no account; posting does. You choose a display name, and a pseudonym is the default.

Nothing here yet. If you are running this trial, taking part in it, or weighing whether to, this is the place to say so.

Start the discussion