CClinicalTrials.gg
CompletedNCT01454947BEARIUpdated May 23, 2024Results posted

Use of Behavioral Economics to Improve Treatment of Acute Respiratory Infections (Main Study)

An interventional study of Clinical Decision Support (CDS): Accountable Justifications and Audit and Feedback: Peer Comparison in Acute Respiratory Infections (ARIs), sponsored by University of Southern California. Completed at 55 sites in United States. Open to participants aged 18 Years and older. Per ClinicalTrials.gov, last updated 2024-05-23.

Sponsored by University of Southern California · Not applicable, Interventional, and Treatment

Phase
Not applicable
Study type
Interventional
Enrollment
248
Allocation
Randomized
Ages
18 Years and older
Sex
All
01

Study summary

Bacteria resistant to antibiotic therapy are a major public health problem. The evolution of multi-drug resistant pathogens may be encouraged by provider prescribing behavior. Inappropriate use of antibiotics for nonbacterial infections and overuse of broad spectrum antibiotics can lead to the development of resistant strains. Though providers are adequately trained to know when antibiotics are and are not comparatively effective, this has not been sufficient to affect critical provider practices.

The intent of this study is to apply behavioral economic theory to reduce the rate of antibiotic prescriptions for acute respiratory diagnoses for which guidelines do not call for antibiotics. Specifically targeted are infections that are likely to be viral.

The objective of this study is to improve provider decisions around treatment of acute respiratory infections.

The participants are practicing attending physicians or advanced practice nurses (i.e. providers) at participating clinics who see acute respiratory infection patients. A maximum of 550 participants will be recruited for this study.

Providers consenting to participate will fill out a baseline questionnaire online. Subsequent to baseline data collection and enrollment, participating clinic sites will be randomized to the study arms, as described below.

There will be a control arm, with clinic sites randomized in a multifactorial design to up to three interventions that leverage the electronic medical record: Order Sets that are triggered by electronic health record (EHR) workflow containing exclusively guideline concordant choices (SA, for Suggested Alternatives); Accountable Justifications triggered by discordant prescriptions that populate the note with provider's rationale for guideline exceptions (AJ); and performance feedback that benchmarks providers' own performance to that of their peers (PC, for Peer Comparisons).

The outcomes of interest are antibiotic prescribing patterns, including prescribing rates and changes in prescribing rates over time.

The intervention period will be over one year, with a one-year follow up period to measure persistence of the effect after EHR features are returned to the original state and providers no longer receive email alerts.

Read the detailed description

Each consented provider will be randomized to 1 of 8 cells in a factorial design with equal probability. If results of retrospective data analysis imply that design will be improved by stratification, randomization will be stratified by factors that could influence outcomes.

Data will be collected from the clinics' Enterprise Data Warehouses which store copies of data recorded in the electronic health record. Data elements from qualifying office visits will be collected from coded portions of the electronic health record.

An encounter is eligible for intervention if the patient's diagnosis is in the selected group of acute respiratory infections. The intervention EHR functions will be triggered when clinicians initiate an antibiotic prescription or enter a diagnosis for an acute respiratory infection that has a defined Order Set. If an antibiotic from a list of frequently misprescribed antibiotics is ordered and a diagnosis has not yet been entered, providers will be prompted to enter a diagnosis. If the diagnosis entered is acute nasopharyngitis; acute laryngopharyngitis/acute upper respiratory infection; acute bronchitis; bronchitis not specified as acute or chronic; or flu; the interventions will be triggered. The diagnosis-appropriate order set will pop-up for providers in the SA arm, while clinicians randomized to the AJ arm will receive an alert and be required to enter a brief statement justifying their antibiotic prescription if antibiotics are not indicated for the diagnosis entered. This note will then be added to the patient's medical record.

Clinicians randomized to the Peer Comparison condition will receive email updates about their antibiotic prescribing practices relative to other clinicians in their practice.

02

Conditions studied

  • Acute Respiratory Infections (ARIs)

Keywords

  • Antibiotics
  • Inappropriate Prescribing
  • Respiratory Tract Infections
  • Behavioral Research
03

In context

Infections

6,687 studies on the registry are indexed under Infections; 807 are open to participants now.

This study's enrollment of 248 is above the median of 120 across 4,200 interventional studies indexed under Infections.

Browse Infections studies →

Lead sponsor

University of Southern California is the lead sponsor of 773 studies on the registry; 135 are open to participants now.

Of its 68 completed or terminated interventional studies of FDA-regulated products, 32 (47%) have results posted.

Counted across the registry records on this site, refreshed daily.

04

Who can participate

Ages eligible
18 Years and older
Sexes eligible
All
Accepts healthy volunteers
No

Inclusion criteria

  • A practicing attending physician or advanced practice nurse ("provider") at a participating clinic in 2011-2013 who sees acute respiratory infection patients.

Exclusion criteria

Exclusion Criteria:

  • None.
05

Study design

Phase
Not applicable
Primary purpose
Treatment
Allocation
Randomized
Intervention model
Factorial assignment
Masking
Single (Participant)
Enrollment
248 participants (actual)

Study arms

  • Experimental
    SA, AJ, PC

    Participants are given all 3 interventions.

    Behavioral: Clinical Decision Support (CDS): Accountable Justifications · Behavioral: Audit and Feedback: Peer Comparison · Behavioral: CDS Order Sets: Suggested Alternatives

  • Experimental
    SA, AJ

    Participants receive the Suggested Alternatives and Accountable Justification interventions, but not the Peer Comparison intervention.

    Behavioral: Clinical Decision Support (CDS): Accountable Justifications · Behavioral: CDS Order Sets: Suggested Alternatives

  • Experimental
    SA, PC

    Participants receive the Suggested Alternative and Peer Comparison interventions, but not the Accountable Justification intervention.

    Behavioral: Audit and Feedback: Peer Comparison · Behavioral: CDS Order Sets: Suggested Alternatives

  • Experimental
    AJ, PC

    Participants receive the Accountable Justification and Peer Comparison interventions, but not the Suggested Alternative intervention.

    Behavioral: Clinical Decision Support (CDS): Accountable Justifications · Behavioral: Audit and Feedback: Peer Comparison

  • Experimental
    Peer Comparison (PC)

    Participants receive the Peer Comparison intervention, but do not receive the Suggested Alternatives or Accountable Justification interventions.

    Behavioral: Audit and Feedback: Peer Comparison

  • Experimental
    Suggested Alternatives (SA)

    Participants receive the Suggested Alternatives intervention, but not the Accountable Justification or Peer Comparison interventions.

    Behavioral: CDS Order Sets: Suggested Alternatives

  • Experimental
    Accountable Justification (AJ)

    Participants receive the Accountable Justification intervention, but do not receive the Suggested Alternatives or Peer Comparison interventions.

    Behavioral: Clinical Decision Support (CDS): Accountable Justifications

  • No intervention
    Education Control

    Participants do not receive any of the 3 interventions.

Interventions

  • BehavioralClinical Decision Support (CDS): Accountable Justifications

    Accountable Justifications triggered by discordant prescriptions that populate the electronic health record (EHR) note with provider's rationale for guideline exceptions (AJ).

    Also known as: AJ, Accountable Justification

  • BehavioralAudit and Feedback: Peer Comparison

    Performance feedback that benchmarks providers' own performance to that of their peers (PC, for Peer Comparison).

    Also known as: PC, Peer Comparison

  • BehavioralCDS Order Sets: Suggested Alternatives

    Order Sets that are triggered by EHR workflow containing exclusively guideline concordant choices (SA, for Suggested Alternatives).

    Also known as: SA, Suggested Alternatives

06

What researchers measure

Primary outcomes

  1. Inappropriate Antibiotic Prescribing Rate for Qualifying Acute Respiratory Infection Diagnoses

    Assess inappropriate antibiotic prescribing rates (relative to all practices that did not receive the intervention) for antibiotic-inappropriate acute respiratory tract infection visits and no concomitant reason for antibiotic prescribing. based on the following non-antibiotic-appropriate International Statistical Classification of Diseases, version 9 (ICD-9) diagnoses: 460 Acute nasopharyngitis (common cold) 465 Acute laryngopharyngitis/acute upper respiratory infection 466 Acute bronchitis 490 Bronchitis not specified as acute or chronic 487 Flu

    Time frame: 18 months

Secondary outcomes

  1. Encounters Closely Following the Index Encounter for Serious Diagnoses

    Within intervention-qualifying acute respiratory infections (ARI) encounters where no antibiotic was prescribed, we will monitor return visit rates for the specified diagnoses and other acute respiratory infection diagnoses (ICD-9), including whooping cough (033.9), rheumatic fever (390-392) and pneumonia (481-487).

    Time frame: 18 months

07

Results

Posted Jun 20, 2017

Participant flow

Participant flow — Overall Study
MilestoneEducation ControlSuggested Alternatives (SA)Accountable Justification (AJ)Peer Comparison (PC)SA, AJSA, PCAJ, PCSA, AJ, PC
Started2742352034352728
Completed2438321933322623
Not completed34311315

Outcome measures

PrimaryInappropriate Antibiotic Prescribing Rate for Qualifying Acute Respiratory Infection Diagnoses

Assess inappropriate antibiotic prescribing rates (relative to all practices that did not receive the intervention) for antibiotic-inappropriate acute respiratory tract infection visits and no concomitant reason for antibiotic prescribing. based on the following non-antibiotic-appropriate International Statistical Classification of Diseases, version 9 (ICD-9) diagnoses: 460 Acute nasopharyngitis (common cold) 465 Acute laryngopharyngitis/acute upper respiratory infection 466 Acute bronchitis 490 Bronchitis not specified as acute or chronic 487 Flu

Time frame:
18 months
Reported as:
Number · proportion of visits
Inappropriate Antibiotic Prescribing Rate for Qualifying Acute Respiratory Infection Diagnoses
proportion of visitsControlSuggested Alternatives (SA)Accountable Justification (AJ)Peer Comparison (PC)Suggested Alternatives + Accountable JustificationSuggested Alternatives + Peer ComparisonAccountable Justification + Peer ComparisonSA+AJ+PC
Inappropriate Antibiotic Prescribing Rate for Qualifying Acute Respiratory Infection Diagnoses0.20 (0.10 to 0.31)0.19 (0.06 to 0.66)0.08 (0.03 to 0.23)0.09 (0.03 to 0.31)0.07 (0.02 to 0.24)0.01 (0.00 to 0.08)0.03 (0.00 to 0.18)0.03 (0.00 to 0.22)
SecondaryEncounters Closely Following the Index Encounter for Serious Diagnoses

Within intervention-qualifying acute respiratory infections (ARI) encounters where no antibiotic was prescribed, we will monitor return visit rates for the specified diagnoses and other acute respiratory infection diagnoses (ICD-9), including whooping cough (033.9), rheumatic fever (390-392) and pneumonia (481-487).

Time frame:
18 months
Reported as:
Count of units · Qualifying encounters
Encounters Closely Following the Index Encounter for Serious Diagnoses
Qualifying encountersControlSuggested Alternatives (SA)Accountable Justification (AJ)Peer Comparison (PC)Suggested Alternatives + Accountable JustificationSuggested Alternatives + Peer ComparisonAccountable Justification + Peer ComparisonSA+AJ+PC
Encounters Closely Following the Index Encounter for Serious Diagnoses1416161322234815
Statistical analysis
  • Control vs Suggested Alternatives (SA) vs Accountable Justification (AJ) vs Peer Comparison (PC) vs Suggested Alternatives + Accountable Justification vs Suggested Alternatives + Peer Comparison vs Accountable Justification + Peer Comparison vs SA+AJ+PC · 2 proportion Z-test · p = 0.007 (P values computed using difference between proportions (z value) with Bonferroni correction.)

Adverse events

Collected over For antibiotic-inappropriate visits in which no antibiotic was prescribed, we assessed return visits within 30 days for the presence of complications potentially attributable to untreated bacterial infections. Non-serious events are listed at a 0% frequency threshold.

Adverse event summary by group
GroupDeathsSeriousOther
Education Control—0/3,245 (0%)14/3,245 (0.4%)
Suggested Alternatives (SA)—0/4,579 (0%)16/4,579 (0.3%)
Accountable Justification (AJ)—0/4,622 (0%)16/4,622 (0.3%)
Peer Comparison (PC)—0/3,781 (0%)13/3,781 (0.3%)
SA, AJ—0/5,717 (0%)22/5,717 (0.4%)
SA, PC—0/5,993 (0%)23/5,993 (0.4%)
AJ, PC—0/3,398 (0%)48/3,398 (1.4%)
SA, AJ, PC—0/4,164 (0%)15/4,164 (0.4%)
Most frequent other events
Most frequent other events
EventEducation ControlSuggested Alternatives (SA)Accountable Justification (AJ)Peer Comparison (PC)SA, AJSA, PCAJ, PCSA, AJ, PC
return visits for bacterial infections occurring within 30 days of study qualifying ARI visit whereInfections and infestations14/324516/457916/462213/378122/571723/599348/339815/4164

Baseline characteristics

Enrolled Clinicians

Age, Continuous
Age, Continuous(years)Education ControlSuggested Alternatives (SA)Accountable Justification (AJ)Peer Comparison (PC)SA, AJSA, PCAJ, PCSA, AJ, PCTotal
Mean47 ± 1249 ± 1049 ± 946 ± 948 ± 951 ± 1148 ± 1046 ± 948 ± 10
Sex: Female, Male
Sex: Female, Male(Participants)Education ControlSuggested Alternatives (SA)Accountable Justification (AJ)Peer Comparison (PC)SA, AJSA, PCAJ, PCSA, AJ, PCTotal
Female1330221224251516157
Male14121381010121291
08

Study locations

55 sites
  • Altamed Anaheim Lincoln
    Anaheim, California 92801, United States
  • Altamed Anaheim West
    Anaheim, California 92801, United States
  • Altamed Bell Clinic
    Bell, California 90201, United States
  • Altamed Mobile Unit Primary Care
    Commerce, California 90040, United States
  • Altamed DVL El Monte
    El Monte, California 91731, United States
  • Altamed El Monte Clinic
    El Monte, California 91731, United States
  • Altamed Garden Grove Harbor
    Garden Grove, California 92840, United States
  • Altamed Huntington Beach Clinic
    Huntington Beach, California 92647, United States
  • Altamed PACE Rugby
    Huntington Park, California 90255, United States
  • The Children's Clinic Family Health Center at Cesar Chavez Elementary School
    Long Beach, California 90802, United States
  • The Children's Clinic Family Health Center at Hamilton Middle School
    Long Beach, California 90805, United States
  • The S. Mark Taper Foundation Children's Clinic Family Health Center
    Long Beach, California 90806, United States
  • The Children's Clinic at the Long Beach Multi-Service Center for the Homeless
    Long Beach, California 90813, United States
  • The Vasek Polak Children's Clinic Family Health Center
    Long Beach, California 90813, United States
  • Altamed PACE Grand Plaza
    Los Angeles, California 90012, United States
  • Altamed William Mead Homes
    Los Angeles, California 90012, United States
  • Altamed Commerce Clinic
    Los Angeles, California 90022, United States
  • Altamed DVL Commerce
    Los Angeles, California 90022, United States
  • Altamed PACE Pomona
    Los Angeles, California 90022, United States
  • Altamed Boyle Heights Clinic
    Los Angeles, California 90023, United States
  • Altamed Estrada Courts
    Los Angeles, California 90023, United States
  • Altamed Ramona Gardens
    Los Angeles, California 90023, United States
  • AltaMed 1st St Boyle Heights Clinic
    Los Angeles, California 90033, United States
  • Altamed Zonal Clinic
    Los Angeles, California 90033, United States
  • Altamed Montebello Clinic
    Montebello, California 90640, United States
  • Altamed El Modena Clinic
    Orange, California 92869, United States
  • Altamed Pico Clinic
    Pico Rivera, California 90060, United States
  • Altamed DVL Pico
    Pico Rivera, California 90660, United States
  • Altamed Santa Ana Main
    Santa Ana, California 92701, United States
  • Altamed Clinic For Women
    Santa Ana, California 92706, United States
  • Altamed Santa Ana Broadway
    Santa Ana, California 92707, United States
  • Altamed Santa Ana Central
    Santa Ana, California 92707, United States
  • Brigham and Women's Primary Care Associates at Foxborough
    Boston, Massachusetts 02035, United States
  • MGH Downtown
    Boston, Massachusetts 02108, United States
  • Mass General Medial Group
    Boston, Massachusetts 02114, United States
  • MGH Beacon Hill
    Boston, Massachusetts 02114, United States
  • MGH Senior Health
    Boston, Massachusetts 02114, United States
  • Women's Health Associates
    Boston, Massachusetts 02114, United States
  • Brigham Circle Medical Associates
    Boston, Massachusetts 02115, United States
  • Brigham Internal Medicine Associates
    Boston, Massachusetts 02115, United States
  • Spanish Clinic
    Boston, Massachusetts 02115, United States
  • MGH Back Bay
    Boston, Massachusetts 02228, United States
  • Brigham and Women's Primary Care Associates of Brookline
    Brookline, Massachusetts 02446, United States
  • MGH Charlestown HealthCare Center
    Charlestown, Massachusetts 02129, United States
  • MGH Chelsea HealthCare Center
    Chelsea, Massachusetts 02150, United States
  • Brigham and Women's Physician Group
    Chestnut Hill, Massachusetts 02467, United States
  • Gretchen and Edward Fish Center for Women's Health
    Chestnut Hill, Massachusetts 02467, United States
  • Everett Family Practice
    Everett, Massachusetts 02149, United States
  • Brigham Primary Physicians at Faulkner
    Jamaica Plain, Massachusetts 02130, United States
  • Brookside Community Health Center
    Jamaica Plain, Massachusetts 02130, United States
  • Faulkner Community Physicians
    Jamaica Plain, Massachusetts 02130, United States
  • Southern Jamaica Plain Health Center
    Jamaica Plain, Massachusetts 02130, United States
  • Brigham and Women's Primary Care Associates of Newton Corner
    Newton, Massachusetts 02458, United States
  • Mass General Revere HealthCare Center
    Revere, Massachusetts 02151, United States
  • Mass General West Medical Group
    Waltham, Massachusetts 02451, United States
09

References and documents

Publications

  • Meeker D, Linder JA, Fox CR, Friedberg MW, Persell SD, Goldstein NJ, Knight TK, Hay JW, Doctor JN. Effect of Behavioral Interventions on Inappropriate Antibiotic Prescribing Among Primary Care Practices: A Randomized Clinical Trial. JAMA. 2016 Feb 9;315(6):562-70. doi: 10.1001/jama.2016.0275. PubMed 26864410 ↗
  • Gong CL, Zangwill KM, Hay JW, Meeker D, Doctor JN. Behavioral Economics Interventions to Improve Outpatient Antibiotic Prescribing for Acute Respiratory Infections: a Cost-Effectiveness Analysis. J Gen Intern Med. 2019 Jun;34(6):846-854. doi: 10.1007/s11606-018-4467-x. Epub 2018 May 8. PubMed 29740788 ↗
  • Gong CL, Hay JW, Meeker D, Doctor JN. Prescriber preferences for behavioural economics interventions to improve treatment of acute respiratory infections: a discrete choice experiment. BMJ Open. 2016 Sep 22;6(9):e012739. doi: 10.1136/bmjopen-2016-012739. PubMed 27660322 ↗
  • Persell SD, Friedberg MW, Meeker D, Linder JA, Fox CR, Goldstein NJ, Shah PD, Knight TK, Doctor JN. Use of behavioral economics and social psychology to improve treatment of acute respiratory infections (BEARI): rationale and design of a cluster randomized controlled trial [1RC4AG039115-01]--study protocol and baseline practice and provider characteristics. BMC Infect Dis. 2013 Jun 27;13:290. doi: 10.1186/1471-2334-13-290. PubMed 23806017 ↗
10

Updates

Tracking since Sep 25, 2026
No changes since tracking began. The registry record was last updated on May 23, 2024, before this site started recording changes on Sep 25, 2026. Its history is on ClinicalTrials.gov ↗
11

Registry details

Key details

Study ID
NCT01454947
Lead sponsor
University of Southern California
Collaborators
National Institute on Aging (NIA)
Responsible party
Jason Doctor (Associate Professor, University of Southern California) — Principal investigator
First posted
Oct 19, 2011
Start date
Aug 2011
Primary completion
Apr 2014
Completion
Sep 2014
Results posted
Jun 20, 2017
Last update
May 23, 2024

Study contacts

Jason N Doctor, PhD
principal investigator · University of Southern California

Oversight

Data monitoring committee
Yes
View the source record on ClinicalTrials.gov ↗

Not currently enrolling

This study is completed, as verified in May 2024. You cannot join it, but the record below documents what was studied.

Follow this study

Get an email when the registry record changes — status, dates, results — or when someone posts here.

Sign in to follow

Discussion

Questions and observations about this study, from anyone following it. Not medical advice, and not a channel to the study team — their contact details are on the registry record.

Sign in to join the discussion. Reading takes no account; posting does. You choose a display name, and a pseudonym is the default.

Nothing here yet. If you are running this trial, taking part in it, or weighing whether to, this is the place to say so.

Start the discussion