ClinicalTrials.gg
CompletedNCT03151083Updated Jul 21, 2023Results posted

Implementing and Evaluating Computer-Based Interventions for Mental Health: Testing an Implementation Strategy for VA Outpatient Care

An interventional study of Internet-based Self-help Insomnia Intervention in Insomnia, sponsored by VA Office of Research and Development. Completed at 1 site in United States. Open to participants aged 18 Years and older, including healthy volunteers. Per ClinicalTrials.gov, last updated 2023-07-21.

Sponsored by VA Office of Research and Development · Not applicable, Interventional, and Health services research

Phase
Not applicable
Study type
Interventional
Enrollment
77
Allocation
Not applicable
Ages
18 Years and older
Sex
All
01

Study summary

Internet-based self-help programs are personalized, self-guided interventions delivered over a computer, mobile device, or other Internet platform and focused on improving knowledge, awareness, or behavior change for a mental or physical health problem. Through previous and on-going projects at VACT, the investigators are developing a general strategy for implementing Internet-based Self-help programs in VA primary care, specifically among Patient Aligned Care Teams (PACT) and Primary Care Mental Health Integration (PCMHI) providers. An implementation strategy is defined as a systematic intervention to integrate evidence-based health innovations into usual care. The strategy the investigators propose to test consists of four core components: (1) a clinical intermediary for patient support, (2) provider/staff facilitation and education, (3) patient education, and (4) stepped-care for those requiring additional treatment. In the proposed study, the investigators will compare this strategy to a low intensity (control) strategy with respect to the implementation related outcomes of patent engagement, provider adoption through referral to the program, and patient completion, over a six-month active implementation period. The investigators will target the very common clinical problem of insomnia and use the SHUTiTM program, a 6-week self-guided program utilizing standard cognitive-behavioral therapy (CBT) techniques for the treatment of chronic insomnia. The program has been shown to improve insomnia severity and other sleep related outcomes in a number of controlled trials. The clinical effectiveness of SHUTiTM will be evaluated using clinical insomnia outcomes obtained on all patients enrolled over the 6-month active implementation periods. The purpose this study is to evaluate the preliminary (1) effectiveness of an implementation strategy for Internet-based Self-help Interventions and (2) clinical outcomes of a specific Internet-based self-help program for insomnia, SHUTiTM, in VA Connecticut outpatient primary care. The primary hypothesis is that the experimental implementation strategy the investigators are developing, relative to a control strategy, will result in higher rates of program engagement by patients, greater provider adoption through referral to the program, greater program completion, and improved patient insomnia outcomes.

Read the detailed description

Objective: The purpose this study is to evaluate the preliminary (1) effectiveness of an implementation strategy for Internet-based Self-help Interventions and (2) clinical outcomes of a specific Internet-based self-help program for insomnia, SHUTiTM, in VA Connecticut outpatient primary care. The primary hypothesis is that the experimental implementation strategy the investigators are developing, relative to a control strategy, will result in higher rates of program engagement by patients, greater provider adoption through referral to the program, greater program completion, and improved patient insomnia outcomes.

Research Design: The investigators will employ a hybrid implementation-effectiveness study design through which the investigators will primarily test the effectiveness of the implementation strategy, while secondarily evaluating the clinical effectiveness of the SHUTiTM program. The investigators will use a quasi-experimental pre-/post-cohort design whereby SHUTiTM will initially be implemented using a low-intensity (control) strategy, followed by implementation using the experimental strategy. The SHUTiTM program's association with clinical response will be evaluated in an uncontrolled pre-/post-format.

Methodology: Internet-based self-help programs are personalized, self-guided interventions delivered over a computer, mobile device, or other Internet platform and focused on improving knowledge, awareness, or behavior change for a mental or physical health problem. Through previous and on-going projects at VACT, the investigators are developing a general strategy for implementing Internet-based Self-help programs in VA primary care, specifically among Patient Aligned Care Teams (PACT) and Primary Care Mental Health Integration (PCMHI) providers. An implementation strategy is defined as a systematic intervention to integrate evidence-based health innovations into usual care. The strategy the investigators propose to test consists of four core components: (1) a clinical intermediary for patient support, (2) provider/staff facilitation and education, (3) patient education, and (4) stepped-care for those requiring additional treatment. The investigators' currently approved protocol (#0002) involves interviewing VA providers, administrators, and staff in order to expand and modify the components of this strategy. In the proposed study, the investigators will compare this strategy to a low intensity (control) strategy with respect to the implementation related outcomes of patent engagement, provider adoption through referral to the program, and patient completion, over a six-month active implementation period. Use of the program will continue and implementation outcomes will be gathered over an additional one-year sustainment phase. The investigators will target the very common clinical problem of insomnia and use the SHUTiTM program, a 6-week self-guided program utilizing standard cognitive-behavioral therapy (CBT) techniques for the treatment of chronic insomnia. The program has been shown to improve insomnia severity and other sleep related outcomes in a number of controlled trials. The clinical effectiveness of SHUTiTM will be evaluated using clinical insomnia outcomes obtained on all patients enrolled over the 6-month active implementation periods.

Impact/Significance: The development and testing of evidence-based implementation strategies for Internet-based self-help programs in VA outpatient care is essential given that (1) there is an increasing number of Internet-based self-help programs providing evidence-based treatment for a variety of mental and behavioral health disorders, (2) VA has committed to improving access to care, especially evidence-based and self-care resources, and (3) there is a Congressional mandate that VA implement Internet-based care. This will be first controlled trial of an implementation strategy for Internet-based self-help programs in a VA primary care (PACT/PCMHI) context.

02

Conditions studied

  • Insomnia

Keywords

  • Health Technology
  • Internet-Based Psychotherapy
  • self-care
  • Primary Care
  • Mental Health
03

In context

Sleep Initiation and Maintenance Disorders

1,925 studies on the registry are indexed under Sleep Initiation and Maintenance Disorders; 612 are open to participants now.

This study's enrollment of 77 is close to the median of 72 across 1,689 interventional studies indexed under Sleep Initiation and Maintenance Disorders.

Browse Sleep Initiation and Maintenance Disorders studies →

Lead sponsor

VA Office of Research and Development is the lead sponsor of 1,767 studies on the registry; 394 are open to participants now.

Of its 209 completed or terminated interventional studies of FDA-regulated products, 183 (88%) have results posted.

Counted across the registry records on this site, refreshed daily.

04

Who can participate

Ages eligible
18 Years and older
Sexes eligible
All
Accepts healthy volunteers
Yes

Go through the criteria one by one — yes, no or not sure — and take the list to your doctor or the study team. Kept in this browser only.

Inclusion criteria

  • Patients Receiving care from a VA Connecticut West Haven PACT/PCMHI Provider
  • Diagnosed with insomnia lasting 3 months by the PACT provider, as evidenced by referral by the provider for access to the SHUTiTM program
  • Able to provide valid informed consent, as evidenced by answering questions indicating their understanding of the content of the Informed Consent Document
  • Willing to participate in an internet-based self-help program for insomnia after the access to and requirements of the program are explained to them
  • English-speaking (The SHUTiTM program is only available in English)

Exclusion criteria

Exclusion Criteria:

  • Evidence of acute psychiatric decompensation requiring inpatient admission or emergency department services within the last month, including suicidality, homicidally, mania, or psychotic decompensation.
  • Evidence of a conservator of person either verbally reported by the patient or upon inspection of the medical record.
05

Study design

Phase
Not applicable
Primary purpose
Health services research
Allocation
Not applicable
Intervention model
Sequential assignment
Masking
None (open label)
Enrollment
77 participants (actual)

Study arms

  • Active comparator
    Phase 1: Implementation As Usual (Implementation Through Rese

    SHUTi digital CBTi Program was implemented in VACT primary care using implementation activities executed by the research team between June 2017 and January 2018 (8-months). Implementation activities included: Provider Education by the research team, Provider Reminders (information pamphlets in treatment rooms), Patient Advertising/Information (information pamphlets in treatment rooms), Single Referral Pathway Not Integrated Primary Care Workflow (Primary care provider contact research team for patient referral over email).

    Behavioral: Internet-based Self-help Insomnia Intervention

  • Experimental
    Phase 2: Primary Care Coached Digital CBTi Implementation (Im

    SHUTi digital CBTi Program implemented in VACT primary care using implementation activities executed by primary care teams June 2018 and January 2019 (8-months). Implementation activities included: Provider Education by the research team, Provider Reminders (information pamphlets in treatment rooms), Patient Advertising/Information (information pamphlets in treatment rooms), patient education and motivational support supplied through a digital CBTi coach, the digital CBTi coach was a primary care nurse trained by the research team, technical support and oversight of the digital CBTi coach by the research team. Single Referral Pathway Not Integrated Primary Care Workflow.

    Behavioral: Internet-based Self-help Insomnia Intervention

  • Experimental
    Phase 3: Primary Care Mental Health Collaborative Care Implem

    SHUTi digital CBTi Program implemented in VACT primary care using implementation activities executed by primary care teams April 2019 and November 2019 (8-months). Implementation activities included: Provider Education by the research team, Provider Reminders, Patient Advertising/Information, patient education and motivational support supplied through a digital CBTi coach, the digital CBTi coach was a peer support specialist working on the primary care mental health collaborative care team, the digital CBTi coach was trained by the research team, technical support and oversight of the digital CBTi coach by the research team. Additional members primary care mental health collaborative care team were educated to provide education about digital CBTi. Multiple referral pathways to digital CBTi: consults to the digital CBTi Coach, warm handoffs to primary care mental health collaborative care team. Digital CBTi coach consults integrated Primary Care Workflow.

    Behavioral: Internet-based Self-help Insomnia Intervention

Interventions

  • BehavioralInternet-based Self-help Insomnia Intervention

    The investigators will use the program, SHUTiTM for the treatment of insomnia. The intervention is a CBT-based 6-week, self-administered course accessed via the Internet on mobile, desk-top, and other devices. The program is split into six modules, completed weekly, which include instruction on psycho-education, stimulus control, relaxation training, sleep restriction, medication tapering, and addressing cognitive distortions. The content is delivered via text, video vignettes, case histories, interactive learning tools, interactive skills assessments, symptom assessments, and a sleep log. Homework is assigned after each module. Providers and support staff can follow treatment progress via access to a dashboard of patient information collected by the program. Such information includes progress through the modules, date of last engagement, symptom assessment outcomes, and sleep log data abstracted into commonly used sleep indices such as sleep onset latency and sleep efficiency.

    Also known as: SHUTi (Sleep Health Using the Internet)

06

What researchers measure

Primary outcomes

  1. Program Engagement: Completion of the First Program Module

    The proportion of participants engaging in the program (completing at least one module) among the unique Veterans treated in VA Connecticut primary care over the respective intervention periods.

    Time frame: 3 weeks following subject enrollment

Secondary outcomes

  1. Program Completion

    Completion of all six modules of the program. The proportion of individuals completing all six modules among all individuals enrolled.

    Time frame: 10 Weeks following subject enrollment

  2. Provider Adoption

    The number of providers who made a referral to the SHUTi Program among the number of providers with the ability to make a referral.

    Time frame: Over each 8-month active implementation Phase

  3. Insomnia Severity Index

    The ISI will be the primary clinical outcome and is a self-report seven-item measure that targets the subjective symptoms and functional consequences of insomnia. The outcome reported is the change in total ISI score from baseline to follow-up. All enrollees are analyzed as a single group regardless of implementation period. The Insomnia Severity Index to total is the sum on 7 questions scored 0 to 4 (minimum=0, Maximum=28). Higher scores indicate more severe insomnia.

    Time frame: At enrollment and 10 weeks following enrollment.

Other outcomes

  1. Beck Depression Inventory

    The BDI is a secondary clinical outcome and is a self-report measure of depression severity. The outcome reported is the change in total BDI score from baseline to follow-up. All enrollees are analyzed as a single group regardless of implementation period. The BDI is a 21-item, self-report rating inventory of depression symptoms. Items receive a rating of zero to three and are summed linearly to create a score which ranges from 0 to 63. Higher score indicate more intense symptoms of depression.

    Time frame: At enrollment and 10 weeks following enrollment

  2. Sedative-Hypnotic Medication Use

    The use of sedative-hypnotics will be measured by self-report of the type and dose of specific medications used in the last week. The outcome reported is the change in the reported total weekly number of sedative-hypnotic doses reported from baseline compared to follow-up.

    Time frame: At enrollment and 10 weeks following enrollment

07

Results

Posted Jan 27, 2021
Limitations and caveats
The research team realized that implementation in phase 2 was not resulting in improved implementation outcomes over phase 1. Formative evaluation of implementation took place, and and additional implementation phase (phase 3) was added.

Participant flow

Recruitment to digital CBTi occurred through primary care providers who made a referrals to the intervention. Referrals were addressed by the digital intervention coach (or research team member, depending on the cohort), who provided and initial education session about digital CBTi. Participants could then enroll in the trial if they wished. Over the entire course of the trial, 153 individuals were referred and 77 chose to enroll.

Participant flow — Overall Study
MilestonePhase 1: Implementation As Usual (Implementation Through Research Team)Phase 2: Primary Care Coached Digital CBTi Implementation (Implementation Through Primary Care)Phase 3: Primary Care Mental Health Collaborative Care Implementation
Started272030
Completed251926
Not completed214

Outcome measures

PrimaryProgram Engagement: Completion of the First Program Module

The proportion of participants engaging in the program (completing at least one module) among the unique Veterans treated in VA Connecticut primary care over the respective intervention periods.

Time frame:
3 weeks following subject enrollment
Reported as:
Count of participants · Participants
Program Engagement: Completion of the First Program Module
ParticipantsPhase 1: Implementation As Usual (Implementation Through Research Team)Phase 2: Primary Care Coached Digital CBTi Implementation (Implementation Through Primary Care)Phase 3: Primary Care Mental Health Collaborative Care Implementation
Program Engagement: Completion of the First Program Module171216
SecondaryProgram Completion

Completion of all six modules of the program. The proportion of individuals completing all six modules among all individuals enrolled.

Time frame:
10 Weeks following subject enrollment
Reported as:
Count of participants · Participants
Program Completion
ParticipantsPhase 1: Implementation As Usual (Implementation Through Research Team)Phase 2: Primary Care Coached Digital CBTi Implementation (Implementation Through Primary Care)Phase 3: Primary Care Mental Health Collaborative Care Implementation
Program Completion1077
SecondaryProvider Adoption

The number of providers who made a referral to the SHUTi Program among the number of providers with the ability to make a referral.

Time frame:
Over each 8-month active implementation Phase
Reported as:
Count of participants · Participants
Provider Adoption
ParticipantsPhase 1: Implementation As Usual (Implementation Through Research Team)Phase 2: Primary Care Coached Digital CBTi Implementation (Implementation Through Primary Care)Phase 3: Primary Care Mental Health Collaborative Care Implementation
Provider Adoption312634
SecondaryInsomnia Severity Index

The ISI will be the primary clinical outcome and is a self-report seven-item measure that targets the subjective symptoms and functional consequences of insomnia. The outcome reported is the change in total ISI score from baseline to follow-up. All enrollees are analyzed as a single group regardless of implementation period. The Insomnia Severity Index to total is the sum on 7 questions scored 0 to 4 (minimum=0, Maximum=28). Higher scores indicate more severe insomnia.

Time frame:
At enrollment and 10 weeks following enrollment.
Reported as:
Mean · score on a scale
Insomnia Severity Index
score on a scaleAll Enrollees
Insomnia Severity Index4.3 ± 5.6
Other pre-specifiedBeck Depression Inventory

The BDI is a secondary clinical outcome and is a self-report measure of depression severity. The outcome reported is the change in total BDI score from baseline to follow-up. All enrollees are analyzed as a single group regardless of implementation period. The BDI is a 21-item, self-report rating inventory of depression symptoms. Items receive a rating of zero to three and are summed linearly to create a score which ranges from 0 to 63. Higher score indicate more intense symptoms of depression.

Time frame:
At enrollment and 10 weeks following enrollment
Reported as:
Mean · score on a scale
Beck Depression Inventory
score on a scaleAll Enrollees
Beck Depression Inventory3.1 ± 5.5
Other pre-specifiedSedative-Hypnotic Medication Use

The use of sedative-hypnotics will be measured by self-report of the type and dose of specific medications used in the last week. The outcome reported is the change in the reported total weekly number of sedative-hypnotic doses reported from baseline compared to follow-up.

Time frame:
At enrollment and 10 weeks following enrollment
Reported as:
Mean · weekly sedative-hypnotic doses
Sedative-Hypnotic Medication Use
weekly sedative-hypnotic dosesAll Enrollees
Sedative-Hypnotic Medication Use2.2 ± 6.6

Adverse events

Collected over Adverse event data was collected over the entire trial period between June 2017 and January 2020. This timeframe included the 3 periods of active implementation (when referrals could be made to the program) in addition to periods where subjects who had enrolled could actively engage in the SHUTi (up to 10 weeks after enrollment).. Non-serious events are listed at a 0% frequency threshold.

Adverse event summary by group
GroupDeathsSeriousOther
All Enrollees0/77 (0%)0/77 (0%)0/77 (0%)

Baseline characteristics

Age, Customized
Age, Customized(Participants)Phase 1: Implementation As Usual (Implementation Through Research Team)Phase 2: Primary Care Coached Digital CBTi Implementation (Implementation Through Primary Care)Phase 3: Primary Care Mental Health Collaborative Care ImplementationTotal
<=5587722
>55,<=6594922
>651091433
Sex: Female, Male
Sex: Female, Male(Participants)Phase 1: Implementation As Usual (Implementation Through Research Team)Phase 2: Primary Care Coached Digital CBTi Implementation (Implementation Through Primary Care)Phase 3: Primary Care Mental Health Collaborative Care ImplementationTotal
Female41611
Male23192466
Race/Ethnicity, Customized
Race/Ethnicity, Customized(Participants)Phase 1: Implementation As Usual (Implementation Through Research Team)Phase 2: Primary Care Coached Digital CBTi Implementation (Implementation Through Primary Care)Phase 3: Primary Care Mental Health Collaborative Care ImplementationTotal
White/non-Hispanic21132458
African American/Non-Hispanic2439
Hispanic3227
Other1113
Any Mental Health Diagnosis
Any Mental Health Diagnosis(Participants)Phase 1: Implementation As Usual (Implementation Through Research Team)Phase 2: Primary Care Coached Digital CBTi Implementation (Implementation Through Primary Care)Phase 3: Primary Care Mental Health Collaborative Care ImplementationTotal
Any Mental Health Diagnosis1281535
No Mental Health Diagnosis15121542
Number of Medical Diagnoses
Number of Medical Diagnoses(Participants)Phase 1: Implementation As Usual (Implementation Through Research Team)Phase 2: Primary Care Coached Digital CBTi Implementation (Implementation Through Primary Care)Phase 3: Primary Care Mental Health Collaborative Care ImplementationTotal
<546717
>=5, <10104721
>=1013101639
Any Sedative-Hypnotic Prescription
Any Sedative-Hypnotic Prescription(Participants)Phase 1: Implementation As Usual (Implementation Through Research Team)Phase 2: Primary Care Coached Digital CBTi Implementation (Implementation Through Primary Care)Phase 3: Primary Care Mental Health Collaborative Care ImplementationTotal
Any Sedative-Hypnotic Prescription641222
No Sedative-Hypnotic Prescription21161855
08

Study locations

1 site
  • VA Connecticut Healthcare System West Haven Campus, West Haven, CT
    West Haven, Connecticut 06516-2770, United States
09

References and documents

Publications

  • Hermes EDA, Rosenheck RA, Burrone L, Dante G, Lukens C, Martino S. The Implementation and Effectiveness of Digital Cognitive Behavioral Therapy for Insomnia in Primary Care: A Pilot Study. Implement Res Pract. 2021 Nov 15;2:26334895211053659. doi: 10.1177/26334895211053659. eCollection 2021 Jan-Dec. PubMed 37090002 ↗

Study documents

  • Protocol and statistical analysis plan · May 28, 2019

Documents are hosted by the registry — open the source record to download them.

Individual participant data

Plan to share: No

10

Updates

Tracking since Sep 25, 2026
No changes since tracking began. The registry record was last updated on Jul 21, 2023, before this site started recording changes on Sep 25, 2026. Its history is on ClinicalTrials.gov ↗
11

Registry details

Key details

Study ID
NCT03151083
Collaborators
VA Connecticut Healthcare System, US Department of Veterans Affairs
Responsible party
Sponsor
First posted
May 12, 2017
Start date
May 30, 2017
Primary completion
Jan 1, 2020
Completion
Jun 1, 2021
Results posted
Jan 27, 2021
Last update
Jul 21, 2023

Study contacts

Eric Hermes, MD
principal investigator · VA Connecticut Healthcare System West Haven Campus, West Haven, CT

Oversight

Data monitoring committee
No
FDA-regulated drug
No
FDA-regulated device
No
View the source record on ClinicalTrials.gov ↗

Not currently enrolling

This study is completed, as verified in Jul 2023. You cannot join it, but the record below documents what was studied.

Follow this study

Get an email when the registry record changes — status, dates, results — or when someone posts here.

Sign in to follow

Discussion

Questions and observations about this study, from anyone following it. Not medical advice, and not a channel to the study team — their contact details are on the registry record.

Sign in to join the discussion. Reading takes no account; posting does. You choose a display name, and a pseudonym is the default.

Nothing here yet. If you are running this trial, taking part in it, or weighing whether to, this is the place to say so.

Start the discussion