Working to Implement and Sustain Digital Outcome Measures

NCT ID: NCT04096274

Last Updated: 2024-02-20

Study Results

Results available

Outcome measurements, participant flow, baseline characteristics, and adverse events have been published for this study.

View full results

Basic Information

Get a concise snapshot of the trial, including recruitment status, study phase, enrollment targets, and key timeline milestones.

Recruitment Status

COMPLETED

Clinical Phase

NA

Total Enrollment

686 participants

Study Classification

INTERVENTIONAL

Study Start Date

2019-10-01

Study Completion Date

2022-09-17

Brief Summary

Review the sponsor-provided synopsis that highlights what the study is about and why it is being conducted.

This study will investigate the effects of an organizational implementation strategy called Leadership and Organizational Change for Implementation (LOCI), relative to training and technical assistance only, on fidelity to, and youth service outcomes of, a well-established digital measurement-based care intervention called the Outcomes Questionnaire-Analyst in outpatient community mental health clinics.

Detailed Description

Dive into the extended narrative that explains the scientific background, objectives, and procedures in greater depth.

Using a cluster randomized, controlled, hybrid type III effectiveness-implementation design, this trial will investigate the effects of LOCI on the fidelity and and clinical outcomes of a digital measurement-based care (MBC) system called the Outcomes Questionnaire Analyst (OQ-A). The trial will enroll up to 22 outpatient mental health clinics that serve youth and randomly assign them using covariate constrained randomization to either LOCI or training and technical assistance only. Within each clinic, up to 2 first level leaders will be recruited (max N of 40 total) and a minimum of 3 clinicians will be recruited per site (60 total). Data on youth outpatients who receive services will be collected in two phases. In each phase, a unique cohort of 360 caregivers of youth who participate in services will be sampled from the participating clinics. Caregivers will report on the service outcomes and experiences of eligible youth who receive services. The total caregiver enrollment for two phases will be 720 (360\*2).

Conditions

See the medical conditions and disease areas that this research is targeting or investigating.

Implementation Behavioral Symptoms

Study Design

Understand how the trial is structured, including allocation methods, masking strategies, primary purpose, and other design elements.

Allocation Method

RANDOMIZED

Intervention Model

PARALLEL

Primary Study Purpose

HEALTH_SERVICES_RESEARCH

Blinding Strategy

DOUBLE

Participants Caregivers
Clinicians and caregivers of youth were naïve to condition; however, masking of clinic leaders was not possible due to the nature of the LOCI strategy (which entails leadership training and consultation).

Study Groups

Review each arm or cohort in the study, along with the interventions and objectives associated with them.

LOCI (Intervention)

In clinics assigned to the LOCI condition, executives and first-level leaders will receive leadership training and coaching to support implementation of the OQ-A system. In addition, leaders and clinicians in this condition will receive training and technical assistance to implement the OQ-A measurement-based care system.

Group Type EXPERIMENTAL

Leadership for Organization Change and Implementation (LOCI)

Intervention Type BEHAVIORAL

LOCI is a multicomponent implementation strategy that engages organizational executives and first-level leaders (i.e., those who administratively supervise clinicians) to build an organizational climate to support the implementation of a focal evidence-based practice (EBP) with fidelity. In this study, the focal EBP is the OQ-A system. LOCI includes two overarching components: (1) monthly organizational strategy meetings between executives and LOCI consultants/trainers to develop and embed policies, procedures, and practices that support implementation of a focal EBP, and (2) training and coaching for first-level leaders, to develop their skills in leading implementation. The aim of these components is to develop an organizational implementation climate in which clinicians' perceive that use of the OQ-A with high fidelity is expected, supported, and rewarded.

Training and Technical Assistance Only

Intervention Type BEHAVIORAL

All leaders and clinicians in participating clinics will receive standardized OQ-A training and technical assistance provided by the OQ-A purveyor organization. This includes an initial, 6-hr, in-person OQ-A training; two, live, virtual, 1-hr booster trainings, offered 3 and 5 months after the initial training; and, year-round technical assistance from the OQ-A purveyor organization. Technical assistance includes virtual training sessions, online library of training videos, and customer care representative for technical support.

In addition, to encourage participation in the study, a set of four 1-hr, web-based general leadership seminars will be offered to leaders in the control condition. These will cover topics ranging from effective leadership, to giving effective feedback.

Training and Technical Assistance only (Control)

In clinics assigned to the control group, leaders and clinicians will receive training and technical assistance to implement the OQ-A measurement-based care system. In addition, to support enrollment in this condition, leaders in this condition will be offered access to general web-based leadership seminars.

Group Type ACTIVE_COMPARATOR

Training and Technical Assistance Only

Intervention Type BEHAVIORAL

All leaders and clinicians in participating clinics will receive standardized OQ-A training and technical assistance provided by the OQ-A purveyor organization. This includes an initial, 6-hr, in-person OQ-A training; two, live, virtual, 1-hr booster trainings, offered 3 and 5 months after the initial training; and, year-round technical assistance from the OQ-A purveyor organization. Technical assistance includes virtual training sessions, online library of training videos, and customer care representative for technical support.

In addition, to encourage participation in the study, a set of four 1-hr, web-based general leadership seminars will be offered to leaders in the control condition. These will cover topics ranging from effective leadership, to giving effective feedback.

Interventions

Learn about the drugs, procedures, or behavioral strategies being tested and how they are applied within this trial.

Leadership for Organization Change and Implementation (LOCI)

LOCI is a multicomponent implementation strategy that engages organizational executives and first-level leaders (i.e., those who administratively supervise clinicians) to build an organizational climate to support the implementation of a focal evidence-based practice (EBP) with fidelity. In this study, the focal EBP is the OQ-A system. LOCI includes two overarching components: (1) monthly organizational strategy meetings between executives and LOCI consultants/trainers to develop and embed policies, procedures, and practices that support implementation of a focal EBP, and (2) training and coaching for first-level leaders, to develop their skills in leading implementation. The aim of these components is to develop an organizational implementation climate in which clinicians' perceive that use of the OQ-A with high fidelity is expected, supported, and rewarded.

Intervention Type BEHAVIORAL

Training and Technical Assistance Only

All leaders and clinicians in participating clinics will receive standardized OQ-A training and technical assistance provided by the OQ-A purveyor organization. This includes an initial, 6-hr, in-person OQ-A training; two, live, virtual, 1-hr booster trainings, offered 3 and 5 months after the initial training; and, year-round technical assistance from the OQ-A purveyor organization. Technical assistance includes virtual training sessions, online library of training videos, and customer care representative for technical support.

In addition, to encourage participation in the study, a set of four 1-hr, web-based general leadership seminars will be offered to leaders in the control condition. These will cover topics ranging from effective leadership, to giving effective feedback.

Intervention Type BEHAVIORAL

Eligibility Criteria

Check the participation requirements, including inclusion and exclusion rules, age limits, and whether healthy volunteers are accepted.

Inclusion Criteria

1. Provide outpatient psychotherapy services to children ages 4 to 18 who have emotional and/ or behavioral disorders and their families
2. Have at least 3 full time equivalent clinicians on staff
3. Not currently implementing a digital measurement-based care system clinic wide


1\. Identified as Chief Executive Officer, Executive Director, or high-level administrator at an enrolled clinic


1\. Identified as a clinical supervisor or clinical work-group supervisor/ leader at an enrolled clinic


1. Employed as staff at participating clinic
2. Provides outpatient mental health services (psychotherapy) to youth clients


1. Child is ages 4 to 18 years at intake,
2. Child has been diagnosed with an emotional or behavioral disorder by clinic staff
3. Clinical staff at the site determined that the youth's treatment needs can be appropriately addressed by the clinic
Minimum Eligible Age

4 Years

Eligible Sex

ALL

Accepts Healthy Volunteers

Yes

Sponsors

Meet the organizations funding or collaborating on the study and learn about their roles.

University of California, San Diego

OTHER

Sponsor Role collaborator

University of Central Florida

OTHER

Sponsor Role collaborator

University of Pennsylvania

OTHER

Sponsor Role collaborator

National Institute of Mental Health (NIMH)

NIH

Sponsor Role collaborator

Boise State University

OTHER

Sponsor Role lead

Responsible Party

Identify the individual or organization who holds primary responsibility for the study information submitted to regulators.

Responsibility Role SPONSOR

Principal Investigators

Learn about the lead researchers overseeing the trial and their institutional affiliations.

Nate Williams, PhD

Role: PRINCIPAL_INVESTIGATOR

Boise State University

Locations

Explore where the study is taking place and check the recruitment status at each participating site.

University of California, San Diego

San Diego, California, United States

Site Status

University of Central Florida

Orlando, Florida, United States

Site Status

Boise State University

Boise, Idaho, United States

Site Status

University of Pennsylvania

Philadelphia, Pennsylvania, United States

Site Status

Countries

Review the countries where the study has at least one active or historical site.

United States

References

Explore related publications, articles, or registry entries linked to this study.

Williams NJ, Ehrhart MG, Aarons GA, Esp S, Sklar M, Carandang K, Vega NR, Brookman-Frazee L, Marcus SC. Improving measurement-based care implementation in youth mental health through organizational leadership and climate: a mechanistic analysis within a randomized trial. Implement Sci. 2024 Mar 28;19(1):29. doi: 10.1186/s13012-024-01356-w.

Reference Type DERIVED
PMID: 38549122 (View on PubMed)

Williams NJ, Marcus SC, Ehrhart MG, Sklar M, Esp SM, Carandang K, Vega N, Gomes AE, Brookman-Frazee L, Aarons GA. Randomized Trial of an Organizational Implementation Strategy to Improve Measurement-Based Care Fidelity and Youth Outcomes in Community Mental Health. J Am Acad Child Adolesc Psychiatry. 2024 Oct;63(10):991-1004. doi: 10.1016/j.jaac.2023.11.010. Epub 2023 Dec 7.

Reference Type DERIVED
PMID: 38070868 (View on PubMed)

Choy-Brown M, Williams NJ, Ramirez N, Esp S. Psychometric evaluation of a pragmatic measure of clinical supervision as an implementation strategy. Implement Sci Commun. 2023 Apr 6;4(1):39. doi: 10.1186/s43058-023-00419-1.

Reference Type DERIVED
PMID: 37024945 (View on PubMed)

Provided Documents

Download supplemental materials such as informed consent forms, study protocols, or participant manuals.

Document Type: Study Protocol and Statistical Analysis Plan

View Document

Related Links

Access external resources that provide additional context or updates about the study.

https://www.implementationleadership.com/

Information about Leadership for Organizational Change for Implementation (LOCI).

http://www.oqmeasures.com/

Information about the digital measurement-based care system, OQ-A.

Other Identifiers

Review additional registry numbers or institutional identifiers associated with this trial.

R01MH119127

Identifier Type: NIH

Identifier Source: secondary_id

View Link

8424

Identifier Type: -

Identifier Source: org_study_id

More Related Trials

Additional clinical trials that may be relevant based on similarity analysis.

Improving Mental Health Among the LGBTQ+ Community
NCT05540067 ACTIVE_NOT_RECRUITING PHASE2