Measurement Training and Feedback System: Family-Based Services
NCT ID: NCT03342872
Last Updated: 2021-08-03
Study Results
The study team has not published outcome measurements, participant flow, or safety data for this trial yet. Check back later for updates.
Basic Information
Get a concise snapshot of the trial, including recruitment status, study phase, enrollment targets, and key timeline milestones.
COMPLETED
NA
84 participants
INTERVENTIONAL
2019-04-01
2020-03-31
Brief Summary
Review the sponsor-provided synopsis that highlights what the study is about and why it is being conducted.
FBS have achieved the strongest evidence base for treating ASU and are a prime candidate for upgrading the quality of ASU services in various systems of care. FBS comprise both family participation in services, the systemic parameters wherein family members are included in assessment and treatment activities; and family therapy techniques, the specific interventions that clinicians use to directly target family members and family functioning for change. For FBS to fulfill their potential to enhance ASU treatment systems, FBS implementation must be supported by effective quality assurance procedures designed to ensure that FBS are delivered with fidelity. The proposed study will leverage a strong research-government partnership between the applicant organization and the New York single-state agency for SU services.
The study will first develop innovative quality procedures (Aim 1) that use existing FBS quality metrics to promote high-fidelity FBS: Measurement Training and Feedback System for Implementation (MTFS-I), a pragmatic evidence-based method for increasing FBS quality by providing monthly feedback on therapist-reported FBS delivery along with brief online FBS training modules. The study will then experimentally compare two system-level implementation strategies designed to foster MTFS-I utilization in usual care for ASU. Core Training Only will contain two 3-hour training sessions: Mapping existing FBS and identifying site goals for FBS improvement; and Installing and sustaining the MTFS-I. Core + Facilitation is an additive strategy that will begin with the Core Training sessions and then continue with monthly facilitation meetings for one year to promote MTFS-I use and progress toward FBS improvement.
The study will feature a three-group cluster randomized trial testing Core Training Only versus Core + Facilitation versus no-intervention Control in 9 ASU clinics across New York State. MTFS-I utilization data will be collected from Core Training and Core + Facilitation sites for one-year follow-up (after initial Core Training); FBS quality data on family participation and family therapy technique use will be collected from all sites over one-year follow-up; observational coding methods will verify therapist reports of FBS quality; and client outcome data for all sites will be retrieved from administrative data warehouses over one-year baseline and one-year follow-up. These data will enable between-condition comparisons of FBS delivery (Aim 2: MTFS-I utilization, family participation, family therapy technique use) and client outcomes (Aim 3: therapeutic goal achievement, substance use change). If study aims are achieved, investigators would be positioned to mount a fully powered RCT to test the effectiveness of these FBS quality improvement procedures at scale.
Related Clinical Trials
Explore similar clinical trials based on study characteristics and research focus.
Prevention of Substance Use in At-Risk Students: A Family-Centered Web Program
NCT03060291
Learning Effective Approaches to Prevention
NCT00985595
Computer-delivered Psychosocial Intervention for Adolescent Substance Use Disorders
NCT00957775
Family Based Contingency Management for Adolescent Alcohol Abuse
NCT00595478
Family Support Protocol for Adolescent Internalizing Disorders
NCT06413979
Detailed Description
Dive into the extended narrative that explains the scientific background, objectives, and procedures in greater depth.
Family-based services (FBS) are a prime candidate for upgrading the quality of the ASU treatment system. FBS comprise both family participation in services, the systemic parameters wherein family members are included in assessment and treatment activities; and family therapy techniques, the specific interventions that clinicians use to directly target family members and family functioning for change. FBS have reached the highest levels of empirical validation for ASU, posting an exemplary record of success in comparison to alternative evidence-based treatments as well as usual care, and FBS produce the largest average effect sizes by a large margin. Due in large part to this extensive evidence base, FBS have long been strongly endorsed by federal agencies, national associations, and policy-making groups. There is also incentive from ASU clinical providers and payers to deliver FBS, which are now approved for treating ASU and disruptive behavior disorders by federal and private insurance plans and regulatory agencies that govern licensed treatment providers. FBS are also widely endorsed by therapists treating youth in routine care. Thus there is impetus from all corners to expand FBS implementation in usual care for ASU.
There are several well-documented barriers to dissemination of manualized FBS models, including the cost and complexity of delivering these models in everyday settings. In addition, for FBS to fulfill their potential to enhance the quality of ASU treatment in usual care, FBS implementation must be supported by effective quality assurance (QA) procedures designed to ensure that FBS are delivered with fidelity, that is, to the target population, by appropriately trained providers, and in accord with specified procedures. The time is propitious for developing such procedures in the current healthcare market, which is incentivized to establish reliable standards for quality care. First, there is growing demand for innovative quality indicators of behavioral treatment that assess appropriateness and potential effectiveness of care. Conventional quality indicators capture broad principles of behavioral care such as treatment assignment, retention and follow-up rates, referrals for ancillary care, and client safety. However, the emerging quality-of-care implementation framework advocates that fidelity to evidence-based treatments itself be considered a quality indicator. Second, in order to properly monitor treatment fidelity in usual care, there is urgent need to develop quality metrics that can reliably and pragmatically measure fidelity in front-line treatment settings. The implications of emerging scientific and policy mandates for improving treatment quality are clear with regard to FBS for ASU: Pragmatic QA procedures for ensuring high-fidelity FBS need to be developed, and these procedures need to be anchored by reliable FBS fidelity metrics.
This study will develop pragmatic QA procedures designed to promote FBS adoption and quality in ASU treatment systems using a measurement feedback system (MFS). MFS is a performance feedback loop in which a given quality indicator is continuously monitored by the clinician to gauge case progress and support clinical decision-making. MFS feedback loops usually take the form of easy-to-digest data reports that provide summary appraisals of individual client progress on selected indicators in comparison to a desired benchmark. To date MFS has been used in mental health care to enable monitoring of client outcomes primarily-for example, therapists tracking weekly client-report depression scores compared to age-adjusted norms on a depression inventory. With adults, utilizing MFS has led to impressive gains in outcomes with diverse samples: preventing early treatment failure, reversing symptom deterioration, and enhancing overall outcomes. MFS research on youth is in its early stages but growing rapidly, with strong enthusiasm about reaping comparable benefits. Importantly, clinicians trained in MFS develop positive attitudes toward it.
MFS successes for client outcomes have generated enthusiastic support for the value of developing complementary MFS procedures that provide measurement Training along with data-based Feedback on implementation: MTFS-I. Due to streamlined administration procedures and emerging evidence, MTFS-I has been labeled a promising QA strategy with broad dissemination potential for youth. MTFS-I has already been incorporated into manualized QA procedures to bolster fidelity to several varieties of manualized treatment; in a few of these instances, feedback reports contain data input from therapists on fidelity indicators. One study found that MTFS-I for clinician-reported session content during youth therapy increased the likelihood and rapidity of addressing that same content in future sessions. In keeping with primary goals of the R34 mechanism, this study will test a pragmatic MTFS-I designed to improve the quality of FBS implementation in ASU treatment sites. The MTFS-I will draw on technology from existing feedback systems, but also, be the first to target system-level FBS delivery for ASU. The four MTFS-I components, described in C4, are designed to increase the extensiveness (i.e., amount and frequency of) FBS implementation.
Conditions
See the medical conditions and disease areas that this research is targeting or investigating.
Study Design
Understand how the trial is structured, including allocation methods, masking strategies, primary purpose, and other design elements.
RANDOMIZED
PARALLEL
TREATMENT
NONE
Study Groups
Review each arm or cohort in the study, along with the interventions and objectives associated with them.
Core Training
Core Training: FBS System Mapping and MTFS-I Installation
Core Training will be a blended strategy wherein multiple interventions targeting multiple agency roles are combined to help ASU treatment providers increase their FBS quality. Core Training will be conducted with administrators, supervisors, data managers, and clinical staff. It will contain two 3-hour sessions focusing on FBS System Mapping and MTFS-I Installation. FBS System Mapping will focus on process mapping of existing site policies and practices for assessing family functioning at intake, educating families about intervention strategies and activities, including family members in treatment sessions, and hiring and supporting clinicians trained in and routinely delivering FBS. MTFS-Installation will focus on introducing MTFS-I components and integrating principles of DDDM.
Core Training & Facilitation
Core Training & Facilitation: FBS System Mapping and MTFS-I Installation plus monthly on-site meetings
Facilitation will consist of monthly on-site meetings to review progress toward FBS improvements, discuss MTFS-I feedback reports and online resource use, and provide intensive technical assistance for progressing toward site-selected FBS improvement goals. Meetings will involve a subset of site-delegated participants from Core Training sessions to serve as a local change team (quality improvement team). The efficacy of facilitation-guided change teams has been established. Although there are several models for creating change teams, at least three features are common: (1) members represent multiple organizational roles (supervisors, data managers, line staff); (2) focus on data-driven decisions; and (3) use of external expert advisors.
Control
No interventions assigned to this group
Interventions
Learn about the drugs, procedures, or behavioral strategies being tested and how they are applied within this trial.
Core Training: FBS System Mapping and MTFS-I Installation
Core Training will be a blended strategy wherein multiple interventions targeting multiple agency roles are combined to help ASU treatment providers increase their FBS quality. Core Training will be conducted with administrators, supervisors, data managers, and clinical staff. It will contain two 3-hour sessions focusing on FBS System Mapping and MTFS-I Installation. FBS System Mapping will focus on process mapping of existing site policies and practices for assessing family functioning at intake, educating families about intervention strategies and activities, including family members in treatment sessions, and hiring and supporting clinicians trained in and routinely delivering FBS. MTFS-Installation will focus on introducing MTFS-I components and integrating principles of DDDM.
Core Training & Facilitation: FBS System Mapping and MTFS-I Installation plus monthly on-site meetings
Facilitation will consist of monthly on-site meetings to review progress toward FBS improvements, discuss MTFS-I feedback reports and online resource use, and provide intensive technical assistance for progressing toward site-selected FBS improvement goals. Meetings will involve a subset of site-delegated participants from Core Training sessions to serve as a local change team (quality improvement team). The efficacy of facilitation-guided change teams has been established. Although there are several models for creating change teams, at least three features are common: (1) members represent multiple organizational roles (supervisors, data managers, line staff); (2) focus on data-driven decisions; and (3) use of external expert advisors.
Eligibility Criteria
Check the participation requirements, including inclusion and exclusion rules, age limits, and whether healthy volunteers are accepted.
Inclusion Criteria
Exclusion Criteria
12 Years
21 Years
ALL
No
Sponsors
Meet the organizations funding or collaborating on the study and learn about their roles.
National Institute on Drug Abuse (NIDA)
NIH
The National Center on Addiction and Substance Abuse at Columbia University
OTHER
Responsible Party
Identify the individual or organization who holds primary responsibility for the study information submitted to regulators.
Principal Investigators
Learn about the lead researchers overseeing the trial and their institutional affiliations.
Aaron Hogue, PhD
Role: PRINCIPAL_INVESTIGATOR
The National Center on Addiction and Substance Abuse
Locations
Explore where the study is taking place and check the recruitment status at each participating site.
Outreach
Brentwood, New York, United States
Horizon Health
Buffalo, New York, United States
Countries
Review the countries where the study has at least one active or historical site.
References
Explore related publications, articles, or registry entries linked to this study.
Hogue A, MacLean A, Bobek M, Porter N, Bruynesteyn L, Jensen-Doss A, Henderson CE. Pilot Trial of Online Measurement Training and Feedback in Family Therapy for Adolescent Behavior Problems. J Clin Child Adolesc Psychol. 2023 Nov-Dec;52(6):850-865. doi: 10.1080/15374416.2022.2051529. Epub 2022 Apr 6.
Hogue A, Bobek M, Porter N, MacLean A, Bruynesteyn L, Jensen-Doss A, Henderson CE. Therapist Self-Report of Fidelity to Core Elements of Family Therapy for Adolescent Behavior Problems: Psychometrics of a Pragmatic Quality Indicator Tool. Adm Policy Ment Health. 2022 Mar;49(2):298-311. doi: 10.1007/s10488-021-01164-0. Epub 2021 Sep 2.
Hogue A, Porter N, Bobek M, MacLean A, Bruynesteyn L, Jensen-Doss A, Dauber S, Henderson CE. Online Training of Community Therapists in Observational Coding of Family Therapy Techniques: Reliability and Accuracy. Adm Policy Ment Health. 2022 Jan;49(1):139-151. doi: 10.1007/s10488-021-01152-4. Epub 2021 Jul 23.
Hogue A, Dauber S, Bobek M, Jensen-Doss A, Henderson CE. Measurement Training and Feedback System for Implementation of family-based services for adolescent substance use: protocol for a cluster randomized trial of two implementation strategies. Implement Sci. 2019 Mar 11;14(1):25. doi: 10.1186/s13012-019-0874-6.
Other Identifiers
More Related Trials
Additional clinical trials that may be relevant based on similarity analysis.