Trial Outcomes & Findings for Using Mobile Technology to Enhance Multisystemic Therapy (MST) Outcomes (NCT NCT02320903)

NCT ID: NCT02320903

Last Updated: 2018-02-14

Results Overview

Percent of parents who set up a behavior plan for teen using app features.

• Recruitment status: COMPLETED
• Study phase: NA
• Target enrollment: 88 participants
• Primary outcome timeframe: up to 45-days
• Results posted on: 2018-02-14

Participant Flow

We completed a four-week within-subjects pre-post trial to determine the usability, acceptability, and feasibility. MST therapists in Seattle, New York City, Hartford, and Washington, DC referred families to the study. Parents contacted the study team to indicate their interest. Therapists of referred families also were enrolled in the study.

Initial App Set Up: Clinicians were solely responsible for assisting families to set up their app; however, many clinicians were uncomfortable with this because they were not "tech savvy". Solution: Phase II will include a self-guided setup tool that will empower users (parents, youth) to complete the set up independently.

Participant milestones

Measure	Therapists In this study, all enrolled caregivers and teens will be referred to the study by their participating therapists. All caregiver/teen dyads will use the VillageWhere App Prototype that has been developed for this study. They are requested to use it as often as they would like throughout the duration of the trial. The app is designed to be used several times throughout each day. VillageWhere App	Parents/Caregivers In this study, all enrolled caregivers and teens will be referred to the study by their participating therapists. All caregiver/teen dyads will use the VillageWhere App Prototype that has been developed for this study. They are requested to use it as often as they would like throughout the duration of the trial. The app is designed to be used several times throughout each day. VillageWhere App	Youth/Teens In this study, all enrolled caregivers and teens will be referred to the study by their participating therapists. All caregiver/teen dyads will use the VillageWhere App Prototype that has been developed for this study. They are requested to use it as often as they would like throughout the duration of the trial. The app is designed to be used several times throughout each day. VillageWhere App
Overall Study STARTED	24	32	32
Overall Study COMPLETED	16	16	16
Overall Study NOT COMPLETED	8	16	16

Reasons for withdrawal

Measure	Therapists In this study, all enrolled caregivers and teens will be referred to the study by their participating therapists. All caregiver/teen dyads will use the VillageWhere App Prototype that has been developed for this study. They are requested to use it as often as they would like throughout the duration of the trial. The app is designed to be used several times throughout each day. VillageWhere App	Parents/Caregivers In this study, all enrolled caregivers and teens will be referred to the study by their participating therapists. All caregiver/teen dyads will use the VillageWhere App Prototype that has been developed for this study. They are requested to use it as often as they would like throughout the duration of the trial. The app is designed to be used several times throughout each day. VillageWhere App	Youth/Teens In this study, all enrolled caregivers and teens will be referred to the study by their participating therapists. All caregiver/teen dyads will use the VillageWhere App Prototype that has been developed for this study. They are requested to use it as often as they would like throughout the duration of the trial. The app is designed to be used several times throughout each day. VillageWhere App
Overall Study Withdrawal by Subject	0	9	9
Overall Study Exited therapy; no longer eligible	8	2	2
Overall Study Lost to Follow-up	0	5	5

Baseline Characteristics

Demographics reported only for families that completed the study.

Baseline characteristics by cohort

Measure	Therapists n=24 Participants In this study, all enrolled caregivers and teens will be referred to the study by their participating therapists. All caregiver/teen dyads will use the VillageWhere App Prototype that has been developed for this study. They are requested to use it as often as they would like throughout the duration of the trial. The app is designed to be used several times throughout each day. VillageWhere App	Parents/Caregivers n=32 Participants In this study, all enrolled caregivers and teens will be referred to the study by their participating therapists. All caregiver/teen dyads will use the VillageWhere App Prototype that has been developed for this study. They are requested to use it as often as they would like throughout the duration of the trial. The app is designed to be used several times throughout each day. VillageWhere App	Youth/Teens n=32 Participants In this study, all enrolled caregivers and teens will be referred to the study by their participating therapists. All caregiver/teen dyads will use the VillageWhere App Prototype that has been developed for this study. They are requested to use it as often as they would like throughout the duration of the trial. The app is designed to be used several times throughout each day. VillageWhere App	Total n=88 Participants Total of all reporting groups
Age, Continuous Age	—	41.7 Years STANDARD_DEVIATION 0 • n=16 Participants • Demographics reported only for families that completed the study.	14.6 Years STANDARD_DEVIATION 1.6 • n=16 Participants • Demographics reported only for families that completed the study.	24.15 Years STANDARD_DEVIATION 0 • n=32 Participants • Demographics reported only for families that completed the study.
Sex: Female, Male Female	22 Participants n=24 Participants • Demographics reported only for families that completed the study.	15 Participants n=16 Participants • Demographics reported only for families that completed the study.	9 Participants n=16 Participants • Demographics reported only for families that completed the study.	46 Participants n=56 Participants • Demographics reported only for families that completed the study.
Sex: Female, Male Male	2 Participants n=24 Participants • Demographics reported only for families that completed the study.	1 Participants n=16 Participants • Demographics reported only for families that completed the study.	7 Participants n=16 Participants • Demographics reported only for families that completed the study.	10 Participants n=56 Participants • Demographics reported only for families that completed the study.
Ethnicity (NIH/OMB) Hispanic or Latino	2 Participants n=24 Participants	3 Participants n=32 Participants	3 Participants n=32 Participants	8 Participants n=88 Participants
Ethnicity (NIH/OMB) Not Hispanic or Latino	20 Participants n=24 Participants	12 Participants n=32 Participants	11 Participants n=32 Participants	43 Participants n=88 Participants
Ethnicity (NIH/OMB) Unknown or Not Reported	2 Participants n=24 Participants	17 Participants n=32 Participants	18 Participants n=32 Participants	37 Participants n=88 Participants
Race (NIH/OMB) American Indian or Alaska Native	0 Participants n=24 Participants	0 Participants n=32 Participants	0 Participants n=32 Participants	0 Participants n=88 Participants
Race (NIH/OMB) Asian	1 Participants n=24 Participants	0 Participants n=32 Participants	0 Participants n=32 Participants	1 Participants n=88 Participants
Race (NIH/OMB) Native Hawaiian or Other Pacific Islander	0 Participants n=24 Participants	0 Participants n=32 Participants	0 Participants n=32 Participants	0 Participants n=88 Participants
Race (NIH/OMB) Black or African American	1 Participants n=24 Participants	5 Participants n=32 Participants	5 Participants n=32 Participants	11 Participants n=88 Participants
Race (NIH/OMB) White	5 Participants n=24 Participants	9 Participants n=32 Participants	8 Participants n=32 Participants	22 Participants n=88 Participants
Race (NIH/OMB) More than one race	0 Participants n=24 Participants	1 Participants n=32 Participants	1 Participants n=32 Participants	2 Participants n=88 Participants
Race (NIH/OMB) Unknown or Not Reported	17 Participants n=24 Participants	17 Participants n=32 Participants	18 Participants n=32 Participants	52 Participants n=88 Participants
Region of Enrollment United States	24 Participants n=24 Participants	32 Participants n=32 Participants	32 Participants n=32 Participants	88 Participants n=88 Participants

PRIMARY outcome

Timeframe: up to 45-days

Population: All parent/caregiver and teen participants analyzed.

Percent of parents who set up a behavior plan for teen using app features.

Outcome measures

Measure	Parents/Caregivers n=16 Participants All caregivers who used the VillageWhere App Prototype that was developed for this study. They were requested to use it as often as they would like throughout the duration of the trial. The app is designed to be used several times throughout each day. VillageWhere App	Youth/Teens All caregiver/teen dyads used the VillageWhere App Prototype that was developed for this study. They were requested to use it as often as they would like throughout the duration of the trial. The app is designed to be used several times throughout each day. VillageWhere App
App Usage - Parent Set up / Modified an App-based Behavior Plan for the Teen	16 Participants	—

PRIMARY outcome

Timeframe: up to 45-days

Population: Percent of caregivers who set and allocated points to the teen (teens who had points redeemed).

How many parents/caregivers set up a reward system and redeemed at least some points for the teen.

Outcome measures

Measure	Parents/Caregivers n=16 Participants All caregivers who used the VillageWhere App Prototype that was developed for this study. They were requested to use it as often as they would like throughout the duration of the trial. The app is designed to be used several times throughout each day. VillageWhere App	Youth/Teens All caregiver/teen dyads used the VillageWhere App Prototype that was developed for this study. They were requested to use it as often as they would like throughout the duration of the trial. The app is designed to be used several times throughout each day. VillageWhere App
App Usage - Set up and Allocated / Earned Points (Rewards) for Positive Teen Behavior	16 Participants	—

PRIMARY outcome

Timeframe: up to 45-days

Percentage of parent/caregivers who set either required or off-limits locations for their teens.

Outcome measures

Measure	Parents/Caregivers n=16 Participants All caregivers who used the VillageWhere App Prototype that was developed for this study. They were requested to use it as often as they would like throughout the duration of the trial. The app is designed to be used several times throughout each day. VillageWhere App	Youth/Teens All caregiver/teen dyads used the VillageWhere App Prototype that was developed for this study. They were requested to use it as often as they would like throughout the duration of the trial. The app is designed to be used several times throughout each day. VillageWhere App
App Usage - Parent Set Geolocation Expectations for the Teen.	14 Participants	—

PRIMARY outcome

Timeframe: up to 45 days

Population: All parent/caregiver and teen participants analyzed

The percentage of participants who viewed notifications that the teen was or was not meeting a behavioral expectation. Both parents and teens had this capability.

Outcome measures

Measure	Parents/Caregivers n=16 Participants All caregivers who used the VillageWhere App Prototype that was developed for this study. They were requested to use it as often as they would like throughout the duration of the trial. The app is designed to be used several times throughout each day. VillageWhere App	Youth/Teens n=16 Participants All caregiver/teen dyads used the VillageWhere App Prototype that was developed for this study. They were requested to use it as often as they would like throughout the duration of the trial. The app is designed to be used several times throughout each day. VillageWhere App
App Usage - Viewed Notifications Regarding Behavioral Expectations Met/Not Met	14 Participants	14 Participants

PRIMARY outcome

Timeframe: up to 45 days

Population: Only the parent/caregiver version of the app had this feature.

The app included 5 brief video vignettes depicting an effective parenting technique.

Outcome measures

Measure	Parents/Caregivers n=16 Participants All caregivers who used the VillageWhere App Prototype that was developed for this study. They were requested to use it as often as they would like throughout the duration of the trial. The app is designed to be used several times throughout each day. VillageWhere App	Youth/Teens All caregiver/teen dyads used the VillageWhere App Prototype that was developed for this study. They were requested to use it as often as they would like throughout the duration of the trial. The app is designed to be used several times throughout each day. VillageWhere App
App Usage - Viewed Parent Coaching Videos	3 Participants	—

PRIMARY outcome

Timeframe: up to 45 days

Population: Analyses performed separately for parents and teens.

Youth/teen points earned over time were depicted on a graph for each day of use. To view the graph, caregivers/parents and youth/teens had to click on an app button.

Outcome measures

Measure	Parents/Caregivers n=16 Participants All caregivers who used the VillageWhere App Prototype that was developed for this study. They were requested to use it as often as they would like throughout the duration of the trial. The app is designed to be used several times throughout each day. VillageWhere App	Youth/Teens n=16 Participants All caregiver/teen dyads used the VillageWhere App Prototype that was developed for this study. They were requested to use it as often as they would like throughout the duration of the trial. The app is designed to be used several times throughout each day. VillageWhere App
App Usage - View Progress Graph (Points Earned Over Time)	10 Participants	8 Participants

PRIMARY outcome

Timeframe: up to 45 days

Population: Only parent/caregivers were administered this measure.

Parent/caregiver was prompted randomly 3 times each week to rate on a scale of 1 (strongly disagree) to 7 (completely agree), how helpful was the app to you today?

Outcome measures

Measure	Parents/Caregivers n=16 Participants All caregivers who used the VillageWhere App Prototype that was developed for this study. They were requested to use it as often as they would like throughout the duration of the trial. The app is designed to be used several times throughout each day. VillageWhere App	Youth/Teens All caregiver/teen dyads used the VillageWhere App Prototype that was developed for this study. They were requested to use it as often as they would like throughout the duration of the trial. The app is designed to be used several times throughout each day. VillageWhere App
App Satisfaction Rating - the App Was Helpful Today	5.95 units on a scale Standard Deviation .999	—

PRIMARY outcome

Timeframe: up to 45 days

Population: Only parent/caregivers were given this question.

Parent/caregiver was prompted randomly 3 times each week to rate on a scale of 1 (strongly disagree) to 7 (completely agree), the app gives me new ways of intervening with my teen.

Outcome measures

Measure	Parents/Caregivers n=16 Participants All caregivers who used the VillageWhere App Prototype that was developed for this study. They were requested to use it as often as they would like throughout the duration of the trial. The app is designed to be used several times throughout each day. VillageWhere App	Youth/Teens All caregiver/teen dyads used the VillageWhere App Prototype that was developed for this study. They were requested to use it as often as they would like throughout the duration of the trial. The app is designed to be used several times throughout each day. VillageWhere App
App Satisfaction Rating - I Have Ways to Intervene With my Teen.	6.00 units on a scale Standard Deviation 1.09	—

PRIMARY outcome

Timeframe: up to 45 days

Population: Parent/caregiver and teen participants were analyzed separately on this measure.

Parent/caregiver and teen was prompted randomly 3 times each week to rate on a scale of 1 (totally unsatisfied) to 7 (completely satisfied), overall, how satisfied are you with the app today?

Outcome measures

Measure	Parents/Caregivers n=16 Participants All caregivers who used the VillageWhere App Prototype that was developed for this study. They were requested to use it as often as they would like throughout the duration of the trial. The app is designed to be used several times throughout each day. VillageWhere App	Youth/Teens n=16 Participants All caregiver/teen dyads used the VillageWhere App Prototype that was developed for this study. They were requested to use it as often as they would like throughout the duration of the trial. The app is designed to be used several times throughout each day. VillageWhere App
App Satisfaction Rating - Overall Satisfaction	5.91 units on a scale Standard Deviation 1.21	6.14 units on a scale Standard Deviation 0.72

PRIMARY outcome

Timeframe: up to 45 days

Population: Only youth/teens were provided this question.

Three times each week, at random, youth/teens were asked to rate on a scale of 1 (strongly disagree) to 7 (strongly agree), my parent is noticing and rewarding good behavior. All ratings were averaged across full period of app use.

Outcome measures

Measure	Parents/Caregivers n=16 Participants All caregivers who used the VillageWhere App Prototype that was developed for this study. They were requested to use it as often as they would like throughout the duration of the trial. The app is designed to be used several times throughout each day. VillageWhere App	Youth/Teens All caregiver/teen dyads used the VillageWhere App Prototype that was developed for this study. They were requested to use it as often as they would like throughout the duration of the trial. The app is designed to be used several times throughout each day. VillageWhere App
App Satisfaction Rating - Parent is Noticing and Rewarding Good Behavior	6.19 units on a scale Standard Deviation 1.15	—

PRIMARY outcome

Timeframe: up to 45 days

Population: Only teens were provided with this question.

Youth/teens in the study were prompted 3 times/week during period of app usage to rate, on a scale of 1 (strongly disagree) to 7 (strongly agree), "I like getting prompts and reminders from the app."

Outcome measures

Measure	Parents/Caregivers n=16 Participants All caregivers who used the VillageWhere App Prototype that was developed for this study. They were requested to use it as often as they would like throughout the duration of the trial. The app is designed to be used several times throughout each day. VillageWhere App	Youth/Teens All caregiver/teen dyads used the VillageWhere App Prototype that was developed for this study. They were requested to use it as often as they would like throughout the duration of the trial. The app is designed to be used several times throughout each day. VillageWhere App
App Satisfaction - I Like Getting Prompts and Reminders	5.62 units on a scale Standard Deviation 1.27	—

SECONDARY outcome

Timeframe: Baseline and Post assessment (end of 45-day app use period)

Population: Parent/caregivers and youth/teens results were analyzed separately.

The Achenbach System of Empirically-Based Assessment is a measure of youth problem behavior and psychiatric symptomatology that has parallel parent (report of teen) and youth (self-report) versions to allow for different perspectives on the problem. The parent version is called the Child Behavior Checklist (CBCL) and the youth version is called the Youth Self Report (YSR). Selected subscales from the CBCL and the YSR were administered before and after the 4 weeks of app usage, in this case, the aggression subscale. Higher values indicate worse symptoms. Possible range on this subcale is 0 - 36; a score of 13 or higher indicates clinically significant aggression, defined as aggression that is higher than that of 93% of teens in the United States.

Outcome measures

Measure	Parents/Caregivers n=16 Participants All caregivers who used the VillageWhere App Prototype that was developed for this study. They were requested to use it as often as they would like throughout the duration of the trial. The app is designed to be used several times throughout each day. VillageWhere App	Youth/Teens n=16 Participants All caregiver/teen dyads used the VillageWhere App Prototype that was developed for this study. They were requested to use it as often as they would like throughout the duration of the trial. The app is designed to be used several times throughout each day. VillageWhere App
Achenbach System of Empirically-Based Assessment, Aggression Subscale Mean at Time 1 (baseline)	13.75 units on a scale Standard Deviation 8.80	11.29 units on a scale Standard Deviation 4.82
Achenbach System of Empirically-Based Assessment, Aggression Subscale Mean at Time 2 (post-usage)	12.31 units on a scale Standard Deviation 8.80	10.14 units on a scale Standard Deviation 5.43

SECONDARY outcome

Timeframe: Baseline and Post assessment (end of 45-day app use period)

Population: Parent/caregivers and youth/teens results were analyzed separately. Least squares means show amount of difference from pre- to post-testing in paired samples T tests.

The Achenbach System of Empirically-Based Assessment is a measure of youth problem behavior and psychiatric symptomatology that has parallel parent (report of teen) and youth (self-report) versions to allow for different perspectives on the problem. The parent version is called the Child Behavior Checklist (CBCL) and the youth version is called the Youth Self Report (YSR). Selected subscales from the CBCL and the YSR were administered before and after the 4 weeks of app usage, in this case, the depression subscale. Higher values indicate worse symptoms. Possible range on this subcale is 0 - 26; a score of 8 or higher indicates clinically significant depression, defined as depressive symptoms higher than that of 93% of teens in the United States.

Outcome measures

Measure	Parents/Caregivers n=16 Participants All caregivers who used the VillageWhere App Prototype that was developed for this study. They were requested to use it as often as they would like throughout the duration of the trial. The app is designed to be used several times throughout each day. VillageWhere App	Youth/Teens n=16 Participants All caregiver/teen dyads used the VillageWhere App Prototype that was developed for this study. They were requested to use it as often as they would like throughout the duration of the trial. The app is designed to be used several times throughout each day. VillageWhere App
Achenbach System of Empirically-Based Assessment, Depression Subscale Pre-test mean	6.93 units on a scale Standard Deviation 5.36	6.29 units on a scale Standard Deviation 4.81
Achenbach System of Empirically-Based Assessment, Depression Subscale Post-test mean	5.80 units on a scale Standard Deviation 5.17	4.71 units on a scale Standard Deviation 3.91

SECONDARY outcome

Timeframe: Baseline and Post assessment (end of 45-day app use period)

Population: Parent/caregivers and youth/teens results were analyzed separately.

The Achenbach System of Empirically-Based Assessment is a measure of youth problem behavior and psychiatric symptomatology that has parallel parent (report of teen) and youth (self-report) versions to allow for different perspectives on the problem. The parent version is called the Child Behavior Checklist (CBCL) and the youth version is called the Youth Self Report (YSR). Selected subscales from the CBCL and the YSR were administered before and after the 4 weeks of app usage, in this case, the rule-breaking subscale. Higher values indicate worse symptoms. Possible range on this subcale is 0 - 34; a score of 9 or higher indicates clinically significant rule-breaking, defined as rule-breaking that is higher than that of 93% of teens in the United States.

Outcome measures

Measure	Parents/Caregivers n=16 Participants All caregivers who used the VillageWhere App Prototype that was developed for this study. They were requested to use it as often as they would like throughout the duration of the trial. The app is designed to be used several times throughout each day. VillageWhere App	Youth/Teens n=16 Participants All caregiver/teen dyads used the VillageWhere App Prototype that was developed for this study. They were requested to use it as often as they would like throughout the duration of the trial. The app is designed to be used several times throughout each day. VillageWhere App
Achenbach System of Empirically-Based Assessment, Rule-breaking Subscale Mean at Time 1 (baseline)	9.71 units on a scale Standard Deviation 6.34	10.07 units on a scale Standard Deviation 4.20
Achenbach System of Empirically-Based Assessment, Rule-breaking Subscale Mean at Time 2 (post-usage)	9.07 units on a scale Standard Deviation 6.49	9.21 units on a scale Standard Deviation 4.61

SECONDARY outcome

Timeframe: Baseline and Post assessment (end of 45-day app use period)

Population: Parent/caregivers and youth/teens results were analyzed separately.

This measure of extent to which parents supervise and monitor youth whereabouts was administered to parents/caregivers and to youth/teens before and after the 4 weeks of app usage.This 8-item scale has a scored range of 0 (minimum score) - 16 (maximum score), with high scores indicating more or better parental supervision/monitoring.

Outcome measures

Measure	Parents/Caregivers n=16 Participants All caregivers who used the VillageWhere App Prototype that was developed for this study. They were requested to use it as often as they would like throughout the duration of the trial. The app is designed to be used several times throughout each day. VillageWhere App	Youth/Teens n=16 Participants All caregiver/teen dyads used the VillageWhere App Prototype that was developed for this study. They were requested to use it as often as they would like throughout the duration of the trial. The app is designed to be used several times throughout each day. VillageWhere App
Loeber Parental Supervision Scale Mean at Time 1 (baseline)	13.00 units on a scale Standard Deviation 2.25	10.86 units on a scale Standard Deviation 3.32
Loeber Parental Supervision Scale Mean at Time 2 (post-usage)	13.38 units on a scale Standard Deviation 2.45	11.50 units on a scale Standard Deviation 2.44

SECONDARY outcome

Timeframe: Baseline and Post assessment (end of 45-day app use period)

Population: Parent/caregivers and youth/teens results were analyzed separately.

This measure of extent to which parents express warmth and encouragement to youth was administered to parents/caregivers and to youth/teens before and after the 4 weeks of app usage.This 9-item scale has a scored range of 0 (minimum score) - 18 (maximum score), with high scores indicating more parental positivity.

Outcome measures

Measure	Parents/Caregivers n=16 Participants All caregivers who used the VillageWhere App Prototype that was developed for this study. They were requested to use it as often as they would like throughout the duration of the trial. The app is designed to be used several times throughout each day. VillageWhere App	Youth/Teens n=16 Participants All caregiver/teen dyads used the VillageWhere App Prototype that was developed for this study. They were requested to use it as often as they would like throughout the duration of the trial. The app is designed to be used several times throughout each day. VillageWhere App
Loeber Positive Parenting Scale Mean at Time 1 (baseline)	8.87 units on a scale Standard Deviation 4.97	8.57 units on a scale Standard Deviation 2.24
Loeber Positive Parenting Scale Mean at Time 2 (post-usage)	11.39 units on a scale Standard Deviation 2.95	8.93 units on a scale Standard Deviation 2.79

SECONDARY outcome

Timeframe: Baseline and Post assessment (end of 45-day app use period)

Population: Parent/caregivers and youth/teens results were analyzed separately.

This measure of extent to which parents are consistent in their rules, expectations, and discipline techniques with youth was administered to parents/caregivers and to youth/teens before and after the 4 weeks of app usage. This 5-item scale has a scored range of 0 (minimum score) - 10 (maximum score), with high scores indicating more consistent / better parental discipline follow-through.

Outcome measures

Measure	Parents/Caregivers n=16 Participants All caregivers who used the VillageWhere App Prototype that was developed for this study. They were requested to use it as often as they would like throughout the duration of the trial. The app is designed to be used several times throughout each day. VillageWhere App	Youth/Teens n=16 Participants All caregiver/teen dyads used the VillageWhere App Prototype that was developed for this study. They were requested to use it as often as they would like throughout the duration of the trial. The app is designed to be used several times throughout each day. VillageWhere App
Loeber Parental Consistency Scale Mean at Time 1 (baseline)	1.87 units on a scale Standard Deviation 1.64	5.21 units on a scale Standard Deviation 2.01
Loeber Parental Consistency Scale Mean at Time 2 (post-usage)	2.27 units on a scale Standard Deviation 2.02	5.57 units on a scale Standard Deviation 2.87

SECONDARY outcome

Timeframe: Change over 30 days of app usage (baseline to post-assessment)

Population: All parents/caregivers who completed the study.

Degree to which parents feel that their parenting techniques are working in terms of managing teen behavior challenges. This 3-item scale has a scored range of 0 (minimum score) - 8 (maximum score), with high scores indicating better discipline effectiveness (e.g., "I feel like the punishment I give works in curbing youth behavior").

Outcome measures

Measure	Parents/Caregivers n=16 Participants All caregivers who used the VillageWhere App Prototype that was developed for this study. They were requested to use it as often as they would like throughout the duration of the trial. The app is designed to be used several times throughout each day. VillageWhere App	Youth/Teens All caregiver/teen dyads used the VillageWhere App Prototype that was developed for this study. They were requested to use it as often as they would like throughout the duration of the trial. The app is designed to be used several times throughout each day. VillageWhere App
Loeber Parental Effectiveness Scale Mean at Time 1 (baseline)	4.20 units on a scale Standard Deviation 1.90	—
Loeber Parental Effectiveness Scale Mean at Time 2 (post-usage)	4.40 units on a scale Standard Deviation 1.88	—

SECONDARY outcome

Timeframe: Change over 30 days of app usage (baseline to post-assessment)

Population: All parents/caregivers who completed the study.

Degree to which parents are experiencing stress related to parenting. This 10-item scale has a scored range of 0 (minimum score) - 40 (maximum score), with high scores indicating more stress related to parenting.

Outcome measures

Measure	Parents/Caregivers n=16 Participants All caregivers who used the VillageWhere App Prototype that was developed for this study. They were requested to use it as often as they would like throughout the duration of the trial. The app is designed to be used several times throughout each day. VillageWhere App	Youth/Teens All caregiver/teen dyads used the VillageWhere App Prototype that was developed for this study. They were requested to use it as often as they would like throughout the duration of the trial. The app is designed to be used several times throughout each day. VillageWhere App
Perceived Stress Scale (PSS) Mean at Time 1 (baseline)	18.09 units on a scale Standard Deviation 8.14	—
Perceived Stress Scale (PSS) Mean at Time 2 (post-usage)	12.73 units on a scale Standard Deviation 4.45	—

SECONDARY outcome

Timeframe: Change over 30 days of app usage (baseline to post-assessment)

Population: All parents/caregivers who completed the study.

Degree to which parents feel efficacious and confident in managing parenting challenges. This 20-item scale has a scored range of 0 (minimum score) - 40 (maximum score), with high scores indicating that the parent has a higher sense of feeling efficacious in their role as a parent.

Outcome measures

Measure	Parents/Caregivers n=16 Participants All caregivers who used the VillageWhere App Prototype that was developed for this study. They were requested to use it as often as they would like throughout the duration of the trial. The app is designed to be used several times throughout each day. VillageWhere App	Youth/Teens All caregiver/teen dyads used the VillageWhere App Prototype that was developed for this study. They were requested to use it as often as they would like throughout the duration of the trial. The app is designed to be used several times throughout each day. VillageWhere App
Parental Locus of Control Scale Mean at Time 1 (baseline)	15.25 units on a scale Standard Deviation 6.22	—
Parental Locus of Control Scale Mean at Time 2 (post-usage)	18.63 units on a scale Standard Deviation 8.72	—

SECONDARY outcome

Timeframe: over 30 days of app usage

Population: Youth/teens who used app only

Youth report of how much parents actually know about the youth's whereabouts/activities. This 5-item scale has a scored range of 0 (minimum score) - 15 (maximum score), with high scores indicating that the parent knows more about what teens are actually doing.

Outcome measures

Measure	Parents/Caregivers n=16 Participants All caregivers who used the VillageWhere App Prototype that was developed for this study. They were requested to use it as often as they would like throughout the duration of the trial. The app is designed to be used several times throughout each day. VillageWhere App	Youth/Teens All caregiver/teen dyads used the VillageWhere App Prototype that was developed for this study. They were requested to use it as often as they would like throughout the duration of the trial. The app is designed to be used several times throughout each day. VillageWhere App
Loeber Parental Knowledge Scale Mean at Time 1 (baseline)	8.07 units on a scale Standard Deviation 2.73	—
Loeber Parental Knowledge Scale Mean at Time 2 (post-usage)	9.00 units on a scale Standard Deviation 3.09	—

Adverse Events

Use of VillageWhere App Prototype

Serious events: 0 serious events

Other events: 0 other events

Deaths: 0 deaths

Serious adverse events

Adverse event data not reported

Other adverse events

Adverse event data not reported

Additional Information

Linda Dimeff, PhD

Evidence-Based Practice Institute

Phone: 206-455-7934

Email: grants@ebpi.org

Results disclosure agreements

• Principal investigator is a sponsor employee
• Publication restrictions are in place