Trial Outcomes & Findings for Investigating How Incentives Impact Engagement With an Online Mental Health Application (Neuroflow) (NCT NCT05121675)
NCT ID: NCT05121675
Last Updated: 2024-08-12
Results Overview
User engagement will be measured as the percentage of daily check-in activities (number completed out of the total number of activities assigned)
Recruitment status
COMPLETED
Study phase
NA
Target enrollment
107 participants
Primary outcome timeframe
Throughout 28-day trial (averaged)
Results posted on
2024-08-12
Participant Flow
Eligible participants were college students at the University of Pennsylvania who had access to a smartphone and agreed to download and use the NeuroFlow application
Participant milestones
| Measure |
App With Behavioral Economics + Financial Incentives
NeuroFlow uses behavioral economics reminders, gamification, and fun, motivating messages to encourage use. It also includes financial incentives so users can earn redeemable points accrued for activity completion for gift cards at popular outlets (e.g., 1000 points which is the maximum per month = $10 gift card).
Neuroflow app: Mental health and wellbeing resources for adults: The NeuroFlow app delivers resources on resilience training, mindfulness-based strategies and cognitive behavioral therapy to adults looking to support their mental health and wellbeing. The specific "journey" (i.e., content such as activities, videos, trackers, and journaling) is tailored to individuals based on depression and anxiety screeners administered upon signing up to the app.
|
App With Behavioral Economics Incentives Only
NeuroFlow uses behavioral economics reminders, gamification, and fun, motivating messages to encourage use. including points accrued for activity completion. This version of the app does not have financial incentives.
Neuroflow app: Mental health and wellbeing resources for adults: The NeuroFlow app delivers resources on resilience training, mindfulness-based strategies and cognitive behavioral therapy to adults looking to support their mental health and wellbeing. The specific "journey" (i.e., content such as activities, videos, trackers, and journaling) is tailored to individuals based on depression and anxiety screeners administered upon signing up to the app.
|
|---|---|---|
|
Overall Study
STARTED
|
53
|
54
|
|
Overall Study
COMPLETED
|
48
|
39
|
|
Overall Study
NOT COMPLETED
|
5
|
15
|
Reasons for withdrawal
Withdrawal data not reported
Baseline Characteristics
some did not report gender
Baseline characteristics by cohort
| Measure |
App With Behavioral Economics + Financial Incentives
n=53 Participants
NeuroFlow uses behavioral economics reminders, gamification, and fun, motivating messages to encourage use. It also includes financial incentives so users can earn redeemable points accrued for activity completion for gift cards at popular outlets (e.g., 1000 points which is the maximum per month = $10 gift card).
Neuroflow app: Mental health and wellbeing resources for adults: The NeuroFlow app delivers resources on resilience training, mindfulness-based strategies and cognitive behavioral therapy to adults looking to support their mental health and wellbeing. The specific "journey" (i.e., content such as activities, videos, trackers, and journaling) is tailored to individuals based on depression and anxiety screeners administered upon signing up to the app.
|
App With Behavioral Economics Incentives Only
n=54 Participants
NeuroFlow uses behavioral economics reminders, gamification, and fun, motivating messages to encourage use. including points accrued for activity completion. This version of the app does not have financial incentives.
Neuroflow app: Mental health and wellbeing resources for adults: The NeuroFlow app delivers resources on resilience training, mindfulness-based strategies and cognitive behavioral therapy to adults looking to support their mental health and wellbeing. The specific "journey" (i.e., content such as activities, videos, trackers, and journaling) is tailored to individuals based on depression and anxiety screeners administered upon signing up to the app.
|
Total
n=107 Participants
Total of all reporting groups
|
|---|---|---|---|
|
Age, Categorical
<=18 years
|
0 Participants
n=53 Participants
|
0 Participants
n=54 Participants
|
0 Participants
n=107 Participants
|
|
Age, Categorical
Between 18 and 65 years
|
53 Participants
n=53 Participants
|
54 Participants
n=54 Participants
|
107 Participants
n=107 Participants
|
|
Age, Categorical
>=65 years
|
0 Participants
n=53 Participants
|
0 Participants
n=54 Participants
|
0 Participants
n=107 Participants
|
|
Age, Continuous
|
19.7 years
STANDARD_DEVIATION 1.8 • n=53 Participants
|
19.4 years
STANDARD_DEVIATION 1.1 • n=54 Participants
|
19.5 years
STANDARD_DEVIATION 2.9 • n=107 Participants
|
|
Sex: Female, Male
Female
|
23 Participants
n=41 Participants • some did not report gender
|
29 Participants
n=44 Participants • some did not report gender
|
52 Participants
n=85 Participants • some did not report gender
|
|
Sex: Female, Male
Male
|
18 Participants
n=41 Participants • some did not report gender
|
15 Participants
n=44 Participants • some did not report gender
|
33 Participants
n=85 Participants • some did not report gender
|
|
Race (NIH/OMB)
American Indian or Alaska Native
|
0 Participants
n=53 Participants
|
0 Participants
n=54 Participants
|
0 Participants
n=107 Participants
|
|
Race (NIH/OMB)
Asian
|
15 Participants
n=53 Participants
|
15 Participants
n=54 Participants
|
30 Participants
n=107 Participants
|
|
Race (NIH/OMB)
Native Hawaiian or Other Pacific Islander
|
1 Participants
n=53 Participants
|
0 Participants
n=54 Participants
|
1 Participants
n=107 Participants
|
|
Race (NIH/OMB)
Black or African American
|
6 Participants
n=53 Participants
|
4 Participants
n=54 Participants
|
10 Participants
n=107 Participants
|
|
Race (NIH/OMB)
White
|
19 Participants
n=53 Participants
|
19 Participants
n=54 Participants
|
38 Participants
n=107 Participants
|
|
Race (NIH/OMB)
More than one race
|
0 Participants
n=53 Participants
|
0 Participants
n=54 Participants
|
0 Participants
n=107 Participants
|
|
Race (NIH/OMB)
Unknown or Not Reported
|
12 Participants
n=53 Participants
|
16 Participants
n=54 Participants
|
28 Participants
n=107 Participants
|
|
Region of Enrollment
United States
|
53 participants
n=53 Participants
|
54 participants
n=54 Participants
|
107 participants
n=107 Participants
|
PRIMARY outcome
Timeframe: Throughout 28-day trial (averaged)Population: some dropped out
User engagement will be measured as the percentage of daily check-in activities (number completed out of the total number of activities assigned)
Outcome measures
| Measure |
App With Behavioral Economics + Financial Incentives
n=48 Participants
NeuroFlow uses behavioral economics reminders, gamification, and fun, motivating messages to encourage use. It also includes financial incentives so users can earn redeemable points accrued for activity completion for gift cards at popular outlets (e.g., 1000 points which is the maximum per month = $10 gift card).
Neuroflow app: Mental health and wellbeing resources for adults: The NeuroFlow app delivers resources on resilience training, mindfulness-based strategies and cognitive behavioral therapy to adults looking to support their mental health and wellbeing. The specific "journey" (i.e., content such as activities, videos, trackers, and journaling) is tailored to individuals based on depression and anxiety screeners administered upon signing up to the app.
|
App With Behavioral Economics Incentives Only
n=39 Participants
NeuroFlow uses behavioral economics reminders, gamification, and fun, motivating messages to encourage use. including points accrued for activity completion. This version of the app does not have financial incentives.
Neuroflow app: Mental health and wellbeing resources for adults: The NeuroFlow app delivers resources on resilience training, mindfulness-based strategies and cognitive behavioral therapy to adults looking to support their mental health and wellbeing. The specific "journey" (i.e., content such as activities, videos, trackers, and journaling) is tailored to individuals based on depression and anxiety screeners administered upon signing up to the app.
|
|---|---|---|
|
Engagement (Percentage of Daily check-in Activities)
|
32.8176 percentage of completion
Standard Error 2.89863
|
30.242 percentage of completion
Standard Error 3.18953
|
SECONDARY outcome
Timeframe: Baseline and post-trial, up to 28 daysPopulation: some dropped out
Change from pre-trial to post-trial score in anxiety. Scores range from 0 to 21. Higher scores = higher symptoms of anxiety.
Outcome measures
| Measure |
App With Behavioral Economics + Financial Incentives
n=27 Participants
NeuroFlow uses behavioral economics reminders, gamification, and fun, motivating messages to encourage use. It also includes financial incentives so users can earn redeemable points accrued for activity completion for gift cards at popular outlets (e.g., 1000 points which is the maximum per month = $10 gift card).
Neuroflow app: Mental health and wellbeing resources for adults: The NeuroFlow app delivers resources on resilience training, mindfulness-based strategies and cognitive behavioral therapy to adults looking to support their mental health and wellbeing. The specific "journey" (i.e., content such as activities, videos, trackers, and journaling) is tailored to individuals based on depression and anxiety screeners administered upon signing up to the app.
|
App With Behavioral Economics Incentives Only
n=34 Participants
NeuroFlow uses behavioral economics reminders, gamification, and fun, motivating messages to encourage use. including points accrued for activity completion. This version of the app does not have financial incentives.
Neuroflow app: Mental health and wellbeing resources for adults: The NeuroFlow app delivers resources on resilience training, mindfulness-based strategies and cognitive behavioral therapy to adults looking to support their mental health and wellbeing. The specific "journey" (i.e., content such as activities, videos, trackers, and journaling) is tailored to individuals based on depression and anxiety screeners administered upon signing up to the app.
|
|---|---|---|
|
Generalized Anxiety Disorder (GAD-7)
Baseline
|
6.58 score on a scale
Standard Error 0.781
|
6.71 score on a scale
Standard Error 0.653
|
|
Generalized Anxiety Disorder (GAD-7)
Post Trial
|
4.45 score on a scale
Standard Error 0.692
|
5.19 score on a scale
Standard Error 0.779
|
SECONDARY outcome
Timeframe: Baseline and post-trial, up to 28 daysPopulation: some dropped out
Change from pre-trial to post-trial score in depression. Scores range from 0-24. Higher scores = higher symptoms of depression.
Outcome measures
| Measure |
App With Behavioral Economics + Financial Incentives
n=31 Participants
NeuroFlow uses behavioral economics reminders, gamification, and fun, motivating messages to encourage use. It also includes financial incentives so users can earn redeemable points accrued for activity completion for gift cards at popular outlets (e.g., 1000 points which is the maximum per month = $10 gift card).
Neuroflow app: Mental health and wellbeing resources for adults: The NeuroFlow app delivers resources on resilience training, mindfulness-based strategies and cognitive behavioral therapy to adults looking to support their mental health and wellbeing. The specific "journey" (i.e., content such as activities, videos, trackers, and journaling) is tailored to individuals based on depression and anxiety screeners administered upon signing up to the app.
|
App With Behavioral Economics Incentives Only
n=41 Participants
NeuroFlow uses behavioral economics reminders, gamification, and fun, motivating messages to encourage use. including points accrued for activity completion. This version of the app does not have financial incentives.
Neuroflow app: Mental health and wellbeing resources for adults: The NeuroFlow app delivers resources on resilience training, mindfulness-based strategies and cognitive behavioral therapy to adults looking to support their mental health and wellbeing. The specific "journey" (i.e., content such as activities, videos, trackers, and journaling) is tailored to individuals based on depression and anxiety screeners administered upon signing up to the app.
|
|---|---|---|
|
Patient Health Questionnaire (PHQ-8)
Baseline
|
5.45 score on a scale
Standard Error 0.365
|
6.08 score on a scale
Standard Error 0.374
|
|
Patient Health Questionnaire (PHQ-8)
Post Trial
|
4.62 score on a scale
Standard Error 0.434
|
5.3 score on a scale
Standard Error 0.427
|
SECONDARY outcome
Timeframe: Baseline and post-trial, up to 28 daysPopulation: some dropped out
Change from pre-trial to post-trial score in wellbeing. Scores range from 0-100 (raw score is multiplied by 4). Higher scores = higher wellbeing.
Outcome measures
| Measure |
App With Behavioral Economics + Financial Incentives
n=33 Participants
NeuroFlow uses behavioral economics reminders, gamification, and fun, motivating messages to encourage use. It also includes financial incentives so users can earn redeemable points accrued for activity completion for gift cards at popular outlets (e.g., 1000 points which is the maximum per month = $10 gift card).
Neuroflow app: Mental health and wellbeing resources for adults: The NeuroFlow app delivers resources on resilience training, mindfulness-based strategies and cognitive behavioral therapy to adults looking to support their mental health and wellbeing. The specific "journey" (i.e., content such as activities, videos, trackers, and journaling) is tailored to individuals based on depression and anxiety screeners administered upon signing up to the app.
|
App With Behavioral Economics Incentives Only
n=41 Participants
NeuroFlow uses behavioral economics reminders, gamification, and fun, motivating messages to encourage use. including points accrued for activity completion. This version of the app does not have financial incentives.
Neuroflow app: Mental health and wellbeing resources for adults: The NeuroFlow app delivers resources on resilience training, mindfulness-based strategies and cognitive behavioral therapy to adults looking to support their mental health and wellbeing. The specific "journey" (i.e., content such as activities, videos, trackers, and journaling) is tailored to individuals based on depression and anxiety screeners administered upon signing up to the app.
|
|---|---|---|
|
World Health Organization (WHO-5)
Baseline
|
57.95 score on a scale
Standard Error 0.361
|
55.9 score on a scale
Standard Error 0.369
|
|
World Health Organization (WHO-5)
Post Trail
|
58.89 score on a scale
Standard Error 0.393
|
61.45 score on a scale
Standard Error 0.409
|
SECONDARY outcome
Timeframe: Baseline and post-trial, up to 28 daysPopulation: some dropped out
Change from pre-trial to post-trial score in emotion regulation difficulties. Scores range from 36-180. Higher scores = greater problems with emotion regulation.
Outcome measures
| Measure |
App With Behavioral Economics + Financial Incentives
n=31 Participants
NeuroFlow uses behavioral economics reminders, gamification, and fun, motivating messages to encourage use. It also includes financial incentives so users can earn redeemable points accrued for activity completion for gift cards at popular outlets (e.g., 1000 points which is the maximum per month = $10 gift card).
Neuroflow app: Mental health and wellbeing resources for adults: The NeuroFlow app delivers resources on resilience training, mindfulness-based strategies and cognitive behavioral therapy to adults looking to support their mental health and wellbeing. The specific "journey" (i.e., content such as activities, videos, trackers, and journaling) is tailored to individuals based on depression and anxiety screeners administered upon signing up to the app.
|
App With Behavioral Economics Incentives Only
n=41 Participants
NeuroFlow uses behavioral economics reminders, gamification, and fun, motivating messages to encourage use. including points accrued for activity completion. This version of the app does not have financial incentives.
Neuroflow app: Mental health and wellbeing resources for adults: The NeuroFlow app delivers resources on resilience training, mindfulness-based strategies and cognitive behavioral therapy to adults looking to support their mental health and wellbeing. The specific "journey" (i.e., content such as activities, videos, trackers, and journaling) is tailored to individuals based on depression and anxiety screeners administered upon signing up to the app.
|
|---|---|---|
|
Difficulties Emotion Regulation Scale (DERS)
Baseline
|
83.29 score on a scale
Standard Error 0.365
|
83.22 score on a scale
Standard Error 0.369
|
|
Difficulties Emotion Regulation Scale (DERS)
Post Trail
|
76.36 score on a scale
Standard Error 0.409
|
74.32 score on a scale
Standard Error 0.421
|
Adverse Events
App With Behavioral Economics + Financial Incentives
Serious events: 0 serious events
Other events: 0 other events
Deaths: 0 deaths
App With Behavioral Economics Incentives Only
Serious events: 0 serious events
Other events: 0 other events
Deaths: 0 deaths
Serious adverse events
Adverse event data not reported
Other adverse events
Adverse event data not reported
Additional Information
Results disclosure agreements
- Principal investigator is a sponsor employee
- Publication restrictions are in place