Exemplar: Determining the Best Practices for EMA Studies

NCT ID: NCT05194228

Last Updated: 2023-01-10

Study Results

Results pending

The study team has not published outcome measurements, participant flow, or safety data for this trial yet. Check back later for updates.

Basic Information

Get a concise snapshot of the trial, including recruitment status, study phase, enrollment targets, and key timeline milestones.

Recruitment Status

COMPLETED

Clinical Phase

NA

Total Enrollment

416 participants

Study Classification

INTERVENTIONAL

Study Start Date

2021-11-30

Study Completion Date

2022-10-26

Brief Summary

Review the sponsor-provided synopsis that highlights what the study is about and why it is being conducted.

Ecological momentary assessment (EMA) is a measurement methodology that utilizes the repeated collection of real-time data on participants' behavior and experience in their natural environment. While EMA allows researchers to gain valuable insights into dynamic behavioral processes, the need for frequent self-report can be burdensome and disruptive to participants. Compliance with EMA protocols is important for accurate, unbiased sampling, yet there is no "gold standard" for EMA study design. In the present study, the investigators aim to use a factorial design to identify the optimal components, or combinations of components, for achieving the highest compliance rates for smartphone-based ecological momentary assessments (EMAs). Participants will be randomized into 1 of 32 conditions in a 2x2x2x2x2 design (i.e., number of questions per EMA survey \[15 vs. 25\] x number of EMAs per day \[2 vs. 4\] x EMA prompting schedule \[random vs. fixed times\]) x payment type \[per EMA vs. based on percentage of EMAs completed\] x order of EMA item question types \[i.e., slider type first 2 weeks vs. Likert-type questions first 2 weeks\]). All participants will complete EMAs for 4 weeks. The effect of each factor on EMA compliance will be examined, as well as the effects of interactions on EMA compliance. The investigators will also examine within and between-subjects factors that influence response rates, and 2) contextual features such as environment and mood that may be associated with better compliance and participant engagement. The results of this study will have broad applications for developing best practices guidelines for future studies utilizing EMA methodologies.

Detailed Description

Dive into the extended narrative that explains the scientific background, objectives, and procedures in greater depth.

Ecological momentary assessment (EMA) is a measurement methodology that utilizes the repeated collection of real-time data on participants' behavior and experience in their natural environment. EMA has been used in behavioral science for years, including research examining the environmental and psychological antecedents of cigarette smoking, substance use disorders, anxiety, eating, and sleep. EMA sampling strategies are typically time-based or event-based. Time-based sampling is solicited based on a schedule; for example, a daily diary prompted every day at the same time, or at random intervals (e.g., every 3-4 hours) each day. In contrast, event- based sampling is centered around a pre-defined event and is typically initiated by the participant. For example, a participant may be asked to initiate an assessment every time the participant smokes a cigarette.

Several studies have examined the impact of EMA study design features on participant compliance. In a recent meta-analysis of compliance with EMA protocols among substance users, there was no evidence that compliance rates were associated with prompt frequency, length of assessment period, or reimbursement. Another study using a pooled dataset of 10 EMA studies found that compliance declined across days, and varied significantly depending on the time of day. In a meta-analysis of EMA studies in mental health research, a higher number of EMAs per day were associated with lower compliance, however the number of days was not. While these studies provide preliminary guidance regarding EMA study design, their results are unfortunately inconsistent, and the varied reporting across studies with respect to the definition of compliance, study design elements, and study populations make it difficult to clearly derive best practice guidelines for EMA design.

In the present study, the investigators use a factorial design to identify the optimal components, or combinations of components, for achieving the highest compliance rates for smartphone-based ecological momentary assessments (EMAs). In addition, the investigators will explore the association between EMA design features and participant compliance/response rates. A factorial design is ideal for exploring these research questions because it is statistically more efficient, as this type of design needs fewer participants to answer questions about each experimental factor of interest.6 In this study, participants will be randomized into 1 of 32 conditions (i.e., number of questions per EMA survey x number of EMAs per day x EMA prompting schedule x EMA item type x payment type) to explore:

1. both within and between-subjects factors that influence response rates, and
2. contextual features such as environment and mood that may be associated with better compliance and participant engagement. The results of this study will have broad applications for developing best practice guidelines for future studies utilizing EMA methodologies.

Conditions

See the medical conditions and disease areas that this research is targeting or investigating.

Ecological Momentary Assessment Best Practices

Study Design

Understand how the trial is structured, including allocation methods, masking strategies, primary purpose, and other design elements.

Allocation Method

RANDOMIZED

Intervention Model

FACTORIAL

Participants will be randomized into 1 of 32 conditions in a 2x2x2x2x2 design (i.e., number of questions per EMA survey \[15 vs. 25\] x number of EMAs per day \[2 vs. 4\] x EMA prompting schedule \[random vs. fixed times\]) x payment type \[per EMA vs. based on percentage of EMAs completed\] x order of EMA item question types \[i.e., slider type first 2 weeks vs. Likert-type questions first 2 weeks\]).
Primary Study Purpose

OTHER

Blinding Strategy

NONE

Study Groups

Review each arm or cohort in the study, along with the interventions and objectives associated with them.

Group 1

$1 Payment per EMA 2 EMAs per day 15 questions per EMA Fixed schedule Slider first

Group Type EXPERIMENTAL

Ecologial Momentary Assessment settings

Intervention Type BEHAVIORAL

Various settings for ecological momentary assessments

Group 2

$1 Payment per EMA 2 EMAs per day 15 questions per EMA Fixed schedule Likert first

Group Type EXPERIMENTAL

Ecologial Momentary Assessment settings

Intervention Type BEHAVIORAL

Various settings for ecological momentary assessments

Group 3

$1 Payment per EMA 2 EMAs per day 15 questions per EMA Random schedule Slider first

Group Type EXPERIMENTAL

Ecologial Momentary Assessment settings

Intervention Type BEHAVIORAL

Various settings for ecological momentary assessments

Group 4

$1 Payment per EMA 2 EMAs per day 15 questions per EMA Random schedule Likert first

Group Type EXPERIMENTAL

Ecologial Momentary Assessment settings

Intervention Type BEHAVIORAL

Various settings for ecological momentary assessments

Group 5

$1 Payment per EMA 2 EMAs per day 25 questions per EMA Fixed schedule Slider first

Group Type EXPERIMENTAL

Ecologial Momentary Assessment settings

Intervention Type BEHAVIORAL

Various settings for ecological momentary assessments

Group 6

$1 Payment per EMA 2 EMAs per day 25 questions per EMA Fixed schedule Likert first

Group Type EXPERIMENTAL

Ecologial Momentary Assessment settings

Intervention Type BEHAVIORAL

Various settings for ecological momentary assessments

Group 7

$1 Payment per EMA 2 EMAs per day 25 questions per EMA Random schedule Slider first

Group Type EXPERIMENTAL

Ecologial Momentary Assessment settings

Intervention Type BEHAVIORAL

Various settings for ecological momentary assessments

Group 8

$1 Payment per EMA 2 EMAs per day 25 questions per EMA Random schedule Likert first

Group Type EXPERIMENTAL

Ecologial Momentary Assessment settings

Intervention Type BEHAVIORAL

Various settings for ecological momentary assessments

Group 9

$1 Payment per EMA 4 EMAs per day 15 questions per EMA Fixed schedule Slider first

Group Type EXPERIMENTAL

Ecologial Momentary Assessment settings

Intervention Type BEHAVIORAL

Various settings for ecological momentary assessments

Group 10

$1 Payment per EMA 4 EMAs per day 15 questions per EMA Fixed schedule Likert first

Group Type EXPERIMENTAL

Ecologial Momentary Assessment settings

Intervention Type BEHAVIORAL

Various settings for ecological momentary assessments

Group 11

$1 Payment per EMA 4 EMAs per day 15 questions per EMA Random schedule Slider first

Group Type EXPERIMENTAL

Ecologial Momentary Assessment settings

Intervention Type BEHAVIORAL

Various settings for ecological momentary assessments

Group 12

$1 Payment per EMA 4 EMAs per day 15 questions per EMA Random schedule Likert first

Group Type EXPERIMENTAL

Ecologial Momentary Assessment settings

Intervention Type BEHAVIORAL

Various settings for ecological momentary assessments

Group 13

$1 Payment per EMA 4 EMAs per day 25 questions per EMA Fixed schedule Slider first

Group Type EXPERIMENTAL

Ecologial Momentary Assessment settings

Intervention Type BEHAVIORAL

Various settings for ecological momentary assessments

Group 14

$1 Payment per EMA 4 EMAs per day 25 questions per EMA Fixed schedule Likert first

Group Type EXPERIMENTAL

Ecologial Momentary Assessment settings

Intervention Type BEHAVIORAL

Various settings for ecological momentary assessments

Group 15

$1 Payment per EMA 4 EMAs per day 25 questions per EMA Random schedule Slider first

Group Type EXPERIMENTAL

Ecologial Momentary Assessment settings

Intervention Type BEHAVIORAL

Various settings for ecological momentary assessments

Group 16

$1 Payment per EMA 4 EMAs per day 25 questions per EMA Random schedule Likert first

Group Type EXPERIMENTAL

Ecologial Momentary Assessment settings

Intervention Type BEHAVIORAL

Various settings for ecological momentary assessments

Group 17

Payment by % EMAs 2 EMAs per day 15 questions per EMA Fixed schedule Slider first

Group Type EXPERIMENTAL

Ecologial Momentary Assessment settings

Intervention Type BEHAVIORAL

Various settings for ecological momentary assessments

Group 18

Payment by % EMAs 2 EMAs per day 15 questions per EMA Fixed schedule Likert first

Group Type EXPERIMENTAL

Ecologial Momentary Assessment settings

Intervention Type BEHAVIORAL

Various settings for ecological momentary assessments

Group 19

Payment by % EMAs 2 EMAs per day 15 questions per EMA Random schedule Slider first

Group Type EXPERIMENTAL

Ecologial Momentary Assessment settings

Intervention Type BEHAVIORAL

Various settings for ecological momentary assessments

Group 20

Payment by % EMAs 2 EMAs per day 15 questions per EMA Random schedule Likert first

Group Type EXPERIMENTAL

Ecologial Momentary Assessment settings

Intervention Type BEHAVIORAL

Various settings for ecological momentary assessments

Group 21

Payment by % EMAs 2 EMAs per day 25 questions per EMA Fixed schedule Slider first

Group Type EXPERIMENTAL

Ecologial Momentary Assessment settings

Intervention Type BEHAVIORAL

Various settings for ecological momentary assessments

Group 22

Payment by % EMAs 2 EMAs per day 25 questions per EMA Fixed schedule Likert first

Group Type EXPERIMENTAL

Ecologial Momentary Assessment settings

Intervention Type BEHAVIORAL

Various settings for ecological momentary assessments

Group 23

Payment by % EMAs 2 EMAs per day 25 questions per EMA Random schedule Slider first

Group Type EXPERIMENTAL

Ecologial Momentary Assessment settings

Intervention Type BEHAVIORAL

Various settings for ecological momentary assessments

Group 24

Payment by % EMAs 2 EMAs per day 25 questions per EMA Random schedule Likert first

Group Type EXPERIMENTAL

Ecologial Momentary Assessment settings

Intervention Type BEHAVIORAL

Various settings for ecological momentary assessments

Group 25

Payment by % EMAs 4 EMAs per day 15 questions per EMA Fixed schedule Slider first

Group Type EXPERIMENTAL

Ecologial Momentary Assessment settings

Intervention Type BEHAVIORAL

Various settings for ecological momentary assessments

Group 26

Payment by % EMAs 4 EMAs per day 15 questions per EMA Fixed schedule Likert first

Group Type EXPERIMENTAL

Ecologial Momentary Assessment settings

Intervention Type BEHAVIORAL

Various settings for ecological momentary assessments

Group 27

Payment by % EMAs 4 EMAs per day 15 questions per EMA Random schedule Slider first

Group Type EXPERIMENTAL

Ecologial Momentary Assessment settings

Intervention Type BEHAVIORAL

Various settings for ecological momentary assessments

Group 28

Payment by % EMAs 4 EMAs per day 15 questions per EMA Random schedule Likert first

Group Type EXPERIMENTAL

Ecologial Momentary Assessment settings

Intervention Type BEHAVIORAL

Various settings for ecological momentary assessments

Group 29

Payment by % EMAs 4 EMAs per day 25 questions per EMA Fixed schedule Slider first

Group Type EXPERIMENTAL

Ecologial Momentary Assessment settings

Intervention Type BEHAVIORAL

Various settings for ecological momentary assessments

Group 30

Payment by % EMAs 4 EMAs per day 25 questions per EMA Fixed schedule Likert first

Group Type EXPERIMENTAL

Ecologial Momentary Assessment settings

Intervention Type BEHAVIORAL

Various settings for ecological momentary assessments

Group 31

Payment by % EMAs 4 EMAs per day 25 questions per EMA Random schedule Slider first

Group Type EXPERIMENTAL

Ecologial Momentary Assessment settings

Intervention Type BEHAVIORAL

Various settings for ecological momentary assessments

Group 32

Payment by % EMAs 4 EMAs per day 25 questions per EMA Random schedule Likert first

Group Type EXPERIMENTAL

Ecologial Momentary Assessment settings

Intervention Type BEHAVIORAL

Various settings for ecological momentary assessments

Interventions

Learn about the drugs, procedures, or behavioral strategies being tested and how they are applied within this trial.

Ecologial Momentary Assessment settings

Various settings for ecological momentary assessments

Intervention Type BEHAVIORAL

Eligibility Criteria

Check the participation requirements, including inclusion and exclusion rules, age limits, and whether healthy volunteers are accepted.

Inclusion Criteria

* At least 18 years of age
* Demonstrate \> 6th grade English literacy level
* Possess an active Android smartphone that is compatible with the Insight (TM) platform with a data plan and an operating system version 6.0 or higher
* Agree to install the study smartphone application onto their personal phone
* Agree to complete EMAs prompted by and completed through the study smartphone application

Exclusion Criteria

* Under 18 years of age
* Demonstrates \< 6th grade English literacy level
* Does not possess an active Android smartphone that is compatible with the Insight (TM) platform with a data plan and an operating system version 6.0 or higher
* Does not agree to install the study smartphone application onto their personal phone
* Does not agree to complete EMAs prompted by and completed through the study smartphone application
Minimum Eligible Age

18 Years

Maximum Eligible Age

99 Years

Eligible Sex

ALL

Accepts Healthy Volunteers

Yes

Sponsors

Meet the organizations funding or collaborating on the study and learn about their roles.

University of Oklahoma

OTHER

Sponsor Role lead

Responsible Party

Identify the individual or organization who holds primary responsibility for the study information submitted to regulators.

Responsibility Role SPONSOR

Locations

Explore where the study is taking place and check the recruitment status at each participating site.

University of Oklahoma Health Sciences Center

Oklahoma City, Oklahoma, United States

Site Status

Countries

Review the countries where the study has at least one active or historical site.

United States

References

Explore related publications, articles, or registry entries linked to this study.

Stone, A. A., & Shiffman, S. (1994). Ecological momentary assessment (EMA) in behavorial medicine. Annals of Behavioral Medicine, 16(3), 199-202. https://doi.org/10.1093/abm/16.3.199

Reference Type BACKGROUND

Shiffman S, Stone AA, Hufford MR. Ecological momentary assessment. Annu Rev Clin Psychol. 2008;4:1-32. doi: 10.1146/annurev.clinpsy.3.022806.091415.

Reference Type BACKGROUND
PMID: 18509902 (View on PubMed)

Jones A, Remmerswaal D, Verveer I, Robinson E, Franken IHA, Wen CKF, Field M. Compliance with ecological momentary assessment protocols in substance users: a meta-analysis. Addiction. 2019 Apr;114(4):609-619. doi: 10.1111/add.14503. Epub 2018 Dec 21.

Reference Type BACKGROUND
PMID: 30461120 (View on PubMed)

Rintala A, Wampers M, Myin-Germeys I, Viechtbauer W. Response compliance and predictors thereof in studies using the experience sampling method. Psychol Assess. 2019 Feb;31(2):226-235. doi: 10.1037/pas0000662. Epub 2018 Nov 5.

Reference Type BACKGROUND
PMID: 30394762 (View on PubMed)

Vachon H, Viechtbauer W, Rintala A, Myin-Germeys I. Compliance and Retention With the Experience Sampling Method Over the Continuum of Severe Mental Disorders: Meta-Analysis and Recommendations. J Med Internet Res. 2019 Dec 6;21(12):e14475. doi: 10.2196/14475.

Reference Type BACKGROUND
PMID: 31808748 (View on PubMed)

Fletcher DJ, Lewis SM, Matthews JN. Factorial designs for crossover clinical trials. Stat Med. 1990 Oct;9(10):1121-9. doi: 10.1002/sim.4780091002.

Reference Type BACKGROUND
PMID: 2247713 (View on PubMed)

Kezbers KM, Robertson MC, Hebert ET, Montgomery A, Businelle MS. Detecting Deception and Ensuring Data Integrity in a Nationwide mHealth Randomized Controlled Trial: Factorial Design Survey Study. J Med Internet Res. 2025 Jan 28;27:e66384. doi: 10.2196/66384.

Reference Type DERIVED
PMID: 39874573 (View on PubMed)

Businelle MS, Hebert ET, Shi D, Benson L, Kezbers KM, Tonkin S, Piper ME, Qian T. Investigating Best Practices for Ecological Momentary Assessment: Nationwide Factorial Experiment. J Med Internet Res. 2024 Aug 12;26:e50275. doi: 10.2196/50275.

Reference Type DERIVED
PMID: 39133915 (View on PubMed)

Other Identifiers

Review additional registry numbers or institutional identifiers associated with this trial.

13684

Identifier Type: -

Identifier Source: org_study_id

More Related Trials

Additional clinical trials that may be relevant based on similarity analysis.