Trial Outcomes & Findings for Covid-19 Messaging to Underserved Communities - 2nd Experiment (NCT NCT04502056)

NCT ID: NCT04502056

Last Updated: 2021-07-27

Results Overview

Recruitment status

COMPLETED

Study phase

Target enrollment

20460 participants

Primary outcome timeframe

The outcome was measured immediately following the intervention in the baseline survey.

Results posted on

2021-07-27

Participant Flow

Participant milestones

Participant milestones
Measure	Intervention: AMA RI - B- B - R Respondents will be randomized to an AMA statement acknowledging racial injustice read by an African American individual. The messenger / doctor in the follow-up AMA videos will also be African American - the message on Covid-19 will include information on the disproportionate impact on communities of color . Acknowledgement Racial Injustice AMA: Investigators will examine whether acknowledgements of racial inequality are helpful towards improving knowledge retention and behaviors associated with the intervention among participants. In this arm, participants will receive a AMA statement on racial injustice. African American Sender Acknowledgement: Investigators will also vary the messenger of the acknowledgement sender. In this arm participants receive a African American sender in acknowledgment of AMA African American Sender in Informational Videos.: Investigators will vary the sender of the informational covid-19 videos. In this arm, participants receive a African American sender in informational videos. Racial Inequality Highlighted: Investigators will include information on race-specific covid-19 cases and deaths in one variation in the messaging. In this arm, participants receive disproportionate race-specific Covid-19 facts	Intervention: AMA RI - B - B - N Respondents will be randomized to an AMA statement acknowledging racial injustice read by an African American individual. The messenger / doctor in the follow-up AMA videos will also be African American - the message on Covid-19 will not include information on the disproportionate impact on communities of color. Acknowledgement Racial Injustice AMA: Investigators will examine whether acknowledgements of racial inequality are helpful towards improving knowledge retention and behaviors associated with the intervention among participants. In this arm, participants will receive a AMA statement on racial injustice. African American Sender Acknowledgement: Investigators will also vary the messenger of the acknowledgement sender. In this arm participants receive a African American sender in acknowledgment of AMA African American Sender in Informational Videos.: Investigators will vary the sender of the informational covid-19 videos. In this arm, participants receive a African American sender in informational videos. No Racial Inequality Highlighting: In this arm, the disproportionate burden of Covid-19 on communities of color will not be highlighted	Intervention: AMA RI - W - W - R Respondents will be randomized to an AMA statement acknowledging racial injustice read by a white individual. The messenger / doctor in the follow-up AMA videos will be white - the message on Covid-19 will include information on the disproportionate impact on communities of color. Acknowledgement Racial Injustice AMA: Investigators will examine whether acknowledgements of racial inequality are helpful towards improving knowledge retention and behaviors associated with the intervention among participants. In this arm, participants will receive a AMA statement on racial injustice. Racial Inequality Highlighted: Investigators will include information on race-specific covid-19 cases and deaths in one variation in the messaging. In this arm, participants receive disproportionate race-specific Covid-19 facts White Sender in Acknowledgement: Investigators will also vary the messenger of the acknowledgement sender. In this arm, participants receive a white sender in the acknowledgement White Sender in Informational Videos: Investigators will vary the messenger of the informational covid-19 videos. In this arm, participants receive white sender in the informational video	Intervention: AMA RI - W - W - N Respondents will be randomized to an AMA statement acknowledging racial injustice read by a white individual. The messenger / doctor in the follow-up AMA videos will be white - the message on Covid-19 will not include information on the disproportionate impact on communities of color. Acknowledgement Racial Injustice AMA: Investigators will examine whether acknowledgements of racial inequality are helpful towards improving knowledge retention and behaviors associated with the intervention among participants. In this arm, participants will receive a AMA statement on racial injustice. White Sender in Acknowledgement: Investigators will also vary the messenger of the acknowledgement sender. In this arm, participants receive a white sender in the acknowledgement White Sender in Informational Videos: Investigators will vary the messenger of the informational covid-19 videos. In this arm, participants receive white sender in the informational video No Racial Inequality Highlighting: In this arm, the disproportionate burden of Covid-19 on communities of color will not be highlighted	Intervention: AMA DP - B- B - R Respondents will be randomized to an AMA statement acknowledging drug pricing read by an African American individual. The messenger / doctor in the follow-up AMA videos will also be African American - the message on Covid-19 will include information on the disproportionate impact on communities of color . African American Sender Acknowledgement: Investigators will also vary the messenger of the acknowledgement sender. In this arm participants receive a African American sender in acknowledgment of AMA African American Sender in Informational Videos.: Investigators will vary the sender of the informational covid-19 videos. In this arm, participants receive a African American sender in informational videos. Racial Inequality Highlighted: Investigators will include information on race-specific covid-19 cases and deaths in one variation in the messaging. In this arm, participants receive disproportionate race-specific Covid-19 facts AMA Acknowledgement Drug Pricing: Investigators will examine whether acknowledgements of racial inequality are helpful towards improving knowledge retention and behaviors associated with the intervention among participants. In this arm, participants receive AMA information on drug pricing	Intervention: AMA DP - B- B - N Respondents will be randomized to an AMA statement acknowledging drug pricing read by an African American individual. The messenger / doctor in the follow-up AMA videos will also be African American - the message on Covid-19 will not include information on the disproportionate impact on communities of color. African American Sender Acknowledgement: Investigators will also vary the messenger of the acknowledgement sender. In this arm participants receive a African American sender in acknowledgment of AMA African American Sender in Informational Videos.: Investigators will vary the sender of the informational covid-19 videos. In this arm, participants receive a African American sender in informational videos. AMA Acknowledgement Drug Pricing: Investigators will examine whether acknowledgements of racial inequality are helpful towards improving knowledge retention and behaviors associated with the intervention among participants. In this arm, participants receive AMA information on drug pricing No Racial Inequality Highlighting: In this arm, the disproportionate burden of Covid-19 on communities of color will not be highlighted	Intervention: AMA DP - W- W - R Respondents will be randomized to an AMA statement acknowledging drug pricing read by a white individual. The messenger / doctor in the follow-up AMA videos will be white - the message on Covid-19 will include information on the disproportionate impact on communities of color. Racial Inequality Highlighted: Investigators will include information on race-specific covid-19 cases and deaths in one variation in the messaging. In this arm, participants receive disproportionate race-specific Covid-19 facts AMA Acknowledgement Drug Pricing: Investigators will examine whether acknowledgements of racial inequality are helpful towards improving knowledge retention and behaviors associated with the intervention among participants. In this arm, participants receive AMA information on drug pricing White Sender in Acknowledgement: Investigators will also vary the messenger of the acknowledgement sender. In this arm, participants receive a white sender in the acknowledgement White Sender in Informational Videos: Investigators will vary the messenger of the informational covid-19 videos. In this arm, participants receive white sender in the informational video	Intervention: AMA DP - W- W - N Respondents will be randomized to an AMA statement acknowledging drug pricing read by a white individual. The messenger / doctor in the follow-up AMA videos will be white - the message on Covid-19 will not include information on the disproportionate impact on communities of color. AMA Acknowledgement Drug Pricing: Investigators will examine whether acknowledgements of racial inequality are helpful towards improving knowledge retention and behaviors associated with the intervention among participants. In this arm, participants receive AMA information on drug pricing White Sender in Acknowledgement: Investigators will also vary the messenger of the acknowledgement sender. In this arm, participants receive a white sender in the acknowledgement White Sender in Informational Videos: Investigators will vary the messenger of the informational covid-19 videos. In this arm, participants receive white sender in the informational video No Racial Inequality Highlighting: In this arm, the disproportionate burden of Covid-19 on communities of color will not be highlighted	Control: AMA RI - B - B Respondents will be randomized to an AMA statement acknowledging racial injustice read by an African American individual. The messenger / doctor in the follow-up AMA videos will also be African American - No message on Covid-19 will be shown. Acknowledgement Racial Injustice AMA: Investigators will examine whether acknowledgements of racial inequality are helpful towards improving knowledge retention and behaviors associated with the intervention among participants. In this arm, participants will receive a AMA statement on racial injustice. African American Sender Acknowledgement: Investigators will also vary the messenger of the acknowledgement sender. In this arm participants receive a African American sender in acknowledgment of AMA	Control: AMA RI - W - W Respondents will be randomized to an AMA statement acknowledging racial injustice read by a white individual. The messenger / doctor in the follow-up AMA videos will also be white - No message on Covid-19 will be shown. Acknowledgement Racial Injustice AMA: Investigators will examine whether acknowledgements of racial inequality are helpful towards improving knowledge retention and behaviors associated with the intervention among participants. In this arm, participants will receive a AMA statement on racial injustice. White Sender Acknowledgement: Investigators will also vary the messenger of the acknowledgement sender. In this arm participants receive a white sender in acknowledgment of AMA	Control: AMA DP - B - B Respondents will be randomized to an AMA statement acknowledging drug pricing read by an African American individual. The messenger / doctor in the follow-up AMA videos will also be African American - No message on Covid-19 will be shown. African American Sender Acknowledgement: Investigators will also vary the messenger of the acknowledgement sender. In this arm participants receive a African American sender in acknowledgment of AMA AMA Acknowledgement Drug Pricing: Investigators will examine whether acknowledgements of racial inequality are helpful towards improving knowledge retention and behaviors associated with the intervention among participants. In this arm, participants receive AMA information on drug pricing	Control: AMA DP - W - W Respondents will be randomized to an AMA statement acknowledging drug pricing read by a white individual. The messenger / doctor in the follow-up AMA videos will also be white - No message on Covid-19 will be shown. White Sender Acknowledgement: Investigators will also vary the messenger of the acknowledgement sender. In this arm participants receive a white sender in acknowledgment of AMA AMA Acknowledgement Drug Pricing: Investigators will examine whether acknowledgements of racial inequality are helpful towards improving knowledge retention and behaviors associated with the intervention among participants. In this arm, participants receive AMA information on drug pricing
Overall Study STARTED	2046	2044	2045	2046	2044	2052	2046	2043	1026	1025	1023	1020
Overall Study Completed the Knowledge Questions, Included for the Knowledge Gaps Analysis	1859	1881	1879	1886	1846	1877	1888	1883	947	942	946	928
Overall Study Completed the Entire Survey, Included for All Analysis Besides Knowledge Gaps, Except Follow-up	1799	1828	1830	1835	1792	1820	1821	1844	914	912	928	900
Overall Study Completed the Follow-up Survey	608	607	591	601	631	598	607	607	301	313	291	316
Overall Study COMPLETED	604	602	586	597	626	596	605	603	298	311	288	614
Overall Study NOT COMPLETED	1442	1442	1459	1449	1418	1456	1441	1440	728	714	735	406

Reasons for withdrawal

Withdrawal data not reported

Baseline Characteristics

Covid-19 Messaging to Underserved Communities - 2nd Experiment

Baseline characteristics by cohort

Baseline characteristics by cohort
Measure	Intervention n=14145 Participants Participants who are assigned to any intervention groups	Control n=3544 Participants Participants who are assigned to a control group	Total n=17689 Participants Total of all reporting groups
Age, Continuous	40.20 years STANDARD_DEVIATION 17.83 • n=5 Participants	40.30 years STANDARD_DEVIATION 17.73 • n=7 Participants	40.22 years STANDARD_DEVIATION 17.81 • n=5 Participants
Sex: Female, Male Female	7907 Participants n=5 Participants	1973 Participants n=7 Participants	9880 Participants n=5 Participants
Sex: Female, Male Male	6238 Participants n=5 Participants	1571 Participants n=7 Participants	7809 Participants n=5 Participants
Race (NIH/OMB) American Indian or Alaska Native	0 Participants n=5 Participants	0 Participants n=7 Participants	0 Participants n=5 Participants
Race (NIH/OMB) Asian	0 Participants n=5 Participants	0 Participants n=7 Participants	0 Participants n=5 Participants
Race (NIH/OMB) Native Hawaiian or Other Pacific Islander	0 Participants n=5 Participants	0 Participants n=7 Participants	0 Participants n=5 Participants
Race (NIH/OMB) Black or African American	6303 Participants n=5 Participants	1576 Participants n=7 Participants	7879 Participants n=5 Participants
Race (NIH/OMB) White	7842 Participants n=5 Participants	1968 Participants n=7 Participants	9810 Participants n=5 Participants
Race (NIH/OMB) More than one race	0 Participants n=5 Participants	0 Participants n=7 Participants	0 Participants n=5 Participants
Race (NIH/OMB) Unknown or Not Reported	0 Participants n=5 Participants	0 Participants n=7 Participants	0 Participants n=5 Participants
Region of Enrollment United States · Northeast, United States	2424 Participants n=5 Participants	600 Participants n=7 Participants	3024 Participants n=5 Participants
Region of Enrollment United States · Midwest, United States	3114 Participants n=5 Participants	770 Participants n=7 Participants	3884 Participants n=5 Participants
Region of Enrollment United States · South, United States	6397 Participants n=5 Participants	1649 Participants n=7 Participants	8046 Participants n=5 Participants
Region of Enrollment United States · West, United States	2210 Participants n=5 Participants	525 Participants n=7 Participants	2735 Participants n=5 Participants
High school graduate	12009 Participants n=5 Participants	3007 Participants n=7 Participants	15016 Participants n=5 Participants
Household income above 60k	3356 Participants n=5 Participants	850 Participants n=7 Participants	4206 Participants n=5 Participants
Party Affiliation Democrat	5594 Participants n=5 Participants	1383 Participants n=7 Participants	6977 Participants n=5 Participants
Party Affiliation Republican	3494 Participants n=5 Participants	882 Participants n=7 Participants	4376 Participants n=5 Participants
Party Affiliation Independent	5057 Participants n=5 Participants	1279 Participants n=7 Participants	6336 Participants n=5 Participants
Preventive practices: mask in (always)	9648 Participants n=5 Participants	2458 Participants n=7 Participants	12106 Participants n=5 Participants
Preventive practices: mask out (always)	4408 Participants n=5 Participants	1109 Participants n=7 Participants	5517 Participants n=5 Participants
Preventive practices: wash hands (always)	8688 Participants n=5 Participants	2091 Participants n=7 Participants	10779 Participants n=5 Participants
Preventive practices: distance (always)	7571 Participants n=5 Participants	1890 Participants n=7 Participants	9461 Participants n=5 Participants

PRIMARY outcome

Timeframe: The outcome was measured immediately following the intervention in the baseline survey.

Population: Any intervention was indeed an arm that included each sub arm of different types of message that we tested against a control and pre-specified in our study protocol and analysis plan to combine arms for analysis.

Outcome measures

Outcome measures
Measure	Intervention n=14999 Participants Participants who are assigned to any intervention groups	Control n=3763 Participants Participants who are assigned to a control group	Within Intervention Group: Doctor Racial Disparity (Arm A) vs. Either/Neither (Arm B) The relative IRR for intervention participants who saw the message on the relative incidence of COVID-19 among Black and white individuals and saw covid-19-related messages vs. those who did not see either or neither of the messages.	Within Control Group: Black Physician (Arm A) vs. White Physician (Arm B) The relative IRR for intervention participants who saw a Black doctor vs. white doctor	Within Control Group: AMA Anti-racism vs. Either/Neither The relative IRR for intervention participants who saw the AMA anti-racism treatment vs. those who saw the placebo message.	Intervention Group vs. Control Group The relative IRR for intervention participants who saw covid-related messages vs. those who did not see any covid-19 related messages.
Incidence Rate for Knowledge Gaps: Control vs. Any Intervention	0.214 proportion of knowledge gaps Interval 0.211 to 0.217	0.241 proportion of knowledge gaps Interval 0.235 to 0.246	—	—	—	—

PRIMARY outcome

Timeframe: The outcome was measured at a follow-up within 2 weeks following the intervention

Participants were asked to identify ways to prevent COVID-19 spread and identify four common symptoms. Incidence rate for knowledge gaps is the count of knowledge gaps divided by the maximum possible count: 10.

Outcome measures

Outcome measures
Measure	Intervention n=4819 Participants Participants who are assigned to any intervention groups	Control n=1211 Participants Participants who are assigned to a control group	Within Intervention Group: Doctor Racial Disparity (Arm A) vs. Either/Neither (Arm B) The relative IRR for intervention participants who saw the message on the relative incidence of COVID-19 among Black and white individuals and saw covid-19-related messages vs. those who did not see either or neither of the messages.	Within Control Group: Black Physician (Arm A) vs. White Physician (Arm B) The relative IRR for intervention participants who saw a Black doctor vs. white doctor	Within Control Group: AMA Anti-racism vs. Either/Neither The relative IRR for intervention participants who saw the AMA anti-racism treatment vs. those who saw the placebo message.	Intervention Group vs. Control Group The relative IRR for intervention participants who saw covid-related messages vs. those who did not see any covid-19 related messages.
Incidence Rate for Knowledge Gaps: Control vs. Any Intervention - Follow up	0.241 proportion of knowledge gaps Interval 0.238 to 0.244	0.250 proportion of knowledge gaps Interval 0.243 to 0.256	—	—	—	—

PRIMARY outcome

Timeframe: The outcome was measured immediately following the intervention in the baseline survey.

Participants were offered the option of requesting additional information on COVID-19 related resources by clicking on up to five links that included more content. We measured "information seeking behavior" as the number of links for which participants expressed interest, a count variable between 0 (lowest information seeking behavior) and 5 (greatest information seeking behavior). Incidence rate for interest in links is the count of links demanded divided by the maximum possible count: 5.

Outcome measures

Outcome measures
Measure	Intervention n=14569 Participants Participants who are assigned to any intervention groups	Control n=3654 Participants Participants who are assigned to a control group	Within Intervention Group: Doctor Racial Disparity (Arm A) vs. Either/Neither (Arm B) The relative IRR for intervention participants who saw the message on the relative incidence of COVID-19 among Black and white individuals and saw covid-19-related messages vs. those who did not see either or neither of the messages.	Within Control Group: Black Physician (Arm A) vs. White Physician (Arm B) The relative IRR for intervention participants who saw a Black doctor vs. white doctor	Within Control Group: AMA Anti-racism vs. Either/Neither The relative IRR for intervention participants who saw the AMA anti-racism treatment vs. those who saw the placebo message.	Intervention Group vs. Control Group The relative IRR for intervention participants who saw covid-related messages vs. those who did not see any covid-19 related messages.
Incidence Rate for Information-seeking Behavior: Control vs. Any Intervention	0.338 proportion of links Interval 0.332 to 0.344	0.320 proportion of links Interval 0.308 to 0.332	—	—	—	—

PRIMARY outcome

Timeframe: The outcome was measured at a follow-up within 2 weeks following the intervention.

Outcome measures

Outcome measures
Measure	Intervention n=4823 Participants Participants who are assigned to any intervention groups	Control n=1212 Participants Participants who are assigned to a control group	Within Intervention Group: Doctor Racial Disparity (Arm A) vs. Either/Neither (Arm B) The relative IRR for intervention participants who saw the message on the relative incidence of COVID-19 among Black and white individuals and saw covid-19-related messages vs. those who did not see either or neither of the messages.	Within Control Group: Black Physician (Arm A) vs. White Physician (Arm B) The relative IRR for intervention participants who saw a Black doctor vs. white doctor	Within Control Group: AMA Anti-racism vs. Either/Neither The relative IRR for intervention participants who saw the AMA anti-racism treatment vs. those who saw the placebo message.	Intervention Group vs. Control Group The relative IRR for intervention participants who saw covid-related messages vs. those who did not see any covid-19 related messages.
Incidence Rate - Safety Gap Score: Control vs. Any Intervention	0.450 proportion of safety gaps Interval 0.44 to 0.46	0.465 proportion of safety gaps Interval 0.445 to 0.484	—	—	—	—

PRIMARY outcome

Timeframe: The outcome was measured immediately following the intervention in the baseline survey.

Outcome measures

Outcome measures
Measure	Intervention n=13399 Participants Participants who are assigned to any intervention groups	Control n=3360 Participants Participants who are assigned to a control group	Within Intervention Group: Doctor Racial Disparity (Arm A) vs. Either/Neither (Arm B) The relative IRR for intervention participants who saw the message on the relative incidence of COVID-19 among Black and white individuals and saw covid-19-related messages vs. those who did not see either or neither of the messages.	Within Control Group: Black Physician (Arm A) vs. White Physician (Arm B) The relative IRR for intervention participants who saw a Black doctor vs. white doctor	Within Control Group: AMA Anti-racism vs. Either/Neither The relative IRR for intervention participants who saw the AMA anti-racism treatment vs. those who saw the placebo message.	Intervention Group vs. Control Group The relative IRR for intervention participants who saw covid-related messages vs. those who did not see any covid-19 related messages.
Willingness to Pay (WTP) for Masks: Control vs. Any Intervention	14.580 dollar Interval 14.148 to 14.741	14.072 dollar Interval 13.762 to 14.382	—	—	—	—

PRIMARY outcome

Timeframe: The outcome was measured immediately following the intervention in the baseline survey.

Population: Arms were combined to assess the differential effectiveness of each unique video message by comparing participants in Arm A vs. Arm B, since Arm A cut across several other studies: 1. within the intervention group; or 2. within the control group; or 3. across the intervention and control groups. Arms A and B are described in each Arm/Group Title.

Participants were asked to identify ways to prevent COVID-19 spread and identify four common symptoms. The incidence rate for knowledge gaps is the count of knowledge gaps divided by the maximum possible count: 10. The incidence rate ratio compares the incidence rate of participants in Arm A vs. Arm B within the intervention group (i.e. those who received covid-19-related videos), within in the control group (i.e. those who saw placebo videos), or across the intervention and control group. Arms A and B are described in each Arm/Group Title. The overall number of participants analyzed is all equal across 6 arms/groups because the outcome measure data presented below came from a single negative binomial regression.

Outcome measures

Outcome measures
Measure	Intervention n=18762 Participants Participants who are assigned to any intervention groups	Control n=18762 Participants Participants who are assigned to a control group	Within Intervention Group: Doctor Racial Disparity (Arm A) vs. Either/Neither (Arm B) n=18762 Participants The relative IRR for intervention participants who saw the message on the relative incidence of COVID-19 among Black and white individuals and saw covid-19-related messages vs. those who did not see either or neither of the messages.	Within Control Group: Black Physician (Arm A) vs. White Physician (Arm B) n=18762 Participants The relative IRR for intervention participants who saw a Black doctor vs. white doctor	Within Control Group: AMA Anti-racism vs. Either/Neither n=18762 Participants The relative IRR for intervention participants who saw the AMA anti-racism treatment vs. those who saw the placebo message.	Intervention Group vs. Control Group n=18762 Participants The relative IRR for intervention participants who saw covid-related messages vs. those who did not see any covid-19 related messages.
Incidence Rate Ratio (IRR) - Knowledge Gap	1.01 ratio Interval 0.96 to 1.06	0.99 ratio Interval 0.94 to 1.04	1.01 ratio Interval 0.98 to 1.03	0.99 ratio Interval 0.95 to 1.04	0.99 ratio Interval 0.95 to 1.03	0.89 ratio Interval 0.85 to 0.93

PRIMARY outcome

Timeframe: The outcome was measured at a follow-up within 2 weeks following the intervention

Outcome measures

Outcome measures
Measure	Intervention n=6030 Participants Participants who are assigned to any intervention groups	Control n=6030 Participants Participants who are assigned to a control group	Within Intervention Group: Doctor Racial Disparity (Arm A) vs. Either/Neither (Arm B) n=6030 Participants The relative IRR for intervention participants who saw the message on the relative incidence of COVID-19 among Black and white individuals and saw covid-19-related messages vs. those who did not see either or neither of the messages.	Within Control Group: Black Physician (Arm A) vs. White Physician (Arm B) n=6030 Participants The relative IRR for intervention participants who saw a Black doctor vs. white doctor	Within Control Group: AMA Anti-racism vs. Either/Neither n=6030 Participants The relative IRR for intervention participants who saw the AMA anti-racism treatment vs. those who saw the placebo message.	Intervention Group vs. Control Group n=6030 Participants The relative IRR for intervention participants who saw covid-related messages vs. those who did not see any covid-19 related messages.
Incidence Rate Ratio (IRR) - Knowledge Gap - Follow up	0.98 ratio Interval 0.9 to 1.07	0.98 ratio Interval 0.9 to 1.07	1.01 ratio Interval 0.98 to 1.05	1.01 ratio Interval 0.94 to 1.09	0.98 ratio Interval 0.91 to 1.06	0.97 ratio Interval 0.9 to 1.04

PRIMARY outcome

Timeframe: The outcome was measured immediately following the intervention in the baseline survey.

Participants were offered the option of requesting additional information on COVID-19 related resources by clicking on up to 5 links that included more content. We measured "information seeking behavior" as the number of links for which participants expressed interest, a count variable between 0 (lowest information seeking behavior) and 5 (greatest information seeking behavior). Incidence rate for interest in links is the count of links demanded divided by the maximum possible count: 5. The incidence rate ratio compares the incidence rate of participants in Arm A vs. Arm B within the intervention group (i.e. those who received covid-19-related videos), within in the control group (i.e. those who saw placebo videos), or across the intervention and control group. Arms A and B are described in each Arm/Group Title. The overall number of participants analyzed is all equal across 6 arms/groups because the outcome measure data presented below came from a single negative binomial regression.

Outcome measures

Outcome measures
Measure	Intervention n=18223 Participants Participants who are assigned to any intervention groups	Control n=18223 Participants Participants who are assigned to a control group	Within Intervention Group: Doctor Racial Disparity (Arm A) vs. Either/Neither (Arm B) n=18223 Participants The relative IRR for intervention participants who saw the message on the relative incidence of COVID-19 among Black and white individuals and saw covid-19-related messages vs. those who did not see either or neither of the messages.	Within Control Group: Black Physician (Arm A) vs. White Physician (Arm B) n=18223 Participants The relative IRR for intervention participants who saw a Black doctor vs. white doctor	Within Control Group: AMA Anti-racism vs. Either/Neither n=18223 Participants The relative IRR for intervention participants who saw the AMA anti-racism treatment vs. those who saw the placebo message.	Intervention Group vs. Control Group n=18223 Participants The relative IRR for intervention participants who saw covid-related messages vs. those who did not see any covid-19 related messages.
Incidence Rate Ratio (IRR) - Information-seeking Behavior	1.04 ratio Interval 0.95 to 1.14	1.03 ratio Interval 0.93 to 1.13	1.02 ratio Interval 0.98 to 1.07	0.96 ratio Interval 0.89 to 1.05	0.97 ratio Interval 0.89 to 1.05	1.01 ratio Interval 0.93 to 1.1

PRIMARY outcome

Timeframe: The outcome was measured at a follow-up within 2 weeks following the intervention.

Participants were asked about how often they engaged in four behaviors of interest: if they wore a mask indoors/outdoors; if they washed their hands; if they followed social distancing guidelines. The safety gap index takes values of 0 (if a participant reported that they always practiced the four behaviors of interest) up to 4 (none). Incidence rate for safety gaps is the count of safety gaps divided by the maximum possible count: 4. The incidence rate ratio compares the incidence rate of participants in Arm A vs. Arm B within the intervention group (i.e. those who received covid-19-related videos), within in the control group (i.e. those who saw placebo videos), or across the intervention and control group. Arms A and B are described in each Arm/Group Title. The overall number of participants analyzed is all equal across 6 arms/groups because the outcome measure data presented below came from a single negative binomial regression.

Outcome measures

Outcome measures
Measure	Intervention n=6035 Participants Participants who are assigned to any intervention groups	Control n=6035 Participants Participants who are assigned to a control group	Within Intervention Group: Doctor Racial Disparity (Arm A) vs. Either/Neither (Arm B) n=6035 Participants The relative IRR for intervention participants who saw the message on the relative incidence of COVID-19 among Black and white individuals and saw covid-19-related messages vs. those who did not see either or neither of the messages.	Within Control Group: Black Physician (Arm A) vs. White Physician (Arm B) n=6035 Participants The relative IRR for intervention participants who saw a Black doctor vs. white doctor	Within Control Group: AMA Anti-racism vs. Either/Neither n=6035 Participants The relative IRR for intervention participants who saw the AMA anti-racism treatment vs. those who saw the placebo message.	Intervention Group vs. Control Group n=6035 Participants The relative IRR for intervention participants who saw covid-related messages vs. those who did not see any covid-19 related messages.
Incidence Rate Ratio (IRR) - Safety Gap Score	1.04 ratio Interval 0.95 to 1.14	1.03 ratio Interval 0.93 to 1.12	1.01 ratio Interval 0.97 to 1.05	0.97 ratio Interval 0.89 to 1.05	0.95 ratio Interval 0.87 to 1.03	0.93 ratio Interval 0.86 to 1.01

PRIMARY outcome

Timeframe: The outcome was measured immediately following the intervention in the baseline survey.

WTP: the participants will be asked to choose between two masks vs an unrestricted gift card. They will be asked what amount of gift card would make them just as happy to receive two mask versus the gift card. The regression coefficients compares the incidence rate of participants in Arm A vs. Arm B within the intervention group (i.e. those who received covid-19-related videos), within in the control group (i.e. those who saw placebo videos), or across the intervention and control group. Arms A and B are described in each Arm/Group Title. The overall number of participants analyzed is all equal across 6 arms/groups because the outcome measure data presented below came from a single ordinary least squares (OLS) regression for WTP masks).

Outcome measures

Outcome measures
Measure	Intervention n=16759 Participants Participants who are assigned to any intervention groups	Control n=16759 Participants Participants who are assigned to a control group	Within Intervention Group: Doctor Racial Disparity (Arm A) vs. Either/Neither (Arm B) n=16759 Participants The relative IRR for intervention participants who saw the message on the relative incidence of COVID-19 among Black and white individuals and saw covid-19-related messages vs. those who did not see either or neither of the messages.	Within Control Group: Black Physician (Arm A) vs. White Physician (Arm B) n=16759 Participants The relative IRR for intervention participants who saw a Black doctor vs. white doctor	Within Control Group: AMA Anti-racism vs. Either/Neither n=16759 Participants The relative IRR for intervention participants who saw the AMA anti-racism treatment vs. those who saw the placebo message.	Intervention Group vs. Control Group n=16759 Participants The relative IRR for intervention participants who saw covid-related messages vs. those who did not see any covid-19 related messages.
OLS Regression Coefficients - Willingness to Pay (WTP) for Masks	-0.21 dollar Interval -0.91 to 0.49	-0.29 dollar Interval -0.99 to 0.41	0.07 dollar Interval -0.24 to 0.39	0.17 dollar Interval -0.45 to 0.8	0.32 dollar Interval -0.3 to 0.95	0.71 dollar Interval 0.09 to 1.34

Deaths: 0 deaths

Serious adverse events

Adverse event data not reported

Other adverse events

Adverse event data not reported

Additional Information

Tristan Loisel

JPAL North America

Phone: 6307476739

Email: [email protected]

Results disclosure agreements

Principal investigator is a sponsor employee
Publication restrictions are in place