Trial Outcomes & Findings for Nudging Flu Vaccination by Making it Easy for Patients to Schedule a Flu Shot (NCT NCT05493787)

Results Overview

Patient self-schedules a flu vaccine appointment through the patient portal. This outcome measures whether the patient schedules an appointment within 4 weeks of the send date, but the appointment can occur more than 4 weeks past the send date.

Recruitment status

COMPLETED

Study phase

NA

Target enrollment

139503 participants

Primary outcome timeframe

Within 4 weeks of message send date

Results posted on

2024-12-30

Participant Flow

Participant milestones

Participant milestones
Measure	Passive Control - November No message	Active Control Message - November A message that simply states that patients can get a flu shot at Geisinger Reminder: Patient portal, SMS, email, and/or another modality	Ease Message - November A message emphasizing the ease of scheduling a flu shot at Geisinger Reminder: Patient portal, SMS, email, and/or another modality	Waiting for You Message - November A message that states the patient's flu shot is "waiting" for them at Geisinger Reminder: Patient portal, SMS, email, and/or another modality	Protect Yourself - Rare Message - November A message that emphasizes the rare, dangerous outcomes of getting the flu (e.g., hospitalization, pneumonia), and states that a flu shot can offer protection from those outcomes Reminder: Patient portal, SMS, email, and/or another modality	Protect Yourself - Frequent Message - November A message that emphasizes the outcomes that frequently occur in people with the flu (e.g., fever, chills, missing important events), and states that a flu shot can offer protection from those outcomes Reminder: Patient portal, SMS, email, and/or another modality	Passive Control - December No message	Active Control Message - December A message that simply states that patients can get a flu shot at Geisinger Reminder: Patient portal, SMS, email, and/or another modality	Ease Message - December A message emphasizing the ease of scheduling a flu shot at Geisinger Reminder: Patient portal, SMS, email, and/or another modality	Waiting for You Message - December A message that states the patient's flu shot is "waiting" for them at Geisinger Reminder: Patient portal, SMS, email, and/or another modality	Protect Yourself - Rare Message - December A message that emphasizes the rare, dangerous outcomes of getting the flu (e.g., hospitalization, pneumonia), and states that a flu shot can offer protection from those outcomes Reminder: Patient portal, SMS, email, and/or another modality	Protect Yourself - Frequent Message - December A message that emphasizes the outcomes that frequently occur in people with the flu (e.g., fever, chills, missing important events), and states that a flu shot can offer protection from those outcomes Reminder: Patient portal, SMS, email, and/or another modality
Overall Study STARTED	12531	12531	12531	12531	12530	12531	10705	10743	10657	10783	10702	10728
Overall Study COMPLETED	12531	12531	12531	12531	12530	12531	10705	10743	10657	10783	10702	10728
Overall Study NOT COMPLETED	0	0	0	0	0	0	0	0	0	0	0	0

Reasons for withdrawal

Withdrawal data not reported

Baseline Characteristics

Nudging Flu Vaccination by Making it Easy for Patients to Schedule a Flu Shot

Baseline characteristics by cohort

Baseline characteristics by cohort
Measure	Passive Control - November n=12531 Participants No message	Active Control Message - November n=12531 Participants A message that simply states that patients can get a flu shot at Geisinger Reminder: Patient portal, SMS, email, and/or another modality	Ease Message - November n=12531 Participants A message emphasizing the ease of scheduling a flu shot at Geisinger Reminder: Patient portal, SMS, email, and/or another modality	Waiting for You Message - November n=12531 Participants A message that states the patient's flu shot is "waiting" for them at Geisinger Reminder: Patient portal, SMS, email, and/or another modality	Protect Yourself - Rare Message - November n=12530 Participants A message that emphasizes the rare, dangerous outcomes of getting the flu (e.g., hospitalization, pneumonia), and states that a flu shot can offer protection from those outcomes Reminder: Patient portal, SMS, email, and/or another modality	Protect Yourself - Frequent Message - November n=12531 Participants A message that emphasizes the outcomes that frequently occur in people with the flu (e.g., fever, chills, missing important events), and states that a flu shot can offer protection from those outcomes Reminder: Patient portal, SMS, email, and/or another modality	Passive Control - December n=10705 Participants No message	Active Control Message - December n=10743 Participants A message that simply states that patients can get a flu shot at Geisinger Reminder: Patient portal, SMS, email, and/or another modality	Ease Message - December n=10657 Participants A message emphasizing the ease of scheduling a flu shot at Geisinger Reminder: Patient portal, SMS, email, and/or another modality	Waiting for You Message - December n=10783 Participants A message that states the patient's flu shot is "waiting" for them at Geisinger Reminder: Patient portal, SMS, email, and/or another modality	Protect Yourself - Rare Message - December n=10702 Participants A message that emphasizes the rare, dangerous outcomes of getting the flu (e.g., hospitalization, pneumonia), and states that a flu shot can offer protection from those outcomes Reminder: Patient portal, SMS, email, and/or another modality	Protect Yourself - Frequent Message - December n=10728 Participants A message that emphasizes the outcomes that frequently occur in people with the flu (e.g., fever, chills, missing important events), and states that a flu shot can offer protection from those outcomes Reminder: Patient portal, SMS, email, and/or another modality	Total n=139503 Participants Total of all reporting groups
Age, Customized 18-64 years	11105 Participants n=5 Participants	11041 Participants n=7 Participants	11096 Participants n=5 Participants	11073 Participants n=4 Participants	11018 Participants n=21 Participants	11040 Participants n=8 Participants	9573 Participants n=8 Participants	9585 Participants n=24 Participants	9564 Participants n=42 Participants	9621 Participants n=42 Participants	9532 Participants n=42 Participants	9564 Participants n=42 Participants	123812 Participants n=36 Participants
Age, Customized 65+ years	1426 Participants n=5 Participants	1490 Participants n=7 Participants	1435 Participants n=5 Participants	1458 Participants n=4 Participants	1512 Participants n=21 Participants	1491 Participants n=8 Participants	1132 Participants n=8 Participants	1158 Participants n=24 Participants	1093 Participants n=42 Participants	1162 Participants n=42 Participants	1170 Participants n=42 Participants	1164 Participants n=42 Participants	15691 Participants n=36 Participants
Sex: Female, Male Female	7019 Participants n=5 Participants	7025 Participants n=7 Participants	7048 Participants n=5 Participants	7126 Participants n=4 Participants	7047 Participants n=21 Participants	7153 Participants n=8 Participants	6002 Participants n=8 Participants	5964 Participants n=24 Participants	5945 Participants n=42 Participants	6007 Participants n=42 Participants	5960 Participants n=42 Participants	6072 Participants n=42 Participants	78368 Participants n=36 Participants
Sex: Female, Male Male	5512 Participants n=5 Participants	5506 Participants n=7 Participants	5483 Participants n=5 Participants	5405 Participants n=4 Participants	5483 Participants n=21 Participants	5378 Participants n=8 Participants	4703 Participants n=8 Participants	4779 Participants n=24 Participants	4712 Participants n=42 Participants	4776 Participants n=42 Participants	4742 Participants n=42 Participants	4656 Participants n=42 Participants	61135 Participants n=36 Participants
Ethnicity (NIH/OMB) Hispanic or Latino	551 Participants n=5 Participants	581 Participants n=7 Participants	632 Participants n=5 Participants	613 Participants n=4 Participants	590 Participants n=21 Participants	612 Participants n=8 Participants	501 Participants n=8 Participants	513 Participants n=24 Participants	537 Participants n=42 Participants	537 Participants n=42 Participants	528 Participants n=42 Participants	494 Participants n=42 Participants	6689 Participants n=36 Participants
Ethnicity (NIH/OMB) Not Hispanic or Latino	11851 Participants n=5 Participants	11810 Participants n=7 Participants	11759 Participants n=5 Participants	11783 Participants n=4 Participants	11794 Participants n=21 Participants	11784 Participants n=8 Participants	10078 Participants n=8 Participants	10119 Participants n=24 Participants	10000 Participants n=42 Participants	10127 Participants n=42 Participants	10060 Participants n=42 Participants	10126 Participants n=42 Participants	131291 Participants n=36 Participants
Ethnicity (NIH/OMB) Unknown or Not Reported	129 Participants n=5 Participants	140 Participants n=7 Participants	140 Participants n=5 Participants	135 Participants n=4 Participants	146 Participants n=21 Participants	135 Participants n=8 Participants	126 Participants n=8 Participants	111 Participants n=24 Participants	120 Participants n=42 Participants	119 Participants n=42 Participants	114 Participants n=42 Participants	108 Participants n=42 Participants	1523 Participants n=36 Participants
Race (NIH/OMB) American Indian or Alaska Native	21 Participants n=5 Participants	20 Participants n=7 Participants	29 Participants n=5 Participants	41 Participants n=4 Participants	27 Participants n=21 Participants	35 Participants n=8 Participants	25 Participants n=8 Participants	30 Participants n=24 Participants	19 Participants n=42 Participants	33 Participants n=42 Participants	20 Participants n=42 Participants	22 Participants n=42 Participants	322 Participants n=36 Participants
Race (NIH/OMB) Asian	159 Participants n=5 Participants	195 Participants n=7 Participants	183 Participants n=5 Participants	181 Participants n=4 Participants	154 Participants n=21 Participants	173 Participants n=8 Participants	128 Participants n=8 Participants	145 Participants n=24 Participants	131 Participants n=42 Participants	139 Participants n=42 Participants	157 Participants n=42 Participants	146 Participants n=42 Participants	1891 Participants n=36 Participants
Race (NIH/OMB) Native Hawaiian or Other Pacific Islander	50 Participants n=5 Participants	56 Participants n=7 Participants	57 Participants n=5 Participants	64 Participants n=4 Participants	50 Participants n=21 Participants	48 Participants n=8 Participants	52 Participants n=8 Participants	62 Participants n=24 Participants	51 Participants n=42 Participants	46 Participants n=42 Participants	37 Participants n=42 Participants	54 Participants n=42 Participants	627 Participants n=36 Participants
Race (NIH/OMB) Black or African American	508 Participants n=5 Participants	505 Participants n=7 Participants	542 Participants n=5 Participants	507 Participants n=4 Participants	484 Participants n=21 Participants	534 Participants n=8 Participants	460 Participants n=8 Participants	444 Participants n=24 Participants	466 Participants n=42 Participants	450 Participants n=42 Participants	451 Participants n=42 Participants	422 Participants n=42 Participants	5773 Participants n=36 Participants
Race (NIH/OMB) White	11636 Participants n=5 Participants	11604 Participants n=7 Participants	11575 Participants n=5 Participants	11566 Participants n=4 Participants	11646 Participants n=21 Participants	11592 Participants n=8 Participants	9914 Participants n=8 Participants	9937 Participants n=24 Participants	9857 Participants n=42 Participants	9980 Participants n=42 Participants	9880 Participants n=42 Participants	9962 Participants n=42 Participants	129149 Participants n=36 Participants
Race (NIH/OMB) More than one race	4 Participants n=5 Participants	5 Participants n=7 Participants	3 Participants n=5 Participants	4 Participants n=4 Participants	1 Participants n=21 Participants	1 Participants n=8 Participants	3 Participants n=8 Participants	0 Participants n=24 Participants	2 Participants n=42 Participants	0 Participants n=42 Participants	0 Participants n=42 Participants	1 Participants n=42 Participants	24 Participants n=36 Participants
Race (NIH/OMB) Unknown or Not Reported	153 Participants n=5 Participants	146 Participants n=7 Participants	142 Participants n=5 Participants	168 Participants n=4 Participants	168 Participants n=21 Participants	148 Participants n=8 Participants	123 Participants n=8 Participants	125 Participants n=24 Participants	131 Participants n=42 Participants	135 Participants n=42 Participants	157 Participants n=42 Participants	121 Participants n=42 Participants	1717 Participants n=36 Participants
Region of Enrollment United States	12531 participants n=5 Participants	12531 participants n=7 Participants	12531 participants n=5 Participants	12531 participants n=4 Participants	12530 participants n=21 Participants	12531 participants n=8 Participants	10705 participants n=8 Participants	10743 participants n=24 Participants	10657 participants n=42 Participants	10783 participants n=42 Participants	10702 participants n=42 Participants	10728 participants n=42 Participants	139503 participants n=36 Participants

PRIMARY outcome

Timeframe: Within 4 weeks of message send date

Patient self-schedules a flu vaccine appointment through the patient portal. This outcome measures whether the patient schedules an appointment within 4 weeks of the send date, but the appointment can occur more than 4 weeks past the send date.

Outcome measures

Outcome measures
Measure	Passive Control - November n=12531 Participants No message	Active Control Message - November n=12531 Participants A message that simply states that patients can get a flu shot at Geisinger Reminder: Patient portal, SMS, email, and/or another modality	Ease Message - November n=12531 Participants A message emphasizing the ease of scheduling a flu shot at Geisinger Reminder: Patient portal, SMS, email, and/or another modality	Waiting for You Message - November n=12531 Participants A message that states the patient's flu shot is "waiting" for them at Geisinger Reminder: Patient portal, SMS, email, and/or another modality	Protect Yourself - Rare Message n=12530 Participants A message that emphasizes the rare, dangerous outcomes of getting the flu (e.g., hospitalization, pneumonia), and states that a flu shot can offer protection from those outcomes Reminder: Patient portal, SMS, email, and/or another modality	Protect Yourself - Frequent Message - November n=12531 Participants A message that emphasizes the outcomes that frequently occur in people with the flu (e.g., fever, chills, missing important events), and states that a flu shot can offer protection from those outcomes Reminder: Patient portal, SMS, email, and/or another modality	Passive Control - December n=10705 Participants No message	Active Control Message - December n=10743 Participants A message that simply states that patients can get a flu shot at Geisinger Reminder: Patient portal, SMS, email, and/or another modality	Ease Message - December n=10657 Participants A message emphasizing the ease of scheduling a flu shot at Geisinger Reminder: Patient portal, SMS, email, and/or another modality	Waiting for You Message - December n=10783 Participants A message that states the patient's flu shot is "waiting" for them at Geisinger Reminder: Patient portal, SMS, email, and/or another modality	Protect Yourself - Rare Message - December n=10702 Participants A message that emphasizes the rare, dangerous outcomes of getting the flu (e.g., hospitalization, pneumonia), and states that a flu shot can offer protection from those outcomes Reminder: Patient portal, SMS, email, and/or another modality	Protect Yourself - Frequent Message - December n=10728 Participants A message that emphasizes the outcomes that frequently occur in people with the flu (e.g., fever, chills, missing important events), and states that a flu shot can offer protection from those outcomes Reminder: Patient portal, SMS, email, and/or another modality
Number of Patients Who Self-scheduled a Flu Shot	43 Participants	63 Participants	62 Participants	74 Participants	70 Participants	53 Participants	8 Participants	28 Participants	36 Participants	44 Participants	20 Participants	26 Participants

SECONDARY outcome

Timeframe: Within 4 weeks of message send date

Number of patients who received a flu vaccine

Outcome measures

Outcome measures
Measure	Passive Control - November n=12531 Participants No message	Active Control Message - November n=12531 Participants A message that simply states that patients can get a flu shot at Geisinger Reminder: Patient portal, SMS, email, and/or another modality	Ease Message - November n=12531 Participants A message emphasizing the ease of scheduling a flu shot at Geisinger Reminder: Patient portal, SMS, email, and/or another modality	Waiting for You Message - November n=12531 Participants A message that states the patient's flu shot is "waiting" for them at Geisinger Reminder: Patient portal, SMS, email, and/or another modality	Protect Yourself - Rare Message n=12530 Participants A message that emphasizes the rare, dangerous outcomes of getting the flu (e.g., hospitalization, pneumonia), and states that a flu shot can offer protection from those outcomes Reminder: Patient portal, SMS, email, and/or another modality	Protect Yourself - Frequent Message - November n=12531 Participants A message that emphasizes the outcomes that frequently occur in people with the flu (e.g., fever, chills, missing important events), and states that a flu shot can offer protection from those outcomes Reminder: Patient portal, SMS, email, and/or another modality	Passive Control - December n=10705 Participants No message	Active Control Message - December n=10743 Participants A message that simply states that patients can get a flu shot at Geisinger Reminder: Patient portal, SMS, email, and/or another modality	Ease Message - December n=10657 Participants A message emphasizing the ease of scheduling a flu shot at Geisinger Reminder: Patient portal, SMS, email, and/or another modality	Waiting for You Message - December n=10783 Participants A message that states the patient's flu shot is "waiting" for them at Geisinger Reminder: Patient portal, SMS, email, and/or another modality	Protect Yourself - Rare Message - December n=10702 Participants A message that emphasizes the rare, dangerous outcomes of getting the flu (e.g., hospitalization, pneumonia), and states that a flu shot can offer protection from those outcomes Reminder: Patient portal, SMS, email, and/or another modality	Protect Yourself - Frequent Message - December n=10728 Participants A message that emphasizes the outcomes that frequently occur in people with the flu (e.g., fever, chills, missing important events), and states that a flu shot can offer protection from those outcomes Reminder: Patient portal, SMS, email, and/or another modality
Flu Vaccination	488 Participants	450 Participants	468 Participants	460 Participants	450 Participants	478 Participants	146 Participants	158 Participants	153 Participants	177 Participants	142 Participants	124 Participants

OTHER_PRE_SPECIFIED outcome

Timeframe: Up to 7 months

Patient received a flu diagnosis via a positive PCR/antigen/molecular test (yes/no) during the 2022-23 flu season (from the patient's message send date through April 30, 2023).

Outcome measures

Outcome data not reported

OTHER_PRE_SPECIFIED outcome

Timeframe: Up to 7 months

Received a "high confidence flu" diagnosis (with positive polymerase chain reaction \[PCR\]/antigen/molecular test) and/or "likely flu" diagnosis (as assessed via International Classification of Disease \[ICD\] codes or Tamiflu administration or positive PCR/antigen/molecular test) (yes/no) during the 2022-23 flu season (from the patient's message send date through April 30, 2023). Note that "likely flu" is a superset of the "high confidence flu" diagnoses.

Outcome measures

Outcome data not reported

OTHER_PRE_SPECIFIED outcome

Timeframe: Up to 10 months

Diagnosed with flu-related complications (yes/no) from the patient's message send date through July 31, 2023.

Outcome measures

Outcome data not reported

OTHER_PRE_SPECIFIED outcome

Timeframe: Up to 10 months

Number of ER visits from the patient's message send date through July 31, 2023.

Outcome measures

Outcome data not reported

OTHER_PRE_SPECIFIED outcome

Timeframe: Up to 10 months

Number of hospitalizations from the patient's message send date through July 31, 2023.

Outcome measures

Outcome data not reported

OTHER_PRE_SPECIFIED outcome

Timeframe: Up to 7 months

Received at least one COVID-19 vaccination (yes/no) during the 2022-23 flu season (from the patient's message send date through April 30, 2023).

Outcome measures

Outcome data not reported

OTHER_PRE_SPECIFIED outcome

Timeframe: Within 4 weeks of the message send date

Population: This outcome divides the population by sex (as listed in the electronic health record)

Patient self-schedules a flu vaccine through the patient portal This outcome measures whether the patient schedules an appointment within 4 weeks of the message send date, but the appointment can occur more than 4 weeks past the send date.

Outcome measures

Outcome measures
Measure	Passive Control - November n=12531 Participants No message	Active Control Message - November n=12531 Participants A message that simply states that patients can get a flu shot at Geisinger Reminder: Patient portal, SMS, email, and/or another modality	Ease Message - November n=12531 Participants A message emphasizing the ease of scheduling a flu shot at Geisinger Reminder: Patient portal, SMS, email, and/or another modality	Waiting for You Message - November n=12531 Participants A message that states the patient's flu shot is "waiting" for them at Geisinger Reminder: Patient portal, SMS, email, and/or another modality	Protect Yourself - Rare Message n=12530 Participants A message that emphasizes the rare, dangerous outcomes of getting the flu (e.g., hospitalization, pneumonia), and states that a flu shot can offer protection from those outcomes Reminder: Patient portal, SMS, email, and/or another modality	Protect Yourself - Frequent Message - November n=12531 Participants A message that emphasizes the outcomes that frequently occur in people with the flu (e.g., fever, chills, missing important events), and states that a flu shot can offer protection from those outcomes Reminder: Patient portal, SMS, email, and/or another modality	Passive Control - December n=10705 Participants No message	Active Control Message - December n=10743 Participants A message that simply states that patients can get a flu shot at Geisinger Reminder: Patient portal, SMS, email, and/or another modality	Ease Message - December n=10657 Participants A message emphasizing the ease of scheduling a flu shot at Geisinger Reminder: Patient portal, SMS, email, and/or another modality	Waiting for You Message - December n=10783 Participants A message that states the patient's flu shot is "waiting" for them at Geisinger Reminder: Patient portal, SMS, email, and/or another modality	Protect Yourself - Rare Message - December n=10702 Participants A message that emphasizes the rare, dangerous outcomes of getting the flu (e.g., hospitalization, pneumonia), and states that a flu shot can offer protection from those outcomes Reminder: Patient portal, SMS, email, and/or another modality	Protect Yourself - Frequent Message - December n=10728 Participants A message that emphasizes the outcomes that frequently occur in people with the flu (e.g., fever, chills, missing important events), and states that a flu shot can offer protection from those outcomes Reminder: Patient portal, SMS, email, and/or another modality
Number of Patients Who Self-Scheduled a Flu Shot by Sex Female	28 Participants	38 Participants	46 Participants	45 Participants	53 Participants	31 Participants	6 Participants	13 Participants	21 Participants	25 Participants	11 Participants	9 Participants
Number of Patients Who Self-Scheduled a Flu Shot by Sex Male	15 Participants	25 Participants	16 Participants	29 Participants	17 Participants	22 Participants	2 Participants	15 Participants	15 Participants	19 Participants	9 Participants	17 Participants

OTHER_PRE_SPECIFIED outcome

Timeframe: Within 4 weeks of the message send date

Population: This outcome divides the population by race (as listed in the electronic health record)

Patient self-schedules a flu vaccine through the patient portal This outcome measures whether the patient schedules an appointment within 4 weeks of the message send date, but the appointment can occur more than 4 weeks past the send date.

Outcome measures

Outcome measures
Measure	Passive Control - November n=12531 Participants No message	Active Control Message - November n=12531 Participants A message that simply states that patients can get a flu shot at Geisinger Reminder: Patient portal, SMS, email, and/or another modality	Ease Message - November n=12531 Participants A message emphasizing the ease of scheduling a flu shot at Geisinger Reminder: Patient portal, SMS, email, and/or another modality	Waiting for You Message - November n=12531 Participants A message that states the patient's flu shot is "waiting" for them at Geisinger Reminder: Patient portal, SMS, email, and/or another modality	Protect Yourself - Rare Message n=12530 Participants A message that emphasizes the rare, dangerous outcomes of getting the flu (e.g., hospitalization, pneumonia), and states that a flu shot can offer protection from those outcomes Reminder: Patient portal, SMS, email, and/or another modality	Protect Yourself - Frequent Message - November n=12531 Participants A message that emphasizes the outcomes that frequently occur in people with the flu (e.g., fever, chills, missing important events), and states that a flu shot can offer protection from those outcomes Reminder: Patient portal, SMS, email, and/or another modality	Passive Control - December n=10705 Participants No message	Active Control Message - December n=10743 Participants A message that simply states that patients can get a flu shot at Geisinger Reminder: Patient portal, SMS, email, and/or another modality	Ease Message - December n=10657 Participants A message emphasizing the ease of scheduling a flu shot at Geisinger Reminder: Patient portal, SMS, email, and/or another modality	Waiting for You Message - December n=10783 Participants A message that states the patient's flu shot is "waiting" for them at Geisinger Reminder: Patient portal, SMS, email, and/or another modality	Protect Yourself - Rare Message - December n=10702 Participants A message that emphasizes the rare, dangerous outcomes of getting the flu (e.g., hospitalization, pneumonia), and states that a flu shot can offer protection from those outcomes Reminder: Patient portal, SMS, email, and/or another modality	Protect Yourself - Frequent Message - December n=10728 Participants A message that emphasizes the outcomes that frequently occur in people with the flu (e.g., fever, chills, missing important events), and states that a flu shot can offer protection from those outcomes Reminder: Patient portal, SMS, email, and/or another modality
Number of Patients Who Self-Scheduled a Flu Shot by Race American Indian or Alaska Native	0 Participants	0 Participants	0 Participants	0 Participants	0 Participants	0 Participants	0 Participants	0 Participants	0 Participants	0 Participants	0 Participants	0 Participants
Number of Patients Who Self-Scheduled a Flu Shot by Race Asian	2 Participants	2 Participants	1 Participants	1 Participants	0 Participants	0 Participants	0 Participants	0 Participants	0 Participants	1 Participants	1 Participants	0 Participants
Number of Patients Who Self-Scheduled a Flu Shot by Race Native Hawaiian or Other Pacific Islander	0 Participants	0 Participants	0 Participants	1 Participants	1 Participants	0 Participants	0 Participants	0 Participants	0 Participants	0 Participants	0 Participants	0 Participants
Number of Patients Who Self-Scheduled a Flu Shot by Race Black or African American	1 Participants	4 Participants	4 Participants	1 Participants	0 Participants	1 Participants	0 Participants	1 Participants	1 Participants	3 Participants	0 Participants	1 Participants
Number of Patients Who Self-Scheduled a Flu Shot by Race White	40 Participants	57 Participants	57 Participants	71 Participants	67 Participants	50 Participants	7 Participants	24 Participants	34 Participants	40 Participants	18 Participants	25 Participants
Number of Patients Who Self-Scheduled a Flu Shot by Race Two or More	0 Participants	0 Participants	0 Participants	0 Participants	0 Participants	0 Participants	0 Participants	0 Participants	0 Participants	0 Participants	0 Participants	0 Participants
Number of Patients Who Self-Scheduled a Flu Shot by Race Unknown	0 Participants	0 Participants	0 Participants	0 Participants	2 Participants	2 Participants	1 Participants	3 Participants	1 Participants	0 Participants	1 Participants	0 Participants

OTHER_PRE_SPECIFIED outcome

Timeframe: Within 4 weeks of the message send date

Population: This outcome divides the population by ethnicity (as listed in the electronic health record)

Patient self-schedules a flu vaccine through the patient portal This outcome measures whether the patient schedules an appointment within 4 weeks of the message send date, but the appointment can occur more than 4 weeks past the send date.