Trial Outcomes & Findings for Patient Portal Reminder/Recall for Influenza Vaccination in a Health System- UCLA Portal R/R Influenza RCT 3 (NCT NCT04533685)

Last Updated: 2022-10-25

Results Overview

Receipt of the annual influenza vaccination (between 8/1/20 - 4/1/21) among index patients. Outcomes will be assessed via vaccine data extraction from the electronic health record and external claims and pharmacy data. The index patients must also be an active UCLA Health MyChart user (\>= 1 login over the last 12 months from 8/1/20, excluding activity on the user's initial profile activation date). Individuals not affiliated with any primary care practice will be excluded from the primary analysis.

Recruitment status

COMPLETED

Study phase

Target enrollment

213773 participants

Primary outcome timeframe

6 months

Results posted on

2022-10-25

Participant Flow

Participant milestones

Participant milestones
Measure	Direct Scheduling + Pre-commitment + Pre-appt Reminder Participants receive 1) reminder/recall messages regarding influenza vaccination via the patient portal with a link enabling direct scheduling, 2) a pre-commitment prompt and 3) pre-appointment reminders that mention asking the provider for a flu vaccine Portal Reminders for Influenza Vaccination: Direct scheduling link: Patients receive reminder/recall messages via the patient portal to get an influenza vaccination that include a direct scheduling link, enabling the patient to directly schedule a flu vaccination only visit Pre-Commitment Prompt: Patients receive a pre-commitment prompt asking about their intention to get an influenza vaccination Pre-Appointment flu vaccine reminders: Patients receive modified pre-appointment reminders for upcoming scheduled appointments that include language encouraging patients to ask the provider for the flu vaccine	Direct Scheduling + Pre-commitment Participants receive 1) reminder/recall messages regarding influenza vaccination via the patient portal with a link enabling direct scheduling and 2) a pre-commitment prompt Portal Reminders for Influenza Vaccination: Direct scheduling link: Patients receive reminder/recall messages via the patient portal to get an influenza vaccination that include a direct scheduling link, enabling the patient to directly schedule a flu vaccination only visit Pre-Commitment Prompt: Patients receive a pre-commitment prompt asking about their intention to get an influenza vaccination	Direct Scheduling + Pre-appt Reminder Participants receive 1) reminder/recall messages regarding influenza vaccination via the patient portal with a link enabling direct scheduling and 2) pre-appointment reminders that mention asking the provider for a flu vaccine Portal Reminders for Influenza Vaccination: Direct scheduling link: Patients receive reminder/recall messages via the patient portal to get an influenza vaccination that include a direct scheduling link, enabling the patient to directly schedule a flu vaccination only visit Pre-Appointment flu vaccine reminders: Patients receive modified pre-appointment reminders for upcoming scheduled appointments that include language encouraging patients to ask the provider for the flu vaccine	Direct Scheduling Participants receive 1) reminder/recall messages regarding influenza vaccination via the patient portal with a link enabling direct scheduling Portal Reminders for Influenza Vaccination: Direct scheduling link: Patients receive reminder/recall messages via the patient portal to get an influenza vaccination that include a direct scheduling link, enabling the patient to directly schedule a flu vaccination only visit	No Direct Scheduling + Pre-commitment + Pre-Appt Reminder Participants receive 1) reminder/recall messages regarding influenza vaccination via the patient portal without a link enabling direct scheduling, 2) a pre-commitment prompt and 3) pre-appointment reminders that mention asking the provider for a flu vaccine Portal Reminders for Influenza Vaccination: No direct scheduling link: Patients receive reminder/recall messages via the patient portal to get an influenza vaccination (no direct scheduling link included) Pre-Commitment Prompt: Patients receive a pre-commitment prompt asking about their intention to get an influenza vaccination Pre-Appointment flu vaccine reminders: Patients receive modified pre-appointment reminders for upcoming scheduled appointments that include language encouraging patients to ask the provider for the flu vaccine	No Direct Scheduling + Pre-commitment Participants receive 1) reminder/recall messages regarding influenza vaccination via the patient portal without a link enabling direct scheduling and 2) a pre-commitment prompt Portal Reminders for Influenza Vaccination: No direct scheduling link: Patients receive reminder/recall messages via the patient portal to get an influenza vaccination (no direct scheduling link included) Pre-Commitment Prompt: Patients receive a pre-commitment prompt asking about their intention to get an influenza vaccination	No Direct Scheduling + Pre-appt Reminder Participants receive 1) reminder/recall messages regarding influenza vaccination via the patient portal without a link enabling direct scheduling and 2) pre-appointment reminders that mention asking the provider for a flu vaccine Portal Reminders for Influenza Vaccination: No direct scheduling link: Patients receive reminder/recall messages via the patient portal to get an influenza vaccination (no direct scheduling link included) Pre-Appointment flu vaccine reminders: Patients receive modified pre-appointment reminders for upcoming scheduled appointments that include language encouraging patients to ask the provider for the flu vaccine	No Direct Scheduling Participants receive 1) reminder/recall messages regarding influenza vaccination via the patient portal without a link enabling direct scheduling for a flu vaccine appointment Portal Reminders for Influenza Vaccination: No direct scheduling link: Patients receive reminder/recall messages via the patient portal to get an influenza vaccination (no direct scheduling link included)	Control Arm Participants will not receive any reminder/recall messages regarding influenza vaccination via the patient portal or other intervention components
Overall Study STARTED	17848	17842	17832	17827	17821	17819	17812	17805	71167
Overall Study COMPLETED	17848	17842	17832	17827	17821	17819	17812	17805	71167
Overall Study NOT COMPLETED	0	0	0	0	0	0	0	0	0

Reasons for withdrawal

Withdrawal data not reported

Baseline Characteristics

Patient Portal Reminder/Recall for Influenza Vaccination in a Health System- UCLA Portal R/R Influenza RCT 3

Baseline characteristics by cohort

Baseline characteristics by cohort
Measure	Direct Scheduling + Pre-commitment + Pre-appt Reminder n=17848 Participants Participants receive 1) reminder/recall messages regarding influenza vaccination via the patient portal with a link enabling direct scheduling, 2) a pre-commitment prompt and 3) pre-appointment reminders that mention asking the provider for a flu vaccine Portal Reminders for Influenza Vaccination: Direct scheduling link: Patients receive reminder/recall messages via the patient portal to get an influenza vaccination that include a direct scheduling link, enabling the patient to directly schedule a flu vaccination only visit Pre-Commitment Prompt: Patients receive a pre-commitment prompt asking about their intention to get an influenza vaccination Pre-Appointment flu vaccine reminders: Patients receive modified pre-appointment reminders for upcoming scheduled appointments that include language encouraging patients to ask the provider for the flu vaccine	Direct Scheduling + Pre-commitment n=17842 Participants Participants receive 1) reminder/recall messages regarding influenza vaccination via the patient portal with a link enabling direct scheduling and 2) a pre-commitment prompt Portal Reminders for Influenza Vaccination: Direct scheduling link: Patients receive reminder/recall messages via the patient portal to get an influenza vaccination that include a direct scheduling link, enabling the patient to directly schedule a flu vaccination only visit Pre-Commitment Prompt: Patients receive a pre-commitment prompt asking about their intention to get an influenza vaccination	Direct Scheduling + Pre-appt Reminder n=17832 Participants Participants receive 1) reminder/recall messages regarding influenza vaccination via the patient portal with a link enabling direct scheduling and 2) pre-appointment reminders that mention asking the provider for a flu vaccine Portal Reminders for Influenza Vaccination: Direct scheduling link: Patients receive reminder/recall messages via the patient portal to get an influenza vaccination that include a direct scheduling link, enabling the patient to directly schedule a flu vaccination only visit Pre-Appointment flu vaccine reminders: Patients receive modified pre-appointment reminders for upcoming scheduled appointments that include language encouraging patients to ask the provider for the flu vaccine	Direct Scheduling n=17827 Participants Participants receive 1) reminder/recall messages regarding influenza vaccination via the patient portal with a link enabling direct scheduling Portal Reminders for Influenza Vaccination: Direct scheduling link: Patients receive reminder/recall messages via the patient portal to get an influenza vaccination that include a direct scheduling link, enabling the patient to directly schedule a flu vaccination only visit	No Direct Scheduling + Pre-commitment + Pre-Appt Reminder n=17821 Participants Participants receive 1) reminder/recall messages regarding influenza vaccination via the patient portal without a link enabling direct scheduling, 2) a pre-commitment prompt and 3) pre-appointment reminders that mention asking the provider for a flu vaccine Portal Reminders for Influenza Vaccination: No direct scheduling link: Patients receive reminder/recall messages via the patient portal to get an influenza vaccination (no direct scheduling link included) Pre-Commitment Prompt: Patients receive a pre-commitment prompt asking about their intention to get an influenza vaccination Pre-Appointment flu vaccine reminders: Patients receive modified pre-appointment reminders for upcoming scheduled appointments that include language encouraging patients to ask the provider for the flu vaccine	No Direct Scheduling + Pre-commitment n=17819 Participants Participants receive 1) reminder/recall messages regarding influenza vaccination via the patient portal without a link enabling direct scheduling and 2) a pre-commitment prompt Portal Reminders for Influenza Vaccination: No direct scheduling link: Patients receive reminder/recall messages via the patient portal to get an influenza vaccination (no direct scheduling link included) Pre-Commitment Prompt: Patients receive a pre-commitment prompt asking about their intention to get an influenza vaccination	No Direct Scheduling + Pre-appt Reminder n=17812 Participants Participants receive 1) reminder/recall messages regarding influenza vaccination via the patient portal without a link enabling direct scheduling and 2) pre-appointment reminders that mention asking the provider for a flu vaccine Portal Reminders for Influenza Vaccination: No direct scheduling link: Patients receive reminder/recall messages via the patient portal to get an influenza vaccination (no direct scheduling link included) Pre-Appointment flu vaccine reminders: Patients receive modified pre-appointment reminders for upcoming scheduled appointments that include language encouraging patients to ask the provider for the flu vaccine	No Direct Scheduling n=17805 Participants Participants receive 1) reminder/recall messages regarding influenza vaccination via the patient portal without a link enabling direct scheduling for a flu vaccine appointment Portal Reminders for Influenza Vaccination: No direct scheduling link: Patients receive reminder/recall messages via the patient portal to get an influenza vaccination (no direct scheduling link included)	Control Arm n=71167 Participants Participants will not receive any reminder/recall messages regarding influenza vaccination via the patient portal or other intervention components	Total n=213773 Participants Total of all reporting groups
Age, Customized <18 years	1556 Participants n=5 Participants	1561 Participants n=7 Participants	1535 Participants n=5 Participants	1547 Participants n=4 Participants	1511 Participants n=21 Participants	1535 Participants n=8 Participants	1546 Participants n=8 Participants	1576 Participants n=24 Participants	6071 Participants n=42 Participants	18438 Participants n=42 Participants
Age, Customized 18-64 years	13166 Participants n=5 Participants	13234 Participants n=7 Participants	13208 Participants n=5 Participants	13202 Participants n=4 Participants	13274 Participants n=21 Participants	13148 Participants n=8 Participants	13238 Participants n=8 Participants	13122 Participants n=24 Participants	52973 Participants n=42 Participants	158565 Participants n=42 Participants
Age, Customized 65+ years	3126 Participants n=5 Participants	3047 Participants n=7 Participants	3089 Participants n=5 Participants	3078 Participants n=4 Participants	3036 Participants n=21 Participants	3136 Participants n=8 Participants	3028 Participants n=8 Participants	3107 Participants n=24 Participants	12123 Participants n=42 Participants	36770 Participants n=42 Participants
Sex/Gender, Customized Female	10100 Participants n=5 Participants	10130 Participants n=7 Participants	10158 Participants n=5 Participants	10028 Participants n=4 Participants	10179 Participants n=21 Participants	10169 Participants n=8 Participants	10116 Participants n=8 Participants	10190 Participants n=24 Participants	40517 Participants n=42 Participants	121587 Participants n=42 Participants
Sex/Gender, Customized Male	7748 Participants n=5 Participants	7711 Participants n=7 Participants	7674 Participants n=5 Participants	7797 Participants n=4 Participants	7642 Participants n=21 Participants	7648 Participants n=8 Participants	7696 Participants n=8 Participants	7615 Participants n=24 Participants	30646 Participants n=42 Participants	92177 Participants n=42 Participants
Sex/Gender, Customized Other	0 Participants n=5 Participants	0 Participants n=7 Participants	0 Participants n=5 Participants	0 Participants n=4 Participants	0 Participants n=21 Participants	0 Participants n=8 Participants	0 Participants n=8 Participants	0 Participants n=24 Participants	1 Participants n=42 Participants	1 Participants n=42 Participants
Sex/Gender, Customized Unknown	0 Participants n=5 Participants	1 Participants n=7 Participants	0 Participants n=5 Participants	2 Participants n=4 Participants	0 Participants n=21 Participants	2 Participants n=8 Participants	0 Participants n=8 Participants	0 Participants n=24 Participants	3 Participants n=42 Participants	8 Participants n=42 Participants
Race/Ethnicity, Customized White or Caucasian	9705 Participants n=5 Participants	9501 Participants n=7 Participants	9662 Participants n=5 Participants	9676 Participants n=4 Participants	9557 Participants n=21 Participants	9648 Participants n=8 Participants	9602 Participants n=8 Participants	9628 Participants n=24 Participants	38560 Participants n=42 Participants	115539 Participants n=42 Participants
Race/Ethnicity, Customized Asian	1638 Participants n=5 Participants	1756 Participants n=7 Participants	1713 Participants n=5 Participants	1703 Participants n=4 Participants	1713 Participants n=21 Participants	1793 Participants n=8 Participants	1677 Participants n=8 Participants	1770 Participants n=24 Participants	6750 Participants n=42 Participants	20513 Participants n=42 Participants
Race/Ethnicity, Customized Black	826 Participants n=5 Participants	814 Participants n=7 Participants	821 Participants n=5 Participants	849 Participants n=4 Participants	837 Participants n=21 Participants	811 Participants n=8 Participants	787 Participants n=8 Participants	829 Participants n=24 Participants	3332 Participants n=42 Participants	9906 Participants n=42 Participants
Race/Ethnicity, Customized American Indian or Alaska Native	49 Participants n=5 Participants	53 Participants n=7 Participants	43 Participants n=5 Participants	46 Participants n=4 Participants	43 Participants n=21 Participants	34 Participants n=8 Participants	41 Participants n=8 Participants	47 Participants n=24 Participants	127 Participants n=42 Participants	483 Participants n=42 Participants
Race/Ethnicity, Customized Multiracial	526 Participants n=5 Participants	527 Participants n=7 Participants	500 Participants n=5 Participants	517 Participants n=4 Participants	522 Participants n=21 Participants	539 Participants n=8 Participants	476 Participants n=8 Participants	494 Participants n=24 Participants	2022 Participants n=42 Participants	6123 Participants n=42 Participants
Race/Ethnicity, Customized Other	2449 Participants n=5 Participants	2491 Participants n=7 Participants	2456 Participants n=5 Participants	2472 Participants n=4 Participants	2475 Participants n=21 Participants	2439 Participants n=8 Participants	2509 Participants n=8 Participants	2465 Participants n=24 Participants	9796 Participants n=42 Participants	29552 Participants n=42 Participants
Race/Ethnicity, Customized Unknown	2819 Participants n=5 Participants	2921 Participants n=7 Participants	2732 Participants n=5 Participants	2679 Participants n=4 Participants	2763 Participants n=21 Participants	2727 Participants n=8 Participants	2818 Participants n=8 Participants	2716 Participants n=24 Participants	11104 Participants n=42 Participants	33279 Participants n=42 Participants
Race/Ethnicity, Customized Not Hispanic or Latino	13227 Participants n=5 Participants	13081 Participants n=7 Participants	13272 Participants n=5 Participants	13271 Participants n=4 Participants	13164 Participants n=21 Participants	13235 Participants n=8 Participants	13111 Participants n=8 Participants	13221 Participants n=24 Participants	52663 Participants n=42 Participants	158245 Participants n=42 Participants
Race/Ethnicity, Customized Hispanic or Latino	1802 Participants n=5 Participants	1840 Participants n=7 Participants	1828 Participants n=5 Participants	1877 Participants n=4 Participants	1894 Participants n=21 Participants	1857 Participants n=8 Participants	1883 Participants n=8 Participants	1868 Participants n=24 Participants	7400 Participants n=42 Participants	22249 Participants n=42 Participants
Primary Language English	17504 Participants n=5 Participants	17518 Participants n=7 Participants	17521 Participants n=5 Participants	17522 Participants n=4 Participants	17451 Participants n=21 Participants	17420 Participants n=8 Participants	17451 Participants n=8 Participants	17448 Participants n=24 Participants	69771 Participants n=42 Participants	209606 Participants n=42 Participants
Primary Language Spanish	134 Participants n=5 Participants	133 Participants n=7 Participants	135 Participants n=5 Participants	122 Participants n=4 Participants	130 Participants n=21 Participants	157 Participants n=8 Participants	145 Participants n=8 Participants	155 Participants n=24 Participants	525 Participants n=42 Participants	1636 Participants n=42 Participants
Primary Language Other	192 Participants n=5 Participants	180 Participants n=7 Participants	166 Participants n=5 Participants	171 Participants n=4 Participants	231 Participants n=21 Participants	227 Participants n=8 Participants	198 Participants n=8 Participants	188 Participants n=24 Participants	800 Participants n=42 Participants	2353 Participants n=42 Participants
Primary Language Uknown	18 Participants n=5 Participants	11 Participants n=7 Participants	10 Participants n=5 Participants	12 Participants n=4 Participants	9 Participants n=21 Participants	15 Participants n=8 Participants	18 Participants n=8 Participants	14 Participants n=24 Participants	71 Participants n=42 Participants	178 Participants n=42 Participants
Primary Insurance Class Commercial	12407 Participants n=5 Participants	12544 Participants n=7 Participants	12458 Participants n=5 Participants	12393 Participants n=4 Participants	12562 Participants n=21 Participants	12443 Participants n=8 Participants	12581 Participants n=8 Participants	12367 Participants n=24 Participants	49916 Participants n=42 Participants	149671 Participants n=42 Participants
Primary Insurance Class UCLA Managed Care	2688 Participants n=5 Participants	2700 Participants n=7 Participants	2662 Participants n=5 Participants	2760 Participants n=4 Participants	2648 Participants n=21 Participants	2683 Participants n=8 Participants	2623 Participants n=8 Participants	2723 Participants n=24 Participants	10566 Participants n=42 Participants	32053 Participants n=42 Participants
Primary Insurance Class Medicare	2055 Participants n=5 Participants	1938 Participants n=7 Participants	2040 Participants n=5 Participants	2025 Participants n=4 Participants	1950 Participants n=21 Participants	2023 Participants n=8 Participants	1967 Participants n=8 Participants	2043 Participants n=24 Participants	7949 Participants n=42 Participants	23990 Participants n=42 Participants
Primary Insurance Class Medi-Cal	280 Participants n=5 Participants	261 Participants n=7 Participants	270 Participants n=5 Participants	260 Participants n=4 Participants	247 Participants n=21 Participants	265 Participants n=8 Participants	263 Participants n=8 Participants	242 Participants n=24 Participants	1063 Participants n=42 Participants	3151 Participants n=42 Participants
Primary Insurance Class Other	223 Participants n=5 Participants	216 Participants n=7 Participants	217 Participants n=5 Participants	195 Participants n=4 Participants	220 Participants n=21 Participants	197 Participants n=8 Participants	190 Participants n=8 Participants	226 Participants n=24 Participants	888 Participants n=42 Participants	2572 Participants n=42 Participants
Primary Insurance Class Tricare	108 Participants n=5 Participants	106 Participants n=7 Participants	123 Participants n=5 Participants	121 Participants n=4 Participants	125 Participants n=21 Participants	120 Participants n=8 Participants	109 Participants n=8 Participants	117 Participants n=24 Participants	475 Participants n=42 Participants	1404 Participants n=42 Participants
Primary Insurance Class Group Health Plan	42 Participants n=5 Participants	38 Participants n=7 Participants	27 Participants n=5 Participants	37 Participants n=4 Participants	36 Participants n=21 Participants	49 Participants n=8 Participants	31 Participants n=8 Participants	42 Participants n=24 Participants	160 Participants n=42 Participants	462 Participants n=42 Participants
Primary Insurance Class International Payor	5 Participants n=5 Participants	4 Participants n=7 Participants	3 Participants n=5 Participants	3 Participants n=4 Participants	4 Participants n=21 Participants	5 Participants n=8 Participants	6 Participants n=8 Participants	5 Participants n=24 Participants	12 Participants n=42 Participants	47 Participants n=42 Participants
Primary Insurance Class Self-pay	3 Participants n=5 Participants	2 Participants n=7 Participants	1 Participants n=5 Participants	2 Participants n=4 Participants	1 Participants n=21 Participants	2 Participants n=8 Participants	1 Participants n=8 Participants	3 Participants n=24 Participants	5 Participants n=42 Participants	20 Participants n=42 Participants
Primary Insurance Class Package Billing	1 Participants n=5 Participants	0 Participants n=7 Participants	1 Participants n=5 Participants	0 Participants n=4 Participants	0 Participants n=21 Participants	1 Participants n=8 Participants	1 Participants n=8 Participants	1 Participants n=24 Participants	0 Participants n=42 Participants	5 Participants n=42 Participants
Primary Insurance Class Unknown	36 Participants n=5 Participants	33 Participants n=7 Participants	30 Participants n=5 Participants	31 Participants n=4 Participants	28 Participants n=21 Participants	31 Participants n=8 Participants	40 Participants n=8 Participants	36 Participants n=24 Participants	133 Participants n=42 Participants	398 Participants n=42 Participants

PRIMARY outcome

Timeframe: 6 months