Trial Outcomes & Findings for Veterans Experiences Using Secure Messaging (NCT NCT01382186)

NCT ID: NCT01382186

Last Updated: 2015-04-28

Results Overview

To determine ease of use and usefulness of secure messaging. Purposive sample of 33 participants were assessed for their ability to complete the following tasks: navigate to Secure Messaging, log-in to My HealtheVet and Secure Messaging, Set user preferences, check Secure Message inbox, open and send Secure Message, Open and read Secure Message attachment. Measured as: (1) able to complete task; (2) able to complete task with some difficulty; (3) not able to complete task.

• Recruitment status: COMPLETED
• Target enrollment: 852 participants
• Primary outcome timeframe: baseline
• Results posted on: 2015-04-28

Participant Flow

Participant milestones

Measure	Purposive Sampling Purposive sampling was used to identify a sample of 33 Veterans who have been Personally Authenticated for the SM feature on MHV. Participants were recruited from each site (Tampa, Boston). Women were purposively recruited to ensure females were represented in data findings.	Random Sampling Random sampling was used to conduct a quantitative survey with 819 veterans to explore their experiences using secure messaging.
Overall Study STARTED	33	819
Overall Study COMPLETED	32	819
Overall Study NOT COMPLETED	1	0

Reasons for withdrawal

Withdrawal data not reported

Baseline Characteristics

Veterans Experiences Using Secure Messaging

Baseline characteristics by cohort

Measure	Purposive Sampling n=33 Participants Veterans registered for My HealtheVet and opted-in to use Secure Messaging from the Tampa, FL and Boston, MA areas.	Random Sampling n=819 Participants Veterans registered for My HealtheVet and opted-in to use Secure Messaging from the Tampa, FL and Boston, MA areas.	Total n=852 Participants Total of all reporting groups
Age, Continuous	59.5 years STANDARD_DEVIATION 12 • n=93 Participants	62 years STANDARD_DEVIATION 13 • n=4 Participants	60.75 years STANDARD_DEVIATION 12.5 • n=27 Participants
Sex: Female, Male Female	7 Participants n=93 Participants	107 Participants n=4 Participants	114 Participants n=27 Participants
Sex: Female, Male Male	26 Participants n=93 Participants	712 Participants n=4 Participants	738 Participants n=27 Participants
Ethnicity (NIH/OMB) Hispanic or Latino	2 Participants n=93 Participants	45 Participants n=4 Participants	47 Participants n=27 Participants
Ethnicity (NIH/OMB) Not Hispanic or Latino	28 Participants n=93 Participants	706 Participants n=4 Participants	734 Participants n=27 Participants
Ethnicity (NIH/OMB) Unknown or Not Reported	3 Participants n=93 Participants	68 Participants n=4 Participants	71 Participants n=27 Participants
Region of Enrollment United States	33 participants n=93 Participants	819 participants n=4 Participants	852 participants n=27 Participants
Number of particpants with greater than or equal to high school education	33 participants n=93 Participants	817 participants n=4 Participants	850 participants n=27 Participants
Number of participants with annual income of $35,001 or more	21 participants n=93 Participants	434 participants n=4 Participants	455 participants n=27 Participants

PRIMARY outcome

Timeframe: baseline

Population: This user-testing method was conducted with the first purposive sample of 33 participants in phase 1 of the study. The random sample of 819 participants in phase 2 were not a part of the user-testing study method.

To determine ease of use and usefulness of secure messaging. Purposive sample of 33 participants were assessed for their ability to complete the following tasks: navigate to Secure Messaging, log-in to My HealtheVet and Secure Messaging, Set user preferences, check Secure Message inbox, open and send Secure Message, Open and read Secure Message attachment. Measured as: (1) able to complete task; (2) able to complete task with some difficulty; (3) not able to complete task.

Outcome measures

Measure	Purposive Sampling: Able to Complete Task n=33 Participants Veterans in this arm were able to complete the task.	Purposive Sampling: Able to Complete Task With Difficulty n=33 Participants Veterans in this arm were able to complete task with some difficulty.	Purposive Sampling: Not Able to Complete Task n=33 Participants Veterans in this arm were not able to complete the task.
Usability of Secure Messaging Log in to site	30 participants	2 participants	1 participants
Usability of Secure Messaging Set "User Preferences"	23 participants	8 participants	2 participants
Usability of Secure Messaging Navigate to My HealtheVet Site	21 participants	10 participants	2 participants
Usability of Secure Messaging Check inbox	33 participants	0 participants	0 participants
Usability of Secure Messaging Use links within Secure Messaging	33 participants	0 participants	0 participants
Usability of Secure Messaging Open Secure Message	33 participants	0 participants	0 participants
Usability of Secure Messaging Open attachment	33 participants	0 participants	0 participants
Usability of Secure Messaging Send secure message	30 participants	3 participants	0 participants
Usability of Secure Messaging Choose secure message recipients	32 participants	0 participants	1 participants
Usability of Secure Messaging Categorize message subject	9 participants	0 participants	24 participants
Usability of Secure Messaging Formulate subject header	18 participants	0 participants	15 participants
Usability of Secure Messaging Formulate a secure message	33 participants	0 participants	0 participants

PRIMARY outcome

Timeframe: 3 months

Population: This method of secondary data collection was conducted with the purposive sample of 33 Veterans in phase 1 of the study. The random sample of 819 Veteran survey respondents in phase 2 were not included in this method of data collection.

Extraction of secure messages over a three-month time frame to examine message content type, including: general, tests, medication, and appointments.

Outcome measures

Measure	Purposive Sampling: Able to Complete Task n=66 number messages Veterans in this arm were able to complete the task.	Purposive Sampling: Able to Complete Task With Difficulty Veterans in this arm were able to complete task with some difficulty.	Purposive Sampling: Not Able to Complete Task Veterans in this arm were not able to complete the task.
Secure Messaging Use and Content Patterns General	36 secure messages	—	—
Secure Messaging Use and Content Patterns Test	1 secure messages	—	—
Secure Messaging Use and Content Patterns Appointment	15 secure messages	—	—
Secure Messaging Use and Content Patterns Medication	10 secure messages	—	—
Secure Messaging Use and Content Patterns Other: System Related not Content Related	4 secure messages	—	—

PRIMARY outcome

Timeframe: baseline

Population: This is a primary outcome for phase 2 of the study which was measured in random sample of 819 Veterans. The purposive sample of 33 Veterans from phase 1 was not included in this method of the study.

Mail surveys examine Veterans frequency of electronic resource use.

Outcome measures

Measure	Purposive Sampling: Able to Complete Task n=819 Participants Veterans in this arm were able to complete the task.	Purposive Sampling: Able to Complete Task With Difficulty Veterans in this arm were able to complete task with some difficulty.	Purposive Sampling: Not Able to Complete Task Veterans in this arm were not able to complete the task.
Frequency of Electronic Resource Use Everyday use of computer	662 participants	—	—
Frequency of Electronic Resource Use Everyday use of internet	653 participants	—	—
Frequency of Electronic Resource Use Use My HealtheVet "a few times a month or less"	629 participants	—	—
Frequency of Electronic Resource Use Using secure messaging 6 months or longer	499 participants	—	—
Frequency of Electronic Resource Use Use secure messaging at least once a year	486 participants	—	—
Frequency of Electronic Resource Use Use secure messaging at least once a month	131 participants	—	—

PRIMARY outcome

Timeframe: baseline

Population: This is a primary outcome for phase 2 of the study which was measured in random sample of 819 Veterans registered for My HealtheVet and opted in to use Secure Messaging. The sample of 33 Veterans from phase 1 was not included in this method of the study.

Participants reported reasons for Using Secure Messaging tool on My HealtheVet

Outcome measures

Measure	Purposive Sampling: Able to Complete Task n=819 Participants Veterans in this arm were able to complete the task.	Purposive Sampling: Able to Complete Task With Difficulty Veterans in this arm were able to complete task with some difficulty.	Purposive Sampling: Not Able to Complete Task Veterans in this arm were not able to complete the task.
Reasons for Using Secure Messaging Tool on My HealtheVet Completing medication refills	546 participant	—	—
Reasons for Using Secure Messaging Tool on My HealtheVet Medication questions	313 participant	—	—
Reasons for Using Secure Messaging Tool on My HealtheVet Managing appointments	343 participant	—	—
Reasons for Using Secure Messaging Tool on My HealtheVet Test results	350 participant	—	—
Reasons for Using Secure Messaging Tool on My HealtheVet Health related questions	340 participant	—	—
Reasons for Using Secure Messaging Tool on My HealtheVet Sensitive health topics	67 participant	—	—

PRIMARY outcome

Timeframe: baseline

Population: This is a primary outcome for phase 2 of the study which was measured in random sample of 819 Veterans registered for My HealtheVet and opted in to use Secure Messaging. The sample of 33 Veterans from phase 1 was not included in this method of the study.

Veterans report benefits of using Secure Messaging

Outcome measures

Measure	Purposive Sampling: Able to Complete Task n=819 Participants Veterans in this arm were able to complete the task.	Purposive Sampling: Able to Complete Task With Difficulty Veterans in this arm were able to complete task with some difficulty.	Purposive Sampling: Not Able to Complete Task Veterans in this arm were not able to complete the task.
Benefits of Using Secure Messaging Good communication tool	619 participant	—	—
Benefits of Using Secure Messaging Saves time	590 participant	—	—
Benefits of Using Secure Messaging Easy to use	544 participant	—	—

PRIMARY outcome

Timeframe: baseline

Population: This is a primary outcome for phase 2 of the study which was measured in random sample of 819 Veterans registered for My HealtheVet and opted in to use Secure Messaging. The sample of 33 Veterans from phase 1 was not included in this method of the study.

Veteran respondent intention to use Secure Messaging in the future

Outcome measures

Measure	Purposive Sampling: Able to Complete Task n=819 Participants Veterans in this arm were able to complete the task.	Purposive Sampling: Able to Complete Task With Difficulty Veterans in this arm were able to complete task with some difficulty.	Purposive Sampling: Not Able to Complete Task Veterans in this arm were not able to complete the task.
Intention to Use Secure Messaging in the Future	689 participant	—	—

PRIMARY outcome

Timeframe: baseline

Population: This is a primary outcome for phase 2 of the study which was measured in random sample of 819 Veterans registered for My HealtheVet and opted in to use Secure Messaging. The sample of 33 Veterans from phase 1 was not included in this method of the study.

Veterans were asked to report if improvements to the secure messaging system would make the tool more useful for use in the future.

Outcome measures

Measure	Purposive Sampling: Able to Complete Task n=819 Participants Veterans in this arm were able to complete the task.	Purposive Sampling: Able to Complete Task With Difficulty Veterans in this arm were able to complete task with some difficulty.	Purposive Sampling: Not Able to Complete Task Veterans in this arm were not able to complete the task.
Veterans That Believed Improvements to the Secure Messaging System Would Make the Tool More Useful in the Future Are Presented in the Table.	342 participant	—	—

PRIMARY outcome

Timeframe: baseline

Population: This is a primary outcome for phase 2 of the study which was measured in random sample of 819 Veterans registered for My HealtheVet and opted in to use Secure Messaging. The sample of 33 Veterans from phase 1 was not included in this method of the study.

Veterans were asked to report if they would like to have education and support using My HealtheVet and the Secure Messaging tool.

Outcome measures

Measure	Purposive Sampling: Able to Complete Task n=819 Participants Veterans in this arm were able to complete the task.	Purposive Sampling: Able to Complete Task With Difficulty Veterans in this arm were able to complete task with some difficulty.	Purposive Sampling: Not Able to Complete Task Veterans in this arm were not able to complete the task.
Veteran Need for Education Support for My HealtheVet and Secure Messaging Use. Reported need for education and support	328 participant	—	—
Veteran Need for Education Support for My HealtheVet and Secure Messaging Use. Report Veterans would benefit from education	652 participant	—	—

Adverse Events

Purposive Sampling

Serious events: 0 serious events

Other events: 0 other events

Deaths: 0 deaths

Random Sampling

Serious events: 0 serious events

Other events: 0 other events

Deaths: 0 deaths

Serious adverse events

Adverse event data not reported

Other adverse events

Adverse event data not reported

Additional Information

Dr. Jolie Haun

Center of Innovation on Disability and Rehabilitation Research

Phone: 813-558-7622

Email: jolie.haun@va.gov

Results disclosure agreements

• Principal investigator is a sponsor employee
• Publication restrictions are in place