DHL Survey on Generative AI for MyChart Messaging

NCT ID: NCT06108037

Last Updated: 2023-12-13

Study Results

Results pending

The study team has not published outcome measurements, participant flow, or safety data for this trial yet. Check back later for updates.

Basic Information

Get a concise snapshot of the trial, including recruitment status, study phase, enrollment targets, and key timeline milestones.

Recruitment Status

COMPLETED

Clinical Phase

NA

Total Enrollment

1454 participants

Study Classification

INTERVENTIONAL

Study Start Date

2023-10-31

Study Completion Date

2023-12-11

Brief Summary

Review the sponsor-provided synopsis that highlights what the study is about and why it is being conducted.

The purpose of this study is to understand how patients feel about the use of computer programs to create responses when they send electronic messages to their doctors.

Detailed Description

Dive into the extended narrative that explains the scientific background, objectives, and procedures in greater depth.

* The investigators will create short surveys online to ask patients how they feel about using computer programs that create messages in their medical records.
* The surveys will show fictional situations where patients ask questions and get answers from either real people or computer programs, with or without a disclosure about how the response was written.
* The investigators will ask the people taking the survey to share what they think about these situations using tools like rating scales, comparison scales, or written responses.
* If patients want to, they can provide their contact information to be part of future discussion groups. Participants do not have to give any personal information to complete the survey.

Conditions

See the medical conditions and disease areas that this research is targeting or investigating.

Communication

Keywords

Explore important study keywords that can help with search, categorization, and topic discovery.

Artificial Intelligence Generative Artificial Intelligence

Study Design

Understand how the trial is structured, including allocation methods, masking strategies, primary purpose, and other design elements.

Allocation Method

RANDOMIZED

Intervention Model

PARALLEL

* Participants will be randomly allocated to one of six arms.
* Over the course of the study period, there will be multiple rounds of surveys, which will consist of a clinical scenario, a response (human or AI generated), and a disclosure statement (none, human, or AI).
* All respondents within an arm will be assigned to a sequence of response-disclosure pairs prior to the first round of surveys.
Primary Study Purpose

OTHER

Blinding Strategy

SINGLE

Participants
Participants will not be aware of the arm they are assigned to. There is no care provider or outcomes assessor in this study, as the patients will report their own perceptions in a survey.

Study Groups

Review each arm or cohort in the study, along with the interventions and objectives associated with them.

Arm A

Each arm will receive 3 clinical scenarios spaced over time across 3 Sends. The 6 groups (Arms A-F) will be arranged with naming conventions as such:

* First letter = A, B, or C where A = scenario 1, B = scenario 2, and C = scenario 3.
* Second letter(s) = H or AI, where H = human response and AI = AI-written response to the patient question posed.
* Third letter(s) = N, C, or H, where N = no disclosure, C = computer disclosure, and H = human disclosure. This refers to the disclosure at the bottom of the response message whereby the author is or is not disclosed.

Arm A receives AHN in Send 1, BAIC in Send 2, and CHH in Send 3

Group Type OTHER

Generative AI for electronic communication and disclosure

Intervention Type BEHAVIORAL

We will use a large language model such as GPT 3.5 to automatically generate responses to fictional messages to a physician. We will disclose whether the message was generated using this technology or not. There are 3 clinical scenarios and 6 pairs of human/AI response and human disclosure/AI disclosure/not disclosed that will test patient attitudes toward this technology.

Arm B

Each arm will receive 3 clinical scenarios spaced over time across 3 Sends. The 6 groups (Arms A-F) will be arranged with naming conventions as such:

* First letter = A, B, or C where A = scenario 1, B = scenario 2, and C = scenario 3.
* Second letter(s) = H or AI, where H = human response and AI = AI-written response to the patient question posed.
* Third letter(s) = N, C, or H, where N = no disclosure, C = computer disclosure, and H = human disclosure. This refers to the disclosure at the bottom of the response message whereby the author is or is not disclosed.

Arm B receives BHC in Send 1, CAIH in Send 2, and AAIN in Send 3

Group Type OTHER

Generative AI for electronic communication and disclosure

Intervention Type BEHAVIORAL

We will use a large language model such as GPT 3.5 to automatically generate responses to fictional messages to a physician. We will disclose whether the message was generated using this technology or not. There are 3 clinical scenarios and 6 pairs of human/AI response and human disclosure/AI disclosure/not disclosed that will test patient attitudes toward this technology.

Arm C

Each arm will receive 3 clinical scenarios spaced over time across 3 Sends. The 6 groups (Arms A-F) will be arranged with naming conventions as such:

* First letter = A, B, or C where A = scenario 1, B = scenario 2, and C = scenario 3.
* Second letter(s) = H or AI, where H = human response and AI = AI-written response to the patient question posed.
* Third letter(s) = N, C, or H, where N = no disclosure, C = computer disclosure, and H = human disclosure. This refers to the disclosure at the bottom of the response message whereby the author is or is not disclosed.

Arm C receives CHC in Send 1, AHH in Send 2, and BAIN in Send 3

Group Type OTHER

Generative AI for electronic communication and disclosure

Intervention Type BEHAVIORAL

We will use a large language model such as GPT 3.5 to automatically generate responses to fictional messages to a physician. We will disclose whether the message was generated using this technology or not. There are 3 clinical scenarios and 6 pairs of human/AI response and human disclosure/AI disclosure/not disclosed that will test patient attitudes toward this technology.

Arm D

Each arm will receive 3 clinical scenarios spaced over time across 3 Sends. The 6 groups (Arms A-F) will be arranged with naming conventions as such:

* First letter = A, B, or C where A = scenario 1, B = scenario 2, and C = scenario 3.
* Second letter(s) = H or AI, where H = human response and AI = AI-written response to the patient question posed.
* Third letter(s) = N, C, or H, where N = no disclosure, C = computer disclosure, and H = human disclosure. This refers to the disclosure at the bottom of the response message whereby the author is or is not disclosed.

Arm D receives AAIH in Send 1, BHN in Send 2, and CAIC in Send 3

Group Type OTHER

Generative AI for electronic communication and disclosure

Intervention Type BEHAVIORAL

We will use a large language model such as GPT 3.5 to automatically generate responses to fictional messages to a physician. We will disclose whether the message was generated using this technology or not. There are 3 clinical scenarios and 6 pairs of human/AI response and human disclosure/AI disclosure/not disclosed that will test patient attitudes toward this technology.

Arm E

Each arm will receive 3 clinical scenarios spaced over time across 3 Sends. The 6 groups (Arms A-F) will be arranged with naming conventions as such:

* First letter = A, B, or C where A = scenario 1, B = scenario 2, and C = scenario 3.
* Second letter(s) = H or AI, where H = human response and AI = AI-written response to the patient question posed.
* Third letter(s) = N, C, or H, where N = no disclosure, C = computer disclosure, and H = human disclosure. This refers to the disclosure at the bottom of the response message whereby the author is or is not disclosed.

Arm E receives BAIH in Send 1, CHN in Send 2, and AHC in Send 3

Group Type OTHER

Generative AI for electronic communication and disclosure

Intervention Type BEHAVIORAL

We will use a large language model such as GPT 3.5 to automatically generate responses to fictional messages to a physician. We will disclose whether the message was generated using this technology or not. There are 3 clinical scenarios and 6 pairs of human/AI response and human disclosure/AI disclosure/not disclosed that will test patient attitudes toward this technology.

Arm F

Each arm will receive 3 clinical scenarios spaced over time across 3 Sends. The 6 groups (Arms A-F) will be arranged with naming conventions as such:

* First letter = A, B, or C where A = scenario 1, B = scenario 2, and C = scenario 3.
* Second letter(s) = H or AI, where H = human response and AI = AI-written response to the patient question posed.
* Third letter(s) = N, C, or H, where N = no disclosure, C = computer disclosure, and H = human disclosure. This refers to the disclosure at the bottom of the response message whereby the author is or is not disclosed.

Arm F receives CAIN in Send 1, AAIC in Send 2, and BHH in Send 3

Group Type OTHER

Generative AI for electronic communication and disclosure

Intervention Type BEHAVIORAL

We will use a large language model such as GPT 3.5 to automatically generate responses to fictional messages to a physician. We will disclose whether the message was generated using this technology or not. There are 3 clinical scenarios and 6 pairs of human/AI response and human disclosure/AI disclosure/not disclosed that will test patient attitudes toward this technology.

Interventions

Learn about the drugs, procedures, or behavioral strategies being tested and how they are applied within this trial.

Generative AI for electronic communication and disclosure

We will use a large language model such as GPT 3.5 to automatically generate responses to fictional messages to a physician. We will disclose whether the message was generated using this technology or not. There are 3 clinical scenarios and 6 pairs of human/AI response and human disclosure/AI disclosure/not disclosed that will test patient attitudes toward this technology.

Intervention Type BEHAVIORAL

Eligibility Criteria

Check the participation requirements, including inclusion and exclusion rules, age limits, and whether healthy volunteers are accepted.

Inclusion Criteria

* Member of the Duke Health Listens patient advocacy community

Exclusion Criteria

* Age \< 18
Minimum Eligible Age

18 Years

Eligible Sex

ALL

Accepts Healthy Volunteers

Yes

Sponsors

Meet the organizations funding or collaborating on the study and learn about their roles.

Duke University

OTHER

Sponsor Role lead

Responsible Party

Identify the individual or organization who holds primary responsibility for the study information submitted to regulators.

Responsibility Role SPONSOR

Principal Investigators

Learn about the lead researchers overseeing the trial and their institutional affiliations.

Anand Chowdhury, MD, MMCi

Role: PRINCIPAL_INVESTIGATOR

Duke University

Locations

Explore where the study is taking place and check the recruitment status at each participating site.

Duke University Health System

Durham, North Carolina, United States

Site Status

Countries

Review the countries where the study has at least one active or historical site.

United States

References

Explore related publications, articles, or registry entries linked to this study.

Ayers JW, Poliak A, Dredze M, Leas EC, Zhu Z, Kelley JB, Faix DJ, Goodman AM, Longhurst CA, Hogarth M, Smith DM. Comparing Physician and Artificial Intelligence Chatbot Responses to Patient Questions Posted to a Public Social Media Forum. JAMA Intern Med. 2023 Jun 1;183(6):589-596. doi: 10.1001/jamainternmed.2023.1838.

Reference Type BACKGROUND
PMID: 37115527 (View on PubMed)

Other Identifiers

Review additional registry numbers or institutional identifiers associated with this trial.

Pro00113587

Identifier Type: -

Identifier Source: org_study_id