LLM-Generated Lay Summaries for Brain MRI Reports

NCT ID: NCT07310394

Last Updated: 2025-12-30

Basic Information

• Recruitment Status: NOT_YET_RECRUITING
• Clinical Phase: NA
• Total Enrollment: 1200 participants
• Study Classification: INTERVENTIONAL
• Study Start Date: 2025-12-10
• Study Completion Date: 2026-02-25

Brief Summary

The goal of this clinical trial is to learn if a summary written by artificial intelligence (AI) helps adults understand brain MRI reports for headaches. The main question it aims to answer is: "Does adding a simple summary help readers correctly understand if a cause for the headache was found in the report?" Researchers will compare standard MRI reports to reports that include an AI-generated explanation to see if the extra summary improves understanding.

Participants will:

Read 6 fictional brain MRI reports online. Answer questions to check if they understood the results. Rate their satisfaction and if they feel they would need to ask a doctor for help.

Detailed Description

Background Headaches account for approximately 2% to 4% of emergency department visits, representing about 450,000 consultations annually in France. While 95% of these cases are benign primary headaches, identifying secondary causes requiring urgent management is critical, often leading to increased use of neuroimaging such as MRI. However, radiology reports often contain complex medical jargon that can be difficult for patients and non-specialist physicians to understand, potentially causing confusion or anxiety. Large Language Models (LLMs) have demonstrated the potential to simplify complex medical text. While commercial models exist, open-weights models (which can be deployed locally to ensure data security) offer a promising avenue for clinical integration. This study aims to evaluate the efficacy of an AI-generated plain-language summary in improving patient understanding of brain MRI reports.

Study Design This is a randomized, controlled, single-blind trial nested within the COMPARE e-cohort. The study uses a parallel-group design with a 1:1 allocation ratio. The entire study is conducted remotely via secure online forms.

Participants The study recruits adult volunteers already enrolled in the COMPARE e-cohort. Participants must have sufficient proficiency in written French to read the reports and complete the questionnaires. No specific medical condition is required for inclusion, as the study uses fictional case scenarios.

Intervention and Procedures Participants are randomized to one of two groups via a minimization procedure balancing history of brain MRI and known neurological pathology. Each participant is asked to read six fictional brain MRI reports simulating common emergency headache scenarios. The six reports cover three clinical situations: two with normal results, two with incidental findings not explaining the headache, and two with abnormalities explaining the headache. In the experimental group, participants receive the standard MRI report enriched with a structured summary paragraph generated by an open-weights LLM, inserted under the section Synthesis for the patient and non-radiologist physician. In the control group, participants receive the standard MRI report in its native version without the AI-generated summary.

Outcome Measures Immediately after reading each report, participants complete a standardized questionnaire. The primary outcome is the comprehension of the report, measured by the accuracy of the response to the binary question: Is a probable explanation for the headache found in this report? Secondary outcomes include participant satisfaction measured on a Likert scale, perceived need for professional clarification, perceived ability to explain results to a relative, and projected anxiety levels.

Statistical Analysis The primary analysis will compare the proportion of correct responses between groups using a mixed logistic regression model. This model will include the intervention group as a fixed effect and account for crossed random effects (participant and report) to manage intra-individual correlation and variability between clinical cases. The sample size is calculated to be 412 participants (206 per group) to detect a 10% difference in understanding with 95% power.

Conditions

Headache

Keywords

headache; LLM; Large Language Model; MRI; lay summary

Study Design

• Allocation Method: RANDOMIZED
• Intervention Model: PARALLEL
• Primary Study Purpose: OTHER
• Blinding Strategy: SINGLE

Study Groups

Original MRI reports

Group Type: NO_INTERVENTION

No interventions assigned to this group

LLM-generated summaries in addition to the original reports

Group Type: EXPERIMENTAL

LLM-generated lay summary

Intervention Type: OTHER

Participants assigned to this group read fictional brain MRI reports that include an additional summary paragraph generated by an artificial intelligence tool. Specifically, an open-weights Large Language Model (LLM) with fewer than 100 billion parameters is used, hosted locally on a secure server to ensure data privacy. This model generates a short synthesis designed to be clear and structured for non-medical readers. This summary is inserted into the report under the heading Synthesis intended for the patient and non-radiologist physician. The intervention consists solely of this added text; the standard medical content of the report remains unchanged.

Interventions

LLM-generated lay summary

Participants assigned to this group read fictional brain MRI reports that include an additional summary paragraph generated by an artificial intelligence tool. Specifically, an open-weights Large Language Model (LLM) with fewer than 100 billion parameters is used, hosted locally on a secure server to ensure data privacy. This model generates a short synthesis designed to be clear and structured for non-medical readers. This summary is inserted into the report under the heading Synthesis intended for the patient and non-radiologist physician. The intervention consists solely of this added text; the standard medical content of the report remains unchanged.

Intervention Type: OTHER

Eligibility Criteria

Inclusion Criteria

• Participants of the COMPARE e-cohort

Exclusion Criteria

• None

• Minimum Eligible Age: 18 Years
• Eligible Sex: ALL
• Accepts Healthy Volunteers: Yes

Sponsors

Direction Générale de l'offre de Soins (DGOS)

UNKNOWN

Sponsor Role: collaborator

University Hospital, Lille

OTHER

Sponsor Role: lead

Responsible Party

Aghiles.HAMROUN

Head of the Include Health Data Warehouse, Lille university Hospital

Responsibility Role: PRINCIPAL_INVESTIGATOR

Central Contacts

Aghiles Hamroun, MD, PhD

Role: CONTACT

Phone: +33 6 71 21 25 63

Email: aghiles.hamroun@chu-lille.fr

Other Identifiers

2025-3783

Identifier Type: -

Identifier Source: org_study_id