Assessing Intensive Care Unit (ICU) Indications: Human vs. ChatGPT-4o Predictions

NCT ID: NCT06726733

Last Updated: 2024-12-10

Basic Information

• Recruitment Status: NOT_YET_RECRUITING
• Total Enrollment: 500 participants
• Study Classification: OBSERVATIONAL
• Study Start Date: 2024-12-28
• Study Completion Date: 2025-02-28

Brief Summary

This retrospective study evaluates the accuracy of ICU admission indications by comparing clinical decisions with predictions from ChatGPT-4. Patient data, including demographics, vital signs, laboratory results, imaging findings, and clinical decisions, will be retrospectively collected and documented systematically using Case Report Forms. The model will be trained using ICU admission guidelines and tasked to predict ICU needs based on collected patient data. This study aims to systematically assess the alignment between AI-based predictions and clinical decisions for ICU admissions.

Detailed Description

This study has a retrospective design. The medical data of patients admitted to the emergency department and consulted to the anesthesiology and reanimation clinic for ICU indications will be collected retrospectively. Demographic information, vital signs, laboratory results, imaging findings, and clinical decisions of the patients will be recorded. These data will be systematically collected for each patient using an individual Case Report Form.

Inclusion Criteria for the Study:

Patients aged 18 years and older who were consulted to the anesthesiology and reanimation clinic for ICU indications from the emergency department will be included in the study.

Exclusion Criteria for the Study:

Patients consulted to the anesthesiology and reanimation clinic for ICU indications from inpatient services.

Patients consulted to the anesthesiology and reanimation clinic from the emergency department for reasons other than ICU indications.

Patients consulted to the anesthesiology and reanimation clinic for ICU indications from the emergency department but with insufficient recorded data (patients with data loss).

Model Training and Prediction Analysis:

ChatGPT-4 will be trained according to the guidelines in "Yoğun Bakım Hasta Kabul Kriterleri (Rehberleri)" by Çiftçi B, Erdoğan C, and Demiraran Y (5). The collected patient data will be presented to the ChatGPT-4 model to obtain predictions regarding whether the patients require ICU admission. The predictions made by ChatGPT will be compared with clinical decisions, and accuracy rate, false positive rate, and false negative rate will be analyzed.

Statistical Analysis Methods to Be Used in the Study:

Accuracy Rate: The rate at which ChatGPT correctly predicts ICU indications will be calculated.

False Positive Rate: The rate at which ChatGPT predicts ICU need for patients who do not require ICU admission will be evaluated.

False Negative Rate: The rate at which ChatGPT predicts no ICU need for patients who require ICU admission will be analyzed.

Kappa Statistics: The agreement between ChatGPT predictions and clinical decisions will be measured.

ROC Curve and AUC: The performance of ChatGPT will be evaluated using the ROC curve and AUC.

The Case Report Form used for each patient ensures detailed and systematic data collection of clinical information, aiming to meaningfully compare the alignment of ChatGPT's predictions with clinical decisions.

Conditions

Intensive Care Unit (ICU) Admission; Emergency Department Patient; Artificial Intelligence (AI); Clinical Decision-making

Keywords

AI; Intensive Care Unit; Clinical decision-making; Artificial Intelligenc

Study Design

• Observational Model Type: CASE_CONTROL
• Study Time Perspective: RETROSPECTIVE

Eligibility Criteria

Inclusion Criteria

• Patients aged 18 years and older who are consulted to the anesthesiology and reanimation clinic for ICU indications from the emergency department will be included in the study.

Exclusion Criteria

• Patients consulted to the anesthesiology and reanimation clinic for ICU indications from inpatient services.
• Patients consulted to the anesthesiology and reanimation clinic from the emergency department for reasons other than ICU indications.
• Patients consulted to the anesthesiology and reanimation clinic for ICU indications from the emergency department but with insufficient recorded data (patients with data loss)

• Minimum Eligible Age: 18 Years
• Eligible Sex: ALL
• Accepts Healthy Volunteers: No

Sponsors

Bursa Yuksek Ihtisas Training and Research Hospital

OTHER_GOV

Sponsor Role: lead

Responsible Party

Aycan KURTARANGİL DOĞAN

Doctor of anesthesiology and reanimation

Responsibility Role: PRINCIPAL_INVESTIGATOR

Principal Investigators

İlkay Ceylan

Role: PRINCIPAL_INVESTIGATOR

ceylanilkay@yahoo.com

Locations

Bursa Yuksek Ihtisas Training and Research Hospital

Bursa, , Turkey (Türkiye)

Countries

Turkey (Türkiye)

Central Contacts

İlkay Ceylan

Role: CONTACT

Phone: +902243664434

Email: ceylanilkay@yahoo.com

Aycan Kurtarangil Doğan

Role: CONTACT

Phone: +902243664434

Email: akurtarangil@gmail.com

Other Identifiers

BYIEAH-INKA

Identifier Type: -

Identifier Source: org_study_id