Evaluation of ChatGPT-4's Success Sonoanatomy

NCT ID: NCT06642389

Last Updated: 2025-02-20

Basic Information

• Recruitment Status: COMPLETED
• Total Enrollment: 147 participants
• Study Classification: OBSERVATIONAL
• Study Start Date: 2024-10-17
• Study Completion Date: 2025-02-16

Brief Summary

Aim and Importance:

Regional anesthesia techniques have advanced significantly with the advent of ultrasound guidance. Peripheral nerve blocks and fascial plane blocks can now be performed safely and effectively under ultrasound visualization. Research has shown that ultrasound use significantly improves block success rates. However, accurate application requires in-depth knowledge of sonoanatomy, as failure to identify critical structures may result in incorrect anesthetic placement or failed blocks. While experienced anesthesiologists can easily identify these anatomical landmarks, those less familiar with sonoanatomy may find it challenging.

This study aims to evaluate the effectiveness of ChatGPT-4 in identifying sonoanatomical structures in ultrasound images. A secondary objective is to assess whether artificial intelligence can evaluate the accuracy of regional anesthesia applications.

Expected Benefits and Risks:

The primary benefit is to explore the potential of AI-based systems in improving the learning and application of sonoanatomy, which may help anesthesiologists perform more accurate and successful blocks. We believe that the findings could contribute to regional anesthesia training. The study poses no risks to participants.

Study Type, Scope, and Design:

This prospective, observational study will be conducted at Health Sciences University Istanbul Kanuni Sultan Süleyman Education and Research Hospital. Ultrasound images from patients aged 18 and older undergoing regional anesthesia under ultrasound guidance will be photographed, without collecting personal data. Detailed images of the ultrasound-guided block steps will be captured. The position and orientation of the ultrasound probe will be documented for the AI model.

A customized GPT-4 model will be developed to evaluate the sonoanatomical structures in the provided ultrasound images based on the probe's position and orientation. Additionally, the AI model will predict which block is being performed and assess the success of the block by analyzing the images. An experienced anesthesiologist will evaluate the accuracy of the AI's predictions.

Detailed Description

Background and Rationale:

With the increasing use of ultrasound in regional anesthesia, techniques such as peripheral nerve blocks and fascial plane blocks have become more reliable and safer. Ultrasound guidance has significantly improved the success rate of regional anesthesia, reducing complications by enabling accurate visualization of relevant anatomical structures. However, successful ultrasound-guided blocks require thorough knowledge of sonoanatomy. Without this expertise, there is a risk of improper anesthetic placement, potentially leading to block failure or unintended complications.

Experienced anesthesiologists proficient in sonoanatomy can easily interpret ultrasound images, but those with limited experience often face difficulties. This highlights the need for educational tools that can aid in teaching and improving the identification of anatomical landmarks. The development of AI-based systems, such as ChatGPT-4, for this purpose could revolutionize the training of regional anesthesia techniques by providing real-time feedback on ultrasound images.

Primary Aim:

The primary objective of this study is to evaluate the accuracy and effectiveness of ChatGPT-4 in identifying sonoanatomical landmarks from ultrasound images during regional anesthesia procedures.

Secondary Aim:

A secondary goal is to assess whether the AI model can evaluate the accuracy of block applications by analyzing the ultrasound images and determining the success of the block based on sonoanatomical features and block placement.

Expected Benefits:

The study aims to explore whether AI-based systems can be integrated into educational settings to aid anesthesiologists in mastering sonoanatomy for regional anesthesia. By facilitating the accurate identification of anatomical structures, the AI could potentially enhance the learning curve and improve block success rates. The findings of this study may lead to the development of advanced tools for training and performing ultrasound-guided regional anesthesia, benefiting both novice and experienced anesthesiologists.

Potential Risks:

There are no anticipated risks for participants in this study, as no personal data will be collected, and the study involves only the analysis of ultrasound images.

Study Design:

This is a prospective, observational study that will be conducted at Health Sciences University Istanbul Kanuni Sultan Süleyman Education and Research Hospital. The study will include patients aged 18 years and older who are undergoing surgery and receiving regional anesthesia under ultrasound guidance for analgesia or anesthesia purposes. Consent will be obtained from all patients before participating in the study.

Data Collection:

Only ultrasound images from the procedures will be captured, without collecting any personal or identifiable patient data. Each regional anesthesia block will be documented step-by-step through ultrasound images. These images will include key steps such as probe position, orientation, and the anatomical structures visualized during the procedure. The positioning and orientation of the ultrasound probe during the block will also be recorded.

AI Model Configuration:

A customized GPT-4 model will be developed and trained to analyze the ultrasound images. Based on the probe's position, region of placement, and the anatomical plane, the AI will attempt to identify the sonoanatomical structures present in the ultrasound images. The model will also make predictions regarding the type of regional block being performed.

In addition to identifying anatomical landmarks, the AI model will assess the success of the block by analyzing the final images from each procedure. It will provide a prediction of whether the block was successfully applied based on the anatomical structures and positioning of the needle and anesthetic.

Evaluation of AI Predictions:

The accuracy of the AI's predictions regarding anatomical landmarks and block success will be evaluated by an experienced anesthesiologist with expertise in regional anesthesia. This expert will compare the AI's predictions with their own interpretations of the ultrasound images to assess the AI's performance.

Study Outcome:

The primary outcome will be the accuracy of ChatGPT-4 in identifying sonoanatomical structures in ultrasound images. The secondary outcome will be the accuracy of the AI model in evaluating the success of block applications. These results will be compared to the evaluations of the experienced anesthesiologist to determine the AI model's efficacy.

Conclusion:

This study seeks to explore the potential of artificial intelligence, specifically ChatGPT-4, in aiding the identification of anatomical landmarks during ultrasound-guided regional anesthesia. By evaluating the AI's accuracy, the study aims to contribute to the development of innovative training tools that could enhance the education and practice of regional anesthesia techniques.

Conditions

Regional Anesthesia

Study Design

• Observational Model Type: CASE_ONLY
• Study Time Perspective: PROSPECTIVE

Interventions

Sonoanatomical Structure Identification

ChatGPT-4 will analyze the ultrasound images to identify key anatomical landmarks such as nerves, muscles, blood vessels, and fascial planes that are critical for successful regional anesthesia. These structures will be labeled and compared to the expert anesthesiologist's assessment to determine accuracy.

Intervention Type: OTHER

Block Type Prediction

Based on the ultrasound images and the position of the probe, ChatGPT-4 will predict the type of regional anesthesia block being performed (e.g., supraclavicular block, femoral nerve block). These predictions will be compared to the actual block performed to evaluate the AI's accuracy.

Intervention Type: OTHER

Block Success Assessment

After analyzing the ultrasound images from the block application, ChatGPT-4 will assess whether the block was successfully administered. This assessment will be based on the correct placement of the needle, the spread of the anesthetic, and proximity to target structures. The AI's evaluation of block success will be compared to the expert anesthesiologist's judgment.

Intervention Type: OTHER

Eligibility Criteria

Inclusion Criteria

• Patients aged 18 years or older.
• Patients undergoing surgery.
• Patients receiving any regional anesthesia technique under ultrasound guidance.
• Patients who have signed an informed consent form.

Exclusion Criteria

• Patients under the age of 18.
• Patients without a history of surgery.
• Patients who have not received any regional anesthesia technique under ultrasound guidance.
• Patients who have not signed the required informed consent documents will not be included in the study.

• Minimum Eligible Age: 18 Years
• Eligible Sex: ALL
• Accepts Healthy Volunteers: No

Sponsors

Kanuni Sultan Suleyman Training and Research Hospital

OTHER

Sponsor Role: lead

Responsible Party

Engin Ihsan Turan

anesthesiology and reanimation specialist

Responsibility Role: PRINCIPAL_INVESTIGATOR

Principal Investigators

Engin ihsan Turan, Specialist

Role: PRINCIPAL_INVESTIGATOR

Health Science University İstanbul Kanuni Sultan Süleyman Education and Training Hospital

Locations

Health Science University İstanbul Kanuni Sultan Süleyman Education and Training Hospital

Istanbul, , Turkey (Türkiye)

Countries

Turkey (Türkiye)

Other Identifiers

SONOANATOMY-AI

Identifier Type: -

Identifier Source: org_study_id