Proximal Femur Image Database Validation

NCT ID: NCT06351943

Last Updated: 2024-04-08

Study Results

Results pending

The study team has not published outcome measurements, participant flow, or safety data for this trial yet. Check back later for updates.

Basic Information

Get a concise snapshot of the trial, including recruitment status, study phase, enrollment targets, and key timeline milestones.

Recruitment Status

ACTIVE_NOT_RECRUITING

Total Enrollment

2932 participants

Study Classification

OBSERVATIONAL

Study Start Date

2021-05-01

Study Completion Date

2025-06-30

Brief Summary

Review the sponsor-provided synopsis that highlights what the study is about and why it is being conducted.

The AO@AI Turin project is a collaborative project with a Turin group and the AO (Arbeitsgemeinschaft für Osteosynthesefragen, or in English, Association for the Study of Internal Fixation) foundation. An Image database (DB) has been built to host AP pelvic radiographs ready for artificial intelligence (AI) development.

The goal of this project is to determine the agreement between the Turin annotation of fracture status and the annotation from an external group of AO expert surgeons for a random subset of the Turin images.

Detailed Description

Dive into the extended narrative that explains the scientific background, objectives, and procedures in greater depth.

The AO@AI Turin project is a collaborative project with a Turin group who has collected 2,932 anteroposterior (AP) pelvic radiographs, of which 1,811 are fracture images, and 1,121 are non-fracture images. The Turin group has developed an artificial intelligence (AI) algorithm for fracture classification using these images. These anonymized images (with all metadata or personal identifiers removed) have been uploaded to a cloud-based image database (DB) hosted and managed by the AO Foundation.

The Turin group has established the "ground truth" using the methods of "consensus by experts". Two radiologists from their medical team have reviewed and classified the fracture status (fracture vs non-fracture, and, if fracture, the AO/Orthopedic Trauma Association \[OTA\] classification).

The next step's goal is the ground truth validation plan to test the accuracy of the Turin annotation of fracture classification of the already uploaded AP pelvic images. This is to ensure that the image DB offers accurate quality annotations to allow AI development.

For the pilot phase, a random subset of the Turin images (300 of images) will be drawn from the image DB. These images will be reviewed by an external group of AO expert surgeons who will annotate the images per their fracture status, i.e., fracture vs non-fracture, and, if fracture, the AO/OTA classification.

The group of AO expert surgeons consists of four surgeons who will independently review the 300 images and a fifth surgeon who serves as an adjudicator if necessary. The expert surgeons will be given access to the 300 images via the cloud-based image DB and annotate the images. The expert surgeons will be blinded to the Turin annotations. The expert surgeons' annotations will be entered into a DB built for the purpose for the pilot study.

To determine the ground truth, the annotations of the four surgeons will be compared, and discrepancies will be identified. A meeting will then be arranged among the surgeons to resolve, by consensus, the discrepancies, with the potential involvement of the fifth surgeon as the adjudicator. After the resolution meeting, there will be a single set of annotations for the 300 images from the exert surgeon group.

The Turin annotations will also be entered into the study DB to allow comparisons with the expert surgeon group's annotation.

In case of disagreement between the Turin annotation and the AO expert surgeon annotations, a consensus will be sought to establish a new ground truth. If this process results in significant revisions to the annotations, the entire dataset will be reviewed to set this new standard. Following such a comprehensive dataset revision, the algorithm for automated fracture classification of the proximal femur, which has already been developed by the Turin group, will be re-trained. After re-training, the algorithm's performance will be evaluated through metrics such as precision, recall, and F1-score to ensure its accuracy and effectiveness in classifying proximal femur fractures.

Conditions

See the medical conditions and disease areas that this research is targeting or investigating.

Proximal Femoral Fracture

Study Design

Understand how the trial is structured, including allocation methods, masking strategies, primary purpose, and other design elements.

Observational Model Type

OTHER

Study Time Perspective

CROSS_SECTIONAL

Interventions

Learn about the drugs, procedures, or behavioral strategies being tested and how they are applied within this trial.

Fracture classification annotations provided by the Turin group

Fracture classification annotations provided by the Turin group: fracture vs non-fracture, and, if fracture, the Arbeitsgemeinschaft für Osteosynthesefragen (AO, in English, Association for the Study of Internal Fixation)/Orthopedic Trauma Association (OTA) classification.

Intervention Type DIAGNOSTIC_TEST

Fracture classification annotations provided by the AO expert surgeon group

Fracture classification annotations provided by the AO expert surgeon group: fracture vs non-fracture, and, if fracture, the AO/OTA classification.

Intervention Type DIAGNOSTIC_TEST

Eligibility Criteria

Check the participation requirements, including inclusion and exclusion rules, age limits, and whether healthy volunteers are accepted.

Inclusion Criteria

* Not applicable.
* The study utilizes the anonymized images in the Image database (DB). No patients will be enrolled for purposes of this study.

Exclusion Criteria

• Not applicable.
Eligible Sex

ALL

Accepts Healthy Volunteers

No

Sponsors

Meet the organizations funding or collaborating on the study and learn about their roles.

University of Turin, Italy

OTHER

Sponsor Role collaborator

AO Innovation Translation Center

OTHER

Sponsor Role lead

Responsible Party

Identify the individual or organization who holds primary responsibility for the study information submitted to regulators.

Responsibility Role SPONSOR

Principal Investigators

Learn about the lead researchers overseeing the trial and their institutional affiliations.

Alessandro Aprato, MD

Role: PRINCIPAL_INVESTIGATOR

University of Turin, Italy

Locations

Explore where the study is taking place and check the recruitment status at each participating site.

AO Foundation

Dübendorf, , Switzerland

Site Status

Countries

Review the countries where the study has at least one active or historical site.

Switzerland

References

Explore related publications, articles, or registry entries linked to this study.

Tanzi L, Vezzetti E, Moreno R, Aprato A, Audisio A, Masse A. Hierarchical fracture classification of proximal femur X-Ray images using a multistage Deep Learning approach. Eur J Radiol. 2020 Dec;133:109373. doi: 10.1016/j.ejrad.2020.109373. Epub 2020 Oct 23.

Reference Type RESULT
PMID: 33126175 (View on PubMed)

Audige L, Bhandari M, Hanson B, Kellam J. A concept for the validation of fracture classifications. J Orthop Trauma. 2005 Jul;19(6):401-6. doi: 10.1097/01.bot.0000155310.04886.37.

Reference Type RESULT
PMID: 16003200 (View on PubMed)

Langerhuizen DWG, Janssen SJ, Mallee WH, van den Bekerom MPJ, Ring D, Kerkhoffs GMMJ, Jaarsma RL, Doornberg JN. What Are the Applications and Limitations of Artificial Intelligence for Fracture Detection and Classification in Orthopaedic Trauma Imaging? A Systematic Review. Clin Orthop Relat Res. 2019 Nov;477(11):2482-2491. doi: 10.1097/CORR.0000000000000848.

Reference Type RESULT
PMID: 31283727 (View on PubMed)

Meinberg EG, Agel J, Roberts CS, Karam MD, Kellam JF. Fracture and Dislocation Classification Compendium-2018. J Orthop Trauma. 2018 Jan;32 Suppl 1:S1-S170. doi: 10.1097/BOT.0000000000001063. No abstract available.

Reference Type RESULT
PMID: 29256945 (View on PubMed)

Other Identifiers

Review additional registry numbers or institutional identifiers associated with this trial.

ImageDB pilot

Identifier Type: -

Identifier Source: org_study_id

More Related Trials

Additional clinical trials that may be relevant based on similarity analysis.

FDG-PET Imaging in Painful Joint Prosthesis
NCT00194285 ACTIVE_NOT_RECRUITING
Image Guided System for Orthopaedic Surgery
NCT00022802 TERMINATED PHASE2