Risk Model for Metastasis Detection of Neuroblastoma

NCT ID: NCT06703944

Last Updated: 2025-05-15

Basic Information

• Recruitment Status: ENROLLING_BY_INVITATION
• Total Enrollment: 500 participants
• Study Classification: OBSERVATIONAL
• Study Start Date: 2024-12-01
• Study Completion Date: 2026-12-01

Brief Summary

Neuroblastoma (NB) is the most common extracranial solid tumor in children, accounting for about 15% of tumor-related mortality. NB patients in high-risk group are prone to bone marrow and/or bone metastases with low five-year overall survival rate. The artificial intelligence (AI) and deep learning technologies have potential to identifying morphological characteristics of bone marrow cytology in clinical practice. In this study, the investigators construct and evaluate the bone marrow cytology-based AI model for detection and prognosis of NB. The main questions of the study as follows:

The question 1: Dose bone marrow cytology-based AI model work for prediction of bone marrow metastasis in NB? The question 2: Dose bone marrow cytology-based AI model work for prediction of bone metastasis in NB? The question 3: Dose bone marrow cytology-based AI model have potential to assist doctors in making individualized predictions of survival outcome? The investigators will retrospectively obtain the participants with NB between January 2019 and June 2024. The follow-up date ended on June 30, 2024.

The internal cohort including participants from Xinhua Hospital, Shanghai Jiao Tong University School of Medicine. The independent external cohorts including participants form Children's Hospital, Zhejiang University School of Medicine and Shenzhen Children's Hospital.

The investigators collect the clinical data of enrolled participants at the time of the patients' initial admission to the hospital, prior to receiving treatment. The clinical information including age, gender, primary tumor location, tumor grade, bone marrow metastasis state, bone metastasis state, genetic aberrations (MYCN amplification, Chromosome 1p deletion, Chromosome 11q deletion) and lab variables (peripheral blood cell count, bone marrow cytology indicators, the serum concentration of lactate dehydrogenase, neuron specific enolase).

This study is a non-interventional observational study, there is no risk to the participants and investigators. Participants get these benefits:

1. Early Detection: The model helps in early risk identification and personalize treatment.

2. Convenience: Because the model relies on general lab tests, it is easy to carry out can reduce invasive diagnostic procedures.

3. Cost-Effective: Using existing clinical data from routine tests can make the prediction process more cost-effective.

4. Data-Driven Decisions: The AI model improve diagnostic efficiency and support the medical decision.

Detailed Description

1. Dataset processing. In this study, the model including training set, validation set and test sets. During the model construction, the investigators process the training in internal cohort by randomly assign the enrolled participants to the training set and validation set in a 8:2 ratio. The investigators use the enrolled participants of external cohorts as test sets to evaluate the model performance independently, and then select the best model for future use.

The Ethics Committee of Xinhua Hospital Affiliated to Shanghai Jiaotong University School of Medicine apaproved this study (XHEC-C-2024-023-2).

2. image acquisition. In the AI model, the investigators use bone marrow smears of enrolled participants for cytological evaluation and image collection. During cell classification and metastasis detection, the experienced pathologists complete the bone marrow smear analysis, metastatic NB clusters in bone marrow usually exhibited aggregated round atypical cells with high nucleus/cytoplasmic ratio. The investigators scan stained bone marrow smear at 40 × magnification for digital whole slide imaging (WSI). The investigators segment WSIs into smaller patches as 512 × 512 pixels tiles and apply the Vahadane method to normalize the color of small tiles.

3. Deep learning training. In the feature extraction of bone marrow cytological image, the process including two tiers of predictions: patch-level and WSI-level predictions.

For patch-level predictions, the investigators carry out label predictions and their respective probabilities for all patches. The investigators apply model in the deep learning process as follows: recognized neural network (CNN)-resnet50 and Vision Transformer (ViT). The parameter configurations in the model as follows: optimizer-SGD, loss function-softmax cross-entropy, with a batch size of 64.

For WSI-level predictions, the investigators use a multi-instance learning (MIL) algorithm to aggregate dispersed patch-level features to WSI-level features. During MIL for WSI fusion, the investigators perform WSI-level predictions with Patch Likelihood Histogram (PLH) pipeline and Bag of Words (BoW) pipeline in combination. Subsequently, the investigators get the WSI-level prediction as final representations of participant for subsequent analytical operations.

4. Signature building. In the procession of feature selection, the investigators use LASSO (Least Absolute Shrinkage and Selection Operator) feature screening to determine the final WSI-level features of the bone marrow cytology. These selected features were then subjected to machine learning methods to develop AI model. the investigators apply several machine learning algorithms to predict metastasis state of bone marrow and/or bone in participants, such as support vector machines (SVM), Logistic regression (LR), tree-based models, such as random forests and extremely randomized trees (ExtraTrees), extreme Gradient Boosting (XGBoost), and light gradient boosting machine (LightGBM), as well as multilayer perceptron (MLP) to develop our models.

In the prognosis model, the investigators e use Cox models to construct the survival model with bone marrow cytological signature and clinical characters.

5. Model evaluation and statistical analysis. The investigators compare the clinical characteristics of participant with independent sample t-test for continuous variables and the χ² test for discrete variables in SPSS version 22.0 (SPSS, Inc., Chicago, IL, USA). P ≤ 0.05 was considered statistically significant.

For the diagnostic model, the investigators use both micro and macro area under the curve (AUC) metrics to evaluate the model in terms of sensitivity, specificity, accuracy, positive predictive value and negative predictive value at different classification thresholds. The model's performance and effectiveness were evaluated on separate test cohort. The study employs custom Python code written in Python v.3.7.12 to evaluate the model performance.

For the prognostic model, the investigators use AUC as the performance metric and calculating sensitivity and specificity. The model with the best performance on the test set was selected as the optimal model. Survival curves were constructed according to the Kaplan-Meier method.

Conditions

Neuroblastoma (NB); Prognosis; Bone Marrow Metastasis; Bone Metastases

Study Design

• Observational Model Type: COHORT
• Study Time Perspective: RETROSPECTIVE

Study Groups

Neuroblastoma With Bone Marrow Metastasis Group

For the diagnosis of neuroblastoma with bone marrow metastasis, the medical practices including as follows: bone marrow biopsy, bone marrow cytology of aspiration smear, flow cytometry and positron emission tomography-computed tomography(PET-CT). Bone marrow biopsy or smear analysis may reveal characteristic NB cells. Flow cytometry may detect NB cells with phenotype of cluster of differentiation antigen 45(CD45)-/cluster of differentiation antigen 56(CD56)+/cluster of differentiation antigen 81(CD81)+/GD2 ganglioside (GD2)+. PET/CT imaging reveal the metastatic NB cells in term of metabolic activity and spatial distribution of metastatic involvement. A positive result from any of these methods is sufficient for diagnosed as NB with bone marrow metastasis.

risk model in diagnosis and prognosis

Intervention Type: OTHER

In this study, we construct and evaluate the bone marrow cytology-based AI model for detection and prognosis of NB.

1. For the diagnostic model, we use AUC metrics to evaluate the model in terms of sensitivity, specificity, accuracy, positive predictive value and negative predictive value at different classification thresholds.

2. For the prognostic model, we use AUC as the performance metric and calculating sensitivity and specificity. Survival curves were constructed according to the Kaplan-Meier method.

Neuroblastoma Without Bone Marrow Metastasis Group

For the diagnosis of bone marrow metastasis in the enrolled participants, if there is no positive result from any of these tests as follows: bone marrow biopsy, bone marrow cytology of smear, flow cytometry or PET/CT, the participant is classified into the Neuroblastoma Without Bone Marrow Metastasis Group.

No interventions assigned to this group

Interventions

risk model in diagnosis and prognosis

In this study, we construct and evaluate the bone marrow cytology-based AI model for detection and prognosis of NB.

1. For the diagnostic model, we use AUC metrics to evaluate the model in terms of sensitivity, specificity, accuracy, positive predictive value and negative predictive value at different classification thresholds.

2. For the prognostic model, we use AUC as the performance metric and calculating sensitivity and specificity. Survival curves were constructed according to the Kaplan-Meier method.

Intervention Type: OTHER

Eligibility Criteria

Inclusion Criteria

1. The participant newly diagnosed with NB according to the International Neuroblastoma Risk Group Staging System (INRGSS). The diagnosis completed by experienced pathologist and correlated with clinical and/or radiological findings.

2. The participant diagnosed with NB at other hospitals who have not received chemotherapy or radiotherapy.

3. The participant with NB has performed bone marrow smear analysis as routine examination. The bone marrow smear stained with Wright-Giemsa was made according to standard protocols.

Exclusion Criteria

1. The participant with concurrent diagnosis of other malignancies.

2. The participant with NB who has previously received chemotherapy and/or radiotherapy.

3. The participant with incomplete clinical data, the metastasis state of bone marrow and/or bone is unclear.

4. The participant was excluded due to non-representative specimens, such as unclear or faded Wright-Giemsa staining of bone marrow smear.

• Eligible Sex: ALL
• Accepts Healthy Volunteers: No

Sponsors

Shenzhen Children's Hospital

OTHER_GOV

Sponsor Role: collaborator

The Children's Hospital of Zhejiang University School of Medicine

OTHER

Sponsor Role: collaborator

Xinhua Hospital, Shanghai Jiao Tong University School of Medicine

OTHER

Sponsor Role: lead

Responsible Party

Juan Ma

Associate Chief Physician of the Clinical Laboratory Department

Responsibility Role: PRINCIPAL_INVESTIGATOR

Principal Investigators

juan ma, Doctor

Role: PRINCIPAL_INVESTIGATOR

Xin Hua Hospital, Shanghai Jiao Tong University School of Medicine

Locations

Xinhua Hospital Affiliated to Shanghai Jiaotong University School of Medicine

Shanghai, Shanghai Municipality, China

The Children's Hospital, Zhejiang University School of Medicine

Hangzhou, Zhejiang, China

Shenzhen Children's Hospital

Shenzhen, , China

Countries

China

Other Identifiers

XH-24-008

Identifier Type: -

Identifier Source: org_study_id