Machine Learning to Analyze Facial Imaging, Voice and Spoken Language for the Capture and Classification of Cancer/Tumor Pain

NCT ID: NCT04442425

Last Updated: 2025-12-26

Study Results

Results pending

The study team has not published outcome measurements, participant flow, or safety data for this trial yet. Check back later for updates.

Basic Information

Get a concise snapshot of the trial, including recruitment status, study phase, enrollment targets, and key timeline milestones.

Recruitment Status

COMPLETED

Total Enrollment

83 participants

Study Classification

OBSERVATIONAL

Study Start Date

2020-10-27

Study Completion Date

2024-03-27

Brief Summary

Review the sponsor-provided synopsis that highlights what the study is about and why it is being conducted.

Background:

Cancer pain can have a very negative effect on people s daily lives. Researchers want to use machine learning to detect facial expressions and voice signals. They want to help people with cancer by creating a model to measure pain. They want the model to reflect diverse faces and facial expressions.

Objective:

To find out whether facial recognition technology can be used to classify pain in a diverse set of people with cancer. Also, to find out whether voice recognition technology can be used to assess pain.

Eligibility:

People ages 12 and older who are undergoing treatment for cancer

Design:

Participants will be screened with:

Cancer history

Information about their sex and skin type

Information about their access to a smart phone and wireless internet

Questions about their cancer pain

Participants will have check-ins at the clinic and at home. These will occur over about 3 months. They will have 2-4 check-ins at the clinic. They will check in at home about 3 times per week.

During check-ins, participants will answer questions and talk about their cancer pain. They will use a mobile phone or a computer with a camera and microphone to complete a questionnaire. They will record a video of themselves reading a 15-second passage of text and responding to a question.

During the clinic check-ins, professional lighting, video equipment, and cameras will be used for the recordings.

During remote check-ins, participants will be asked to complete the questionnaire and recordings alone. They should be in a quiet and bright room. The room should have a white wall or background.

...

Detailed Description

Dive into the extended narrative that explains the scientific background, objectives, and procedures in greater depth.

Background:

* Pain related to cancer/tumors can be widespread, wield debilitating effects on daily life, and interfere with otherwise positive outcomes from targeted treatment.
* The underpinnings of this study are chiefly motivated by the need to develop and validate objective methods for measuring pain using a model that is relevant in breadth and depth to a diversity of patient populations.
* Inadequate assessment and management of cancer/tumor pain can lead to functional and psychological deterioration and negatively impact quality of life.
* Research of objective measurement scales of pain based on automated detection of facial expression using machine learning is expanding but has been limited to certain demographic cohorts.
* Machine learning models demonstrate poor performance when training sets lack adequate diversity of training data, including visibly different faces and facial expressions, which yields opportunity in the proposed study to lay a guiding foundation by constructing a more general and generalizable model based on faces of varying sex and skin phototypes.

Objectives:

-The primary objective of this study is to determine the feasibility of using facial recognition technology to classify cancer/tumor related pain in a demographically diverse set of participants with cancer/tumors who are receiving standard of care or investigational treatment for their cancer/tumor.

Eligibility:

* Adults and children (12 years of age or older) with a diagnosis of a cancer or tumor who are receiving standard of care or investigational treatment for their underlying cancer/tumor.
* Participant must have access to internet connected smart phone or computer with camera and microphone and must be willing to pay any charges from service provider/carrier associated with the use of the device.

Design:

* The design is a single institution, observational, non-intervention clinical study at the National Institutes of Health Clinical Center.
* All participants will participate in the same activities in two different settings (remotely and in-clinic) for a three-month period.
* At home, participants will utilize a mobile application for self-reporting of pain and will audio- visually record themselves reading a passage of text and describing how they feel. In the clinic, participants will perform the same activities with optimal lighting and videography, along with infrared video capture.
* Visual (RGB) and infrared facial images, audio signal, self-reported pain and natural language verbalizations of participant feelings feel will be captured. Audio signal and video data will be annotated with self-reported pain and clinical data to create a supervised machine learning model that will learn to automatically detect pain.
* Care will be taken with the study sample to include a diversity of genders and skin types (a proxy for racial diversity) to establish a broad applicability of the model in the clinical setting. Additionally, video recordings of participant natural language to describe their pain and how they feel will be transcribed and auto-processed against the Patient-Reported Outcomes version of the Common Terminology Criteria for Adverse Events (PROCTCAE) library to explore the presence and progression of self-reporting of adverse events.

Conditions

See the medical conditions and disease areas that this research is targeting or investigating.

Cancer Neoplasms Solid Tumors

Keywords

Explore important study keywords that can help with search, categorization, and topic discovery.

Telehealth Self-Reported Pain Facial Recognition Technology Pain Score Natural History

Study Design

Understand how the trial is structured, including allocation methods, masking strategies, primary purpose, and other design elements.

Observational Model Type

COHORT

Study Time Perspective

PROSPECTIVE

Study Groups

Review each arm or cohort in the study, along with the interventions and objectives associated with them.

1DF/NoPain_IV-VI_Female

Worst pain in past month = 0; Skin Type IV-VI, Female

No interventions assigned to this group

1DM/NoPain_IV-VI_Male

Worst pain in past month = 0; Skin Type IV-VI, Male

No interventions assigned to this group

1LF/NoPain_I-III_Female

Worst pain in past month = 0; Skin Type I-III, Female

No interventions assigned to this group

1LM/NoPain_I-III_Male

Worst pain in past month = 0; Skin Type I-III, Male

No interventions assigned to this group

2DF/MildPain_IV-VI_Female

Worst pain in past month = 1-3; Skin Type IV-VI, Female

No interventions assigned to this group

2DM/MildPain_IV-VI_Male

Worst pain in past month = 1-3; Skin Type IV-VI, Male

No interventions assigned to this group

2LF/MildPain_I-III_Female

Worst pain in past month = 1-3; Skin Type I-III, Female

No interventions assigned to this group

2LM/MildPain_I-III_Male

Worst pain in past month = 1-3; Skin Type I-III, Male

No interventions assigned to this group

3DF/ModPain_IV-VI_Female

Worst pain in past month = 4-6; Skin Type IV-VI, Female

No interventions assigned to this group

3DM/ModPain_IV-VI_Male

Worst pain in past month = 4-6; Skin Type IV-VI, Male

No interventions assigned to this group

3LF/ModPain_I-III_Female

Worst pain in past month = 4-6; Skin Type I-III, Female

No interventions assigned to this group

3LM/ModPain_I-III_Male

Worst pain in past month = 4-6; Skin Type I-III, Male

No interventions assigned to this group

4DF/SeverePain_IV-VI_Female

Worst pain in past month = 7-10; Skin Type IV-VI, Female

No interventions assigned to this group

4DM/SeverePain_IV-VI_Male

Worst pain in past month = 7-10; Skin Type IV-VI, Male

No interventions assigned to this group

4LF/SeverePain_I-III_Female

Worst pain in past month = 7-10; Skin Type I-III, Female

No interventions assigned to this group

4LM/SeverePain_I-III_Male

Worst pain in past month = 7-10; Skin Type I-III, Male

No interventions assigned to this group

Eligibility Criteria

Check the participation requirements, including inclusion and exclusion rules, age limits, and whether healthy volunteers are accepted.

Inclusion Criteria

1. Ability of subject to understand and willingness to sign a written informed consent document.
2. Adults and children (including NIH staff) aged \>= 12 years.
3. Participants with diagnosis of a cancer or tumor
4. Participant must be receiving either standard of care or investigational cancer/tumor treatment either at NIH or with a community physician.
5. Must have access to a smart phone (iPhone or Android) with either a data plan and/or access to wireless internet (wifi) or a computer with a camera and microphone and access to internet and must willing to use their device and assume any associated charges from

service providers.

Exclusion Criteria

1. Participants with progressive brain tumors or metastasis. Participants with treated brain metastasis or primary brain tumor are eligible if there is no evidence of progression for at least 4 weeks after CNS directed treatment and there is no impact on voice or facial muscle movements.
2. Participants with Parkinson s disease.
3. Known current alcohol or drug abuse.
4. Any psychiatric condition that would prohibit the understanding or rendering of informed consent.
5. Non-English speaking subjects.
Minimum Eligible Age

12 Years

Maximum Eligible Age

120 Years

Eligible Sex

ALL

Accepts Healthy Volunteers

No

Sponsors

Meet the organizations funding or collaborating on the study and learn about their roles.

National Cancer Institute (NCI)

NIH

Sponsor Role lead

Responsible Party

Identify the individual or organization who holds primary responsibility for the study information submitted to regulators.

Responsibility Role SPONSOR

Principal Investigators

Learn about the lead researchers overseeing the trial and their institutional affiliations.

James L Gulley, M.D.

Role: PRINCIPAL_INVESTIGATOR

National Cancer Institute (NCI)

Locations

Explore where the study is taking place and check the recruitment status at each participating site.

National Institutes of Health Clinical Center

Bethesda, Maryland, United States

Site Status

Countries

Review the countries where the study has at least one active or historical site.

United States

Related Links

Access external resources that provide additional context or updates about the study.

Other Identifiers

Review additional registry numbers or institutional identifiers associated with this trial.

200130

Identifier Type: -

Identifier Source: org_study_id

20-C-0130

Identifier Type: -

Identifier Source: secondary_id