Community Members as Reviewers of Medical Journal Manuscripts

NCT ID: NCT03432143

Last Updated: 2022-09-29

Basic Information

• Recruitment Status: COMPLETED
• Clinical Phase: NA
• Total Enrollment: 568 participants
• Study Classification: INTERVENTIONAL
• Study Start Date: 2018-06-13
• Study Completion Date: 2021-11-30

Brief Summary

Manuscripts submitted to medical journals are typically reviewed by physicians or researchers, with no input from patients or other community members. However, involvement of community members in other phases of the research process suggests that they provide distinct and useful expertise. Such involvement may lead to enhanced understanding of community priorities, refinement of study designs to minimize participant burden, and increased recruitment and retention of subjects.

The investigators propose a randomized controlled trial involving 24 community members who will receive training and mentoring in reviewing manuscripts. A total of 568 manuscripts submitted to 2 medical journals will be randomly assigned to an intervention or control group. Intervention manuscripts will be reviewed by both a community member and by scientific reviewers while control manuscripts will be reviewed only by scientific reviewers. Journal editorial teams will use all reviews to help them make decisions about acceptance, revision, or rejection of manuscripts.

Detailed Description

Manuscripts submitted to medical journals are typically reviewed by physicians or researchers, with no input from patients or other community members. However, involvement of community members in other phases of the research process suggests that they provide distinct and useful expertise. Such involvement may lead to enhanced understanding of community priorities, refinement of study designs to minimize participant burden, and increased recruitment and retention of subjects. In general, community involvement in research is more common in the earlier phases of the research process (selection of research question and development of a study protocol) and less common in later phases (dissemination and implementation of findings). In the investigators' previous work, they conducted a pilot study that recruited and trained community members to review medical journal manuscripts. They found that community reviewers were much more likely than scientific reviewers to comment on i) the relevance of the study to patients and communities, ii) the diversity and complexity of the study participants, iii) the social context of the condition studied, and iv) barriers to implementation of study findings by patients and communities.

The investigators now propose a randomized controlled trial involving 24 community members who will receive training and mentoring in reviewing manuscripts. A total of 568 manuscripts submitted to 2 medical journals will be randomly assigned to an intervention or control group. Intervention manuscripts will be reviewed by both a community member and by scientific reviewers while control manuscripts will be reviewed only by scientific reviewers. Community reviewers will follow each journal's instructions regarding electronic access to manuscripts, use of drop-down menus and free-text boxes to address specific aspects of the review, and completion within the time frame specified by the journal. Journal editorial teams will use all reviews to help them make decisions about acceptance, revision, or rejection of manuscripts. Quantitative and qualitative analyses will i) compare the content of community and scientific reviews, ii) determine the usefulness of community reviews to journal editors, and iii) explore how community reviewer comments are integrated into published articles.

The proposed project is a novel approach to engaging health disparity populations and other community members in dissemination of research findings. This approach has the potential to provide new and distinct perspectives, to increase the quality and relevance of articles published in medical journals, and to enhance dissemination and implementation of research findings.

Primary Aim A. To compare community member reviews with those of scientific reviewers.

Hypothesis: Compared to scientific reviewers, community reviewers will be more likely to comment on relevance to patients and communities, subject diversity, social context, and implementation barriers.

Primary Aim B. To determine the usefulness of community member reviews to editors.

Hypothesis: Editors will report utilizing community reviewer comments in manuscript decisions.

Secondary Aim C. To explore how community reviews are integrated into published articles.

Hypothesis: Community perspectives that were not present in manuscripts at the time of original submission will subsequently be discernible in published articles.

Conditions

Peer Review, Research

Study Design

• Allocation Method: RANDOMIZED
• Intervention Model: PARALLEL
• Primary Study Purpose: OTHER
• Blinding Strategy: NONE

Study Groups

Community Reviewers

24 community members will receive training and mentoring in reviewing manuscripts. Approximately 284 manuscripts will be randomized into the intervention group over the duration of the study. Manuscripts will be reviewed by both a community member and scientific reviewers.

Group Type: EXPERIMENTAL

Community Reviewers

Intervention Type: OTHER

Intervention manuscripts will be reviewed by both a trained community member and scientific reviewers. Community reviewers will follow each journal's instructions regarding electronic access to manuscripts, use of drop-down menus and free-text boxes to address specific aspects of the review, and completion within the time frame specified by the journal.The journal editorial team will use all reviews to make decisions about acceptance, revision, or rejection of manuscripts.

Scientific Reviewers Only

Approximately 284 manuscripts will be randomized into the control group over the duration of the study. Manuscripts will be reviewed by multiple scientific reviewers. Community reviewers will not be involved in reviewing these manuscripts.

Group Type: NO_INTERVENTION

No interventions assigned to this group

Interventions

Community Reviewers

Intervention manuscripts will be reviewed by both a trained community member and scientific reviewers. Community reviewers will follow each journal's instructions regarding electronic access to manuscripts, use of drop-down menus and free-text boxes to address specific aspects of the review, and completion within the time frame specified by the journal.The journal editorial team will use all reviews to make decisions about acceptance, revision, or rejection of manuscripts.

Intervention Type: OTHER

Eligibility Criteria

Inclusion Criteria

• 18 years or older
• At least a high school diploma
• Proficient in English speaking, reading, and writing
• Computer access
• Personal experience (having the condition or being a caregiver to someone with the condition) with 1 or more of these conditions: Cancer, diabetes, dementia, heart disease, hypertension, liver disease, lung disease, kidney disease, and stroke

• Full length
• Original research

Exclusion Criteria

• Children under 18 years of age
• Non-high school graduates
• Individuals who work in health care settings
• Individuals who have formal training in health care or scientific research

Manuscript Eligibility:

• Minimum Eligible Age: 18 Years
• Eligible Sex: ALL
• Accepts Healthy Volunteers: Yes

Sponsors

MetroHealth Medical Center

OTHER

Sponsor Role: lead

Responsible Party

Ash Sehgal

Investigator

Responsibility Role: PRINCIPAL_INVESTIGATOR

Principal Investigators

Ashwini Sehgal

Role: PRINCIPAL_INVESTIGATOR

Case Western Reserve University

Locations

MetroHealth Medical Center

Cleveland, Ohio, United States

Countries

United States

References

Israel BA, Schulz AJ, Parker EA, Becker AB. Review of community-based research: assessing partnership approaches to improve public health. Annu Rev Public Health. 1998;19:173-202. doi: 10.1146/annurev.publhealth.19.1.173.

Reference Type: BACKGROUND

PMID: 9611617 (View on PubMed)

Minkler M. Community-based research partnerships: challenges and opportunities. J Urban Health. 2005 Jun;82(2 Suppl 2):ii3-12. doi: 10.1093/jurban/jti034. Epub 2005 May 11.

Reference Type: BACKGROUND

PMID: 15888635 (View on PubMed)

Caron-Flinterman JF, Broerse JE, Teerling J, Bunders JF. Patients' priorities concerning health research: the case of asthma and COPD research in the Netherlands. Health Expect. 2005 Sep;8(3):253-63. doi: 10.1111/j.1369-7625.2005.00337.x.

Reference Type: BACKGROUND

PMID: 16098155 (View on PubMed)

Hewlett S, Wit Md, Richards P, Quest E, Hughes R, Heiberg T, Kirwan J. Patients and professionals as research partners: challenges, practicalities, and benefits. Arthritis Rheum. 2006 Aug 15;55(4):676-80. doi: 10.1002/art.22091. No abstract available.

Reference Type: BACKGROUND

PMID: 16874772 (View on PubMed)

Resnik DB, Kennedy CE. Balancing scientific and community interests in community-based participatory research. Account Res. 2010 Jul;17(4):198-210. doi: 10.1080/08989621.2010.493095.

Reference Type: BACKGROUND

PMID: 20597018 (View on PubMed)

Wallerstein NB, Duran B. Using community-based participatory research to address health disparities. Health Promot Pract. 2006 Jul;7(3):312-23. doi: 10.1177/1524839906289376. Epub 2006 Jun 7.

Reference Type: BACKGROUND

PMID: 16760238 (View on PubMed)

Fleurence RL, Forsythe LP, Lauer M, Rotter J, Ioannidis JP, Beal A, Frank L, Selby JV. Engaging patients and stakeholders in research proposal review: the patient-centered outcomes research institute. Ann Intern Med. 2014 Jul 15;161(2):122-30. doi: 10.7326/M13-2412.

Reference Type: BACKGROUND

PMID: 25023251 (View on PubMed)

Domecq JP, Prutsky G, Elraiyah T, Wang Z, Nabhan M, Shippee N, Brito JP, Boehmer K, Hasan R, Firwana B, Erwin P, Eton D, Sloan J, Montori V, Asi N, Dabrh AM, Murad MH. Patient engagement in research: a systematic review. BMC Health Serv Res. 2014 Feb 26;14:89. doi: 10.1186/1472-6963-14-89.

Reference Type: BACKGROUND

PMID: 24568690 (View on PubMed)

Forsythe LP, Frank L, Walker KO, Anise A, Wegener N, Weisman H, Hunt G, Beal A. Patient and clinician views on comparative effectiveness research and engagement in research. J Comp Eff Res. 2015 Jan;4(1):11-25. doi: 10.2217/cer.14.52.

Reference Type: BACKGROUND

PMID: 25565066 (View on PubMed)

Reich SM, Reich JA. Cultural competence in interdisciplinary collaborations: a method for respecting diversity in research partnerships. Am J Community Psychol. 2006 Sep;38(1-2):51-62. doi: 10.1007/s10464-006-9064-1.

Reference Type: BACKGROUND

PMID: 16807789 (View on PubMed)

Supple D, Roberts A, Hudson V, Masefield S, Fitch N, Rahmen M, Flood B, de Boer W, Powell P, Wagers S; U-BIOPRED PIP group. From tokenism to meaningful engagement: best practices in patient involvement in an EU project. Res Involv Engagem. 2015 Jun 25;1:5. doi: 10.1186/s40900-015-0004-9. eCollection 2015.

Reference Type: BACKGROUND

PMID: 29062494 (View on PubMed)

Barber R, Boote JD, Parry GD, Cooper CL, Yeeles P, Cook S. Can the impact of public involvement on research be evaluated? A mixed methods study. Health Expect. 2012 Sep;15(3):229-41. doi: 10.1111/j.1369-7625.2010.00660.x. Epub 2011 Feb 17.

Reference Type: BACKGROUND

PMID: 21324054 (View on PubMed)

Staley K. 'Is it worth doing?' Measuring the impact of patient and public involvement in research. Res Involv Engagem. 2015 Jul 31;1:6. doi: 10.1186/s40900-015-0008-5. eCollection 2015.

Reference Type: BACKGROUND

PMID: 29062495 (View on PubMed)

Wright D, Foster C, Amir Z, Elliott J, Wilson R. Critical appraisal guidelines for assessing the quality and impact of user involvement in research. Health Expect. 2010 Dec;13(4):359-68. doi: 10.1111/j.1369-7625.2010.00607.x.

Reference Type: BACKGROUND

PMID: 20629767 (View on PubMed)

Frank L, Forsythe L, Ellis L, Schrandt S, Sheridan S, Gerson J, Konopka K, Daugherty S. Conceptual and practical foundations of patient engagement in research at the patient-centered outcomes research institute. Qual Life Res. 2015 May;24(5):1033-41. doi: 10.1007/s11136-014-0893-3. Epub 2015 Jan 6.

Reference Type: BACKGROUND

PMID: 25560774 (View on PubMed)

Huml AM, Albert JM, Beltran JM, Berg KA, Collins CC, Hood EN, Nelson LC, Perzynski AT, Stange KC, Sehgal AR. Community Members as Reviewers of Medical Journal Manuscripts: a Randomized Controlled Trial. J Gen Intern Med. 2023 May;38(6):1393-1401. doi: 10.1007/s11606-022-07802-z. Epub 2022 Sep 26.

Reference Type: DERIVED

PMID: 36163530 (View on PubMed)

Other Identifiers

IRB17-00374

Identifier Type: -

Identifier Source: org_study_id