Faculty Development to Improve Mini-CEX Ratings

NCT ID: NCT00667940

Last Updated: 2008-04-28

Study Results

Results pending

The study team has not published outcome measurements, participant flow, or safety data for this trial yet. Check back later for updates.

Basic Information

Get a concise snapshot of the trial, including recruitment status, study phase, enrollment targets, and key timeline milestones.

Recruitment Status

COMPLETED

Clinical Phase

NA

Total Enrollment

52 participants

Study Classification

INTERVENTIONAL

Study Start Date

2006-03-31

Study Completion Date

2007-06-30

Brief Summary

Review the sponsor-provided synopsis that highlights what the study is about and why it is being conducted.

We will conduct a faculty development workshop with intent to improve interrater reliability and rater accuracy. Outcomes will include interrater reliability, accuracy, and workshop evaluations.

Detailed Description

Dive into the extended narrative that explains the scientific background, objectives, and procedures in greater depth.

Hypothesis: An intervention for training faculty preceptors on the use of the mini-CEX will improve inter-rater reliability and classification accuracy.

Methods. We will develop a faculty development workshop aimed at improving the inter-rater reliability and accuracy of mini-CEX scores. To evaluate the workshop we will conduct a randomized, controlled trial. Preceptors will be randomly assigned to immediate or delayed workshop. The primary outcome will be inter-rater reliability of mini-CEX scores as preceptors rate videotaped resident-patient encounters before and four weeks after the workshop. We will also evaluate the accuracy of performance classifications. We will also collect mini-CEX ratings of actual resident-patient interactions one year preceding and one year following the workshop, and calculate interrater reliability.

Statistical methods. Inter-rater reliability will be determined using the intraclass correlation coefficient (ICC) and corresponding confidence intervals. ICC will be used to determine chance-corrected agreement (accuracy). Discrimination (differences in mean scores among scripted levels of performance) will also be evaluated as a measure of accuracy.

Scientific basis. Clinical performance assessments constitute a key element of resident education. The effect of rater training on the inter-rater reliability of mini-CEX scores is unknown. This workshop will utilize methods (rater error and field of reference training) shown to be effective in improving rater accuracy in non-medical fields.

Inclusion criteria. All internal medicine residency continuity clinic preceptors are eligible.

Conditions

See the medical conditions and disease areas that this research is targeting or investigating.

Faculty Development

Keywords

Explore important study keywords that can help with search, categorization, and topic discovery.

Medical education faculty development rater training clinical competence assessment

Study Design

Understand how the trial is structured, including allocation methods, masking strategies, primary purpose, and other design elements.

Allocation Method

RANDOMIZED

Intervention Model

PARALLEL

Primary Study Purpose

TREATMENT

Blinding Strategy

NONE

Study Groups

Review each arm or cohort in the study, along with the interventions and objectives associated with them.

Workshop

Rater training workshop: rater error training, performance dimension training, behavioral observation training, and frame of reference training using lecture, video, and facilitated discussion

Group Type EXPERIMENTAL

Rater training workshop

Intervention Type BEHAVIORAL

Rater training workshop: rater error training, performance dimension training, behavioral observation training, and frame of reference training using lecture, video, and facilitated discussion

Delayed workshop

No specific intervention until after follow-up assessment, then receives same workshop.

Group Type NO_INTERVENTION

No interventions assigned to this group

Interventions

Learn about the drugs, procedures, or behavioral strategies being tested and how they are applied within this trial.

Rater training workshop

Rater training workshop: rater error training, performance dimension training, behavioral observation training, and frame of reference training using lecture, video, and facilitated discussion

Intervention Type BEHAVIORAL

Eligibility Criteria

Check the participation requirements, including inclusion and exclusion rules, age limits, and whether healthy volunteers are accepted.

Inclusion Criteria

* Internal medicine residency continuity clinic preceptor at Mayo Clinic Rochester Minnesota

Exclusion Criteria

* None
Eligible Sex

ALL

Accepts Healthy Volunteers

Yes

Sponsors

Meet the organizations funding or collaborating on the study and learn about their roles.

Mayo Clinic

OTHER

Sponsor Role lead

Responsible Party

Identify the individual or organization who holds primary responsibility for the study information submitted to regulators.

Mayo Clinic

Principal Investigators

Learn about the lead researchers overseeing the trial and their institutional affiliations.

David A Cook, MD, MHPE

Role: PRINCIPAL_INVESTIGATOR

Mayo Clinic

Locations

Explore where the study is taking place and check the recruitment status at each participating site.

Mayo Clinic

Rochester, Minnesota, United States

Site Status

Countries

Review the countries where the study has at least one active or historical site.

United States

References

Explore related publications, articles, or registry entries linked to this study.

Cook DA, Dupras DM, Beckman TJ, Thomas KG, Pankratz VS. Effect of rater training on reliability and accuracy of mini-CEX scores: a randomized, controlled trial. J Gen Intern Med. 2009 Jan;24(1):74-9. doi: 10.1007/s11606-008-0842-3. Epub 2008 Nov 11.

Reference Type DERIVED
PMID: 19002533 (View on PubMed)

Other Identifiers

Review additional registry numbers or institutional identifiers associated with this trial.

06-002730

Identifier Type: -

Identifier Source: org_study_id