Comparison of Three Modalities to Assess Clinical Competence of Medical Students

NCT ID: NCT03884114

Last Updated: 2020-07-20

Study Results

Results pending

The study team has not published outcome measurements, participant flow, or safety data for this trial yet. Check back later for updates.

Basic Information

Get a concise snapshot of the trial, including recruitment status, study phase, enrollment targets, and key timeline milestones.

Recruitment Status

COMPLETED

Clinical Phase

NA

Total Enrollment

42 participants

Study Classification

INTERVENTIONAL

Study Start Date

2019-03-20

Study Completion Date

2019-07-06

Brief Summary

Review the sponsor-provided synopsis that highlights what the study is about and why it is being conducted.

This study, focusing on the management of pediatric asthma exacerbations, assesses the clinical skills of medical students using three different evaluation tools: (i) the simulation game "Effic'Asthme" developed to train individuals on the management of pediatric asthma exacerbations; (ii) a multiple choice questionnaire (MCQ) on the same subject developed for the purpose of the study and (iii) high fidelity (HF)-simulation, considered as the gold-standard for its enhanced realism.

Its objective is to determine which of the simulation game or the MCQ reflects the best the clinical competence of medical students evaluated on a HF simulator.

Detailed Description

Dive into the extended narrative that explains the scientific background, objectives, and procedures in greater depth.

The assessment of medical students' clinical competence has long been of concern to educational institutions. Objective structural clinical examination (OSCE) and assessments in high-fidelity (HF) simulation settings represent interesting evaluation modalities but are associated with huge costs, especially when they are used for large-scale standardized assessments. Multiple choice questionnaires (MCQ) remain the most common evaluation tool in medical schools.

Simulation games may represent an interesting compromise between the cheap but limited assessment allowed by MCQs, and the comprehensive but highly expensive assessment allowed by OSCE and HF simulation.

This study, focusing on the management of pediatric asthma exacerbations, assesses the clinical skills of medical students using three different evaluation tools: (i) the simulation game "Effic'Asthme" developed to train individuals on the management of pediatric asthma exacerbations; (ii) a MCQ on the same subject developed for the purpose of the study and (iii) HF-simulation, considered as the gold-standard for its enhanced realism.

Its objective is to determine which of the simulation game or the MCQ reflects the best the clinical competence of medical students evaluated on a HF simulator.

Conditions

See the medical conditions and disease areas that this research is targeting or investigating.

Educational Problems

Study Design

Understand how the trial is structured, including allocation methods, masking strategies, primary purpose, and other design elements.

Intervention Model

SEQUENTIAL

All medical students are evaluated using a high-fidelity simulation environment, then using a serious game, then using multiple choice questionnaire, all on the same topic.
Primary Study Purpose

OTHER

Blinding Strategy

NONE

Study Groups

Review each arm or cohort in the study, along with the interventions and objectives associated with them.

All participants

All participants are evaluated on a scenario of pediatric asthma exacerbation using three different evaluation tools: (i) the simulation game EfficAsthme developed to train individuals on the management of pediatric asthma exacerbations; (ii) a MCQ on the same subject developed for the purpose of the study and (iii) HF-simulation, considered as the gold-standard for its enhanced realism.

Group Type OTHER

High-fidelity simulation

Intervention Type OTHER

The first evaluation modality studied is high fidelity (HF) simulation. In our study, this modality is considered to be the gold-standard assessment method of clinical assessment, because HF simulation corresponds to the modality which reflects the best clinical competence in hospital settings. The HF pediatric manikin used (SimBaby), is able to reproduce all the signs of an asthma exacerbation (coughing, wheezing, tachypnea, chest indrawing, seesaw respiration, cyanosis). In the simulation room, participants can use the same items that those present in the simulation game (a glass of water, paracetamol, short acting beta-agonist, controller treatment (Fluticasone), an asthma spacer with a facial mask, saline nose drops to perform nasal irrigation, oral steroids in tablets (prednisone), and a phone).

Simulation game

Intervention Type OTHER

EfficAsthme is a simulation game used on a tablet computer. This simulation game was developed to train parents on the management of asthma exacerbations of their children. For the purpose of the study, EfficAsthme is diverted from its original use to assess students' clinical skills. The training scenario "A polluted atmosphere" is used in this study. Participants need to observe the signs presented by the child, and to determine the severity of the asthma exacerbation. From a menu on the right of the screen, the participant can choose several actions, especially to provide the short acting beta-agonist.

Multiple choice questionnaire

Intervention Type OTHER

The third evaluation modality corresponds to a multiple choice questionnaire (MCQ) including 15 questions. As for HF-simulation and the simulation game, the MCQ starts with the same briefing and continues with 15 questions regarding the management of a moderate asthma exacerbation.

Interventions

Learn about the drugs, procedures, or behavioral strategies being tested and how they are applied within this trial.

High-fidelity simulation

The first evaluation modality studied is high fidelity (HF) simulation. In our study, this modality is considered to be the gold-standard assessment method of clinical assessment, because HF simulation corresponds to the modality which reflects the best clinical competence in hospital settings. The HF pediatric manikin used (SimBaby), is able to reproduce all the signs of an asthma exacerbation (coughing, wheezing, tachypnea, chest indrawing, seesaw respiration, cyanosis). In the simulation room, participants can use the same items that those present in the simulation game (a glass of water, paracetamol, short acting beta-agonist, controller treatment (Fluticasone), an asthma spacer with a facial mask, saline nose drops to perform nasal irrigation, oral steroids in tablets (prednisone), and a phone).

Intervention Type OTHER

Simulation game

EfficAsthme is a simulation game used on a tablet computer. This simulation game was developed to train parents on the management of asthma exacerbations of their children. For the purpose of the study, EfficAsthme is diverted from its original use to assess students' clinical skills. The training scenario "A polluted atmosphere" is used in this study. Participants need to observe the signs presented by the child, and to determine the severity of the asthma exacerbation. From a menu on the right of the screen, the participant can choose several actions, especially to provide the short acting beta-agonist.

Intervention Type OTHER

Multiple choice questionnaire

The third evaluation modality corresponds to a multiple choice questionnaire (MCQ) including 15 questions. As for HF-simulation and the simulation game, the MCQ starts with the same briefing and continues with 15 questions regarding the management of a moderate asthma exacerbation.

Intervention Type OTHER

Eligibility Criteria

Check the participation requirements, including inclusion and exclusion rules, age limits, and whether healthy volunteers are accepted.

Inclusion Criteria

* medical students from Paris 5 University who meet the following criteria

* Being in their fifth year of medical school
* Having passed their pediatric exam in the previous 15 days
* Willing to participate in the study

Exclusion Criteria

* refusal to participate
Minimum Eligible Age

18 Years

Eligible Sex

ALL

Accepts Healthy Volunteers

Yes

Sponsors

Meet the organizations funding or collaborating on the study and learn about their roles.

Ilumens

OTHER

Sponsor Role lead

Responsible Party

Identify the individual or organization who holds primary responsibility for the study information submitted to regulators.

Responsibility Role SPONSOR

Principal Investigators

Learn about the lead researchers overseeing the trial and their institutional affiliations.

David Drummond, MD, PhD

Role: PRINCIPAL_INVESTIGATOR

Université Paris Descartes

Locations

Explore where the study is taking place and check the recruitment status at each participating site.

Université Paris Descartes

Paris, , France

Site Status

Countries

Review the countries where the study has at least one active or historical site.

France

References

Explore related publications, articles, or registry entries linked to this study.

Norcini JJ, Swanson DB, Grosso LJ, Webster GD. Reliability, validity and efficiency of multiple choice question and patient management problem item formats in assessment of clinical competence. Med Educ. 1985 May;19(3):238-47. doi: 10.1111/j.1365-2923.1985.tb01314.x.

Reference Type BACKGROUND
PMID: 4010571 (View on PubMed)

Drummond D, Delval P, Abdenouri S, Truchot J, Ceccaldi PF, Plaisance P, Hadchouel A, Tesniere A. Serious game versus online course for pretraining medical students before a simulation-based mastery learning course on cardiopulmonary resuscitation: A randomised controlled study. Eur J Anaesthesiol. 2017 Dec;34(12):836-844. doi: 10.1097/EJA.0000000000000675.

Reference Type BACKGROUND
PMID: 28731928 (View on PubMed)

Adjedj J, Ducrocq G, Bouleti C, Reinhart L, Fabbro E, Elbez Y, Fischer Q, Tesniere A, Feldman L, Varenne O. Medical Student Evaluation With a Serious Game Compared to Multiple Choice Questions Assessment. JMIR Serious Games. 2017 May 16;5(2):e11. doi: 10.2196/games.7033.

Reference Type BACKGROUND
PMID: 28512082 (View on PubMed)

Fonteneau T, Billion E, Abdoul C, Le S, Hadchouel A, Drummond D. Simulation Game Versus Multiple Choice Questionnaire to Assess the Clinical Competence of Medical Students: Prospective Sequential Trial. J Med Internet Res. 2020 Dec 16;22(12):e23254. doi: 10.2196/23254.

Reference Type DERIVED
PMID: 33325833 (View on PubMed)

Related Links

Access external resources that provide additional context or updates about the study.

http://sites-e-play.parisdescartes.fr/educasthma/efficasthme/

Site showing the simulation game "EfficAsthme" developed

Other Identifiers

Review additional registry numbers or institutional identifiers associated with this trial.

Ilumens0003

Identifier Type: -

Identifier Source: org_study_id

More Related Trials

Additional clinical trials that may be relevant based on similarity analysis.