Multifaceted Online Interventions to Increase Clinicians Searching of Current Best Evidence to Answer Clinical Questions

NCT ID: NCT02038439

Last Updated: 2015-04-08

Study Results

Results pending

The study team has not published outcome measurements, participant flow, or safety data for this trial yet. Check back later for updates.

Basic Information

Get a concise snapshot of the trial, including recruitment status, study phase, enrollment targets, and key timeline milestones.

Recruitment Status

COMPLETED

Clinical Phase

NA

Total Enrollment

908 participants

Study Classification

INTERVENTIONAL

Study Start Date

2014-01-31

Study Completion Date

2014-10-31

Brief Summary

Review the sponsor-provided synopsis that highlights what the study is about and why it is being conducted.

Translation of new knowledge from research into evidence-informed health care is a shared obligation of the clinical and the scientific communities. Unfortunately, studies of quality of care continue to show that this goal is substantially unrealized. One main barrier is lack of quick and easy identification, appraisal and synthesis of current best evidence. Clinicians' information have 5 to 8 questions about individual patients per daily shift, but face a large volume of 3000 articles published every day, accessible in many scattered resources.

To address theses problems, McMaster's Health Information Research Unit (Hamilton, Ontario, Canada) has developed and implemented "McMaster Premium LiteratUre Service Federated Search" (MPFS), an online search engine that provides a unique 1-stop search and organized access to current best evidence in daily practice. However additional barriers need to be overcome for clinicians to actually search and use this evidence in their practice. Theses include logistical barriers (time constraints, forgotten questions), as well as educational barriers (eg, lack of awareness of the "architecture" of evidence, limited searching skills, and lack of reference standards among peers for finding best evidence).

This randomized trial seeks to test 3 innovative online interventions among clinicians registered to MPFS to overcome these barriers and increase the quantity and quality of searching for current best evidence to answer clinical questions. These interventions build on effective models for the teaching of clinical skills at the point of care, so that clinicians are facilitated in using the search engine as a clinical tool, and perceive evidence retrieval skills as true clinical skills.

Detailed Description

Dive into the extended narrative that explains the scientific background, objectives, and procedures in greater depth.

1. Rationale \& Objectives

One main barrier to achieving evidence-informed care by clinicians is lack of quick and easy identification, appraisal and synthesis of current best evidence. Clinicians' information needs are considerable - but about 3000 articles are published in Medline every day. Numerous evidence-based resources have been developed to filter and process the evidence, but although increasingly used by clinicians, each offer a fragmented and scattered view of information, and none provides comprehensive topic coverage or satisfactory updating.

To address theses problems, McMaster's Health Information Research Unit (Hamilton, Ontario, Canada) has developed and implemented "McMaster Premium LiteratUre Service Federated Search (MPFS)", an online search engine that provides a unique 1-stop search and organized access to current best evidence in daily practice. MPFS provides both alerts to users about new research in their chosen disciplines, and a novel federated search function, with the particular feature of organizing information according to the "pyramid of evidence-based resources", with the most clinically applicable evidence at the top. Thus MPFS simultaneously retrieves evidence from Studies ("Medline", both filtered and unfiltered, at the bottom), then Systematic reviews; Synopses of studies and systematic reviews (selected for methodological rigor and clinical relevance), and, at the top level, online widely used Summaries (e.g."Best Practice").

Combining features of the current best evidence-based resources is not enough to increase access and use of current best evidence, as shown by the relatively low utilization of searching features among the hundreds of clinicians currently registered at McMaster University and using the alerting system. Additional well-known barriers that need to be overcome include logistical barriers (time constraints, forgotten questions, and simplicity of using one single albeit limited resource), as well as educational barriers (eg, lack of awareness of the "architecture" of evidence and limits of other single resources, lack of knowledge and experience of what federated searches can offer, limited searching skills, and lack of reference standards among peers for finding best evidence).
2. Hypothesis

This trial seeks to test 3 innovative online interventions among clinicians registered to MPFS to overcome these barriers and increase the quantity and quality of searching for current best evidence to answer clinical questions. These interventions build on effective models for the teaching of clinical skills at the point of care, so that clinicians are facilitated in using the search engine as a clinical tool, and perceive evidence retrieval skills as true clinical skills.
3. Methods

1. Study design: Randomized Factorial Controlled Trial.
2. Setting and Participants: The trial will be conducted among postgraduate and faculty MD registered in MPFS and working in the teaching hospitals and clinics of McMaster University (see eligibility criteria below)
3. Participating clinicians will be randomized to 3 online interventions (see description below) in a factorial design (A x B x C), whose permutation results in 8 allocation arms (A+B+C, A+B, A+C, B+C, A, B, C, no intervention, see details below)
4. Randomization: will be computer-generated, stratified training level (post-graduate MD, faculty MD), and baseline frequency of searching for evidence on MPFS. Registrants will be randomly allocated to each study arms. Allocation will be concealed from research staff.
5. Blinding and control group: Although participants cannot be blinded to the interventions, they will not be told of the different features offered, and all will receive usual searching features of MPFS.
6. Primary and secondary outcomes (see below).

Conditions

See the medical conditions and disease areas that this research is targeting or investigating.

Physicians Evidence Retrieval Skills

Study Design

Understand how the trial is structured, including allocation methods, masking strategies, primary purpose, and other design elements.

Allocation Method

RANDOMIZED

Intervention Model

FACTORIAL

Blinding Strategy

SINGLE

Investigators

Study Groups

Review each arm or cohort in the study, along with the interventions and objectives associated with them.

Interventions: A + B + C

See Interventions Description. In this arm, clinicians will be offered all 3 online interventions combined:

* Intervention A - Online Clinical Questions Recorder
* Intervention B - Online Evidence Retrieval Coach
* Intervention C - Online Audit and Feedback

Group Type EXPERIMENTAL

Intervention A - Online Clinical Questions Recorder

Intervention Type BEHAVIORAL

Clinicians allocated to this intervention will receive access to an online recorder for the clinical questions at the point of care. The recorder is accessible across a wide range of devices including phones, tablets, and desktop computers.

Intervention B - Online Evidence Retrieval Coach

Intervention Type BEHAVIORAL

Clinicians allocated to this intervention will receive online guidance, embedded in the MPFS search engine, in the form of short videos, animations, demos and tips and tricks regarding evidence retrieval.

Intervention C - Online Audit and Feedback

Intervention Type BEHAVIORAL

Clinicians allocated to this intervention will receive feedback on their current search performance compared to their peers, both online when using MPFS as well as by e-mail.

Interventions A + B

See Interventions Description. In this arm, clinicians will be offered the 2 following interventions combined:

* Intervention A - Online Clinical Questions Recorder
* Intervention B - Online Evidence Retrieval Coach

Group Type EXPERIMENTAL

Intervention A - Online Clinical Questions Recorder

Intervention Type BEHAVIORAL

Clinicians allocated to this intervention will receive access to an online recorder for the clinical questions at the point of care. The recorder is accessible across a wide range of devices including phones, tablets, and desktop computers.

Intervention B - Online Evidence Retrieval Coach

Intervention Type BEHAVIORAL

Clinicians allocated to this intervention will receive online guidance, embedded in the MPFS search engine, in the form of short videos, animations, demos and tips and tricks regarding evidence retrieval.

Interventions A + C

See Interventions Description. In this arm, clinicians will be offered the 2 following online interventions combined:

* Intervention A - Online Clinical Questions Recorder
* Intervention C - Online Audit and Feedback

Group Type EXPERIMENTAL

Intervention A - Online Clinical Questions Recorder

Intervention Type BEHAVIORAL

Clinicians allocated to this intervention will receive access to an online recorder for the clinical questions at the point of care. The recorder is accessible across a wide range of devices including phones, tablets, and desktop computers.

Intervention C - Online Audit and Feedback

Intervention Type BEHAVIORAL

Clinicians allocated to this intervention will receive feedback on their current search performance compared to their peers, both online when using MPFS as well as by e-mail.

Interventions B + C

See Interventions Description. In this arm, clinicians will be offered the 2 following online interventions combined:

* Intervention B - Online Evidence Retrieval Coach
* Intervention C - Online Audit and Feedback

Group Type EXPERIMENTAL

Intervention B - Online Evidence Retrieval Coach

Intervention Type BEHAVIORAL

Clinicians allocated to this intervention will receive online guidance, embedded in the MPFS search engine, in the form of short videos, animations, demos and tips and tricks regarding evidence retrieval.

Intervention C - Online Audit and Feedback

Intervention Type BEHAVIORAL

Clinicians allocated to this intervention will receive feedback on their current search performance compared to their peers, both online when using MPFS as well as by e-mail.

Intervention A alone

See Interventions Description. In this arm, clinicians will be offered only the following intervention:

\* Intervention A - Online Clinical Questions Recorder

Group Type EXPERIMENTAL

Intervention A - Online Clinical Questions Recorder

Intervention Type BEHAVIORAL

Clinicians allocated to this intervention will receive access to an online recorder for the clinical questions at the point of care. The recorder is accessible across a wide range of devices including phones, tablets, and desktop computers.

Intervention B alone

See Interventions Description. In this arm, clinicians will be offered only the following intervention:

\* Intervention B - Online Evidence Retrieval Coach

Group Type EXPERIMENTAL

Intervention B - Online Evidence Retrieval Coach

Intervention Type BEHAVIORAL

Clinicians allocated to this intervention will receive online guidance, embedded in the MPFS search engine, in the form of short videos, animations, demos and tips and tricks regarding evidence retrieval.

Intervention C alone

See Interventions Description. In this arm, clinicians will be offered only the following intervention:

\* Intervention C - Online Audit and Feedback

Group Type EXPERIMENTAL

Intervention C - Online Audit and Feedback

Intervention Type BEHAVIORAL

Clinicians allocated to this intervention will receive feedback on their current search performance compared to their peers, both online when using MPFS as well as by e-mail.

No intervention

In this arm, clinicians will be offered non of the 3 online interventions, but will just be using the usual features of the search engine available to all users.

Group Type NO_INTERVENTION

No interventions assigned to this group

Interventions

Learn about the drugs, procedures, or behavioral strategies being tested and how they are applied within this trial.

Intervention A - Online Clinical Questions Recorder

Clinicians allocated to this intervention will receive access to an online recorder for the clinical questions at the point of care. The recorder is accessible across a wide range of devices including phones, tablets, and desktop computers.

Intervention Type BEHAVIORAL

Intervention B - Online Evidence Retrieval Coach

Clinicians allocated to this intervention will receive online guidance, embedded in the MPFS search engine, in the form of short videos, animations, demos and tips and tricks regarding evidence retrieval.

Intervention Type BEHAVIORAL

Intervention C - Online Audit and Feedback

Clinicians allocated to this intervention will receive feedback on their current search performance compared to their peers, both online when using MPFS as well as by e-mail.

Intervention Type BEHAVIORAL

Eligibility Criteria

Check the participation requirements, including inclusion and exclusion rules, age limits, and whether healthy volunteers are accepted.

Inclusion Criteria

* All postgraduate and faculty physicians currently registered for more than one month in the MPFS search engine,
* and working in the teaching hospitals and clinics of the Faculty of Health Sciences, McMaster University, Hamilton, Ontario.

Exclusion Criteria

* Registrants that are no longer working or training at McMaster University,
* Registrants that never logged in MPFS during the last 12 months counting back from the beginning of the trial.
Eligible Sex

ALL

Accepts Healthy Volunteers

No

Sponsors

Meet the organizations funding or collaborating on the study and learn about their roles.

Canadian Institutes of Health Research (CIHR)

OTHER_GOV

Sponsor Role collaborator

McMaster University

OTHER

Sponsor Role lead

Responsible Party

Identify the individual or organization who holds primary responsibility for the study information submitted to regulators.

Responsibility Role SPONSOR

Principal Investigators

Learn about the lead researchers overseeing the trial and their institutional affiliations.

Thomas Agoritsas, MD

Role: PRINCIPAL_INVESTIGATOR

McMaster University

Locations

Explore where the study is taking place and check the recruitment status at each participating site.

McMaster University

Hamilton, Ontario, Canada

Site Status

Countries

Review the countries where the study has at least one active or historical site.

Canada

References

Explore related publications, articles, or registry entries linked to this study.

Seguin A, Haynes RB, Carballo S, Iorio A, Perrier A, Agoritsas T. Translating Clinical Questions by Physicians Into Searchable Queries: Analytical Survey Study. JMIR Med Educ. 2020 Apr 20;6(1):e16777. doi: 10.2196/16777.

Reference Type DERIVED
PMID: 32310137 (View on PubMed)

Agoritsas T, Iserman E, Hobson N, Cohen N, Cohen A, Roshanov PS, Perez M, Cotoi C, Parrish R, Pullenayegum E, Wilczynski NL, Iorio A, Haynes RB. Increasing the quantity and quality of searching for current best evidence to answer clinical questions: protocol and intervention design of the MacPLUS FS Factorial Randomized Controlled Trials. Implement Sci. 2014 Sep 20;9:125. doi: 10.1186/s13012-014-0125-9.

Reference Type DERIVED
PMID: 25239537 (View on PubMed)

Related Links

Access external resources that provide additional context or updates about the study.

http://plus.mcmaster.ca/MacPLUSFS/

online MPFS search engine

Other Identifiers

Review additional registry numbers or institutional identifiers associated with this trial.

FRN86465

Identifier Type: -

Identifier Source: org_study_id

More Related Trials

Additional clinical trials that may be relevant based on similarity analysis.

Agent-Enhanced Document Explanation
NCT02668705 TERMINATED NA
ECA vs E-Document Explanation
NCT03381911 COMPLETED NA
Improving Patient-centered Care Using an Inventory
NCT01843803 COMPLETED PHASE2/PHASE3