Making Data Count Intervention Evaluation

NCT ID: NCT04977414

Last Updated: 2023-12-11

Study Results

Results pending

The study team has not published outcome measurements, participant flow, or safety data for this trial yet. Check back later for updates.

Basic Information

Get a concise snapshot of the trial, including recruitment status, study phase, enrollment targets, and key timeline milestones.

Recruitment Status

COMPLETED

Clinical Phase

NA

Total Enrollment

15 participants

Study Classification

INTERVENTIONAL

Study Start Date

2021-10-01

Study Completion Date

2023-06-30

Brief Summary

Review the sponsor-provided synopsis that highlights what the study is about and why it is being conducted.

Hospitals collect copious amounts of data to share with their board for quality assurance and improvement purposes. The way these data are presented can influence board members' decisions. For example, time-series charts highlight the highest and lowest data but do not clarify whether those data lie outside expected or 'common cause' variation. Statistical process control charts make this clarification and, in so doing, guide quality assurance and improvements in a more targeted fashion.

A previous study showed that data suitable for presentation as a control chart are seldom presented in that format. A training intervention called 'Making Data Count' was created to improve the uptake of statistical process control charts by hospitals in England. The current study will use a randomized design to evaluate whether the intervention increases control charts in hospitals that were not early adopters of the training intervention.

This study is a parallel cluster randomized trial (with baseline-line measurements) across 20 National Health Service (NHS) hospitals in England. The hospitals will be randomly split into two groups. One group will be scheduled to experience the training intervention, and the other group will be placed on a waiting list to experience the training later. The primary analysis will compare the difference in the use of control charts between waitlist and intervention hospitals (adjusting for pre-intervention use) reported with 95% confidence intervals. A qualitative thematic analysis of feedback forms will be conducted.

The present research will evaluate the impact of the training intervention on the use of control charts. The results will apply to institutions that are not early adopters of this training intervention.

Detailed Description

Dive into the extended narrative that explains the scientific background, objectives, and procedures in greater depth.

Conditions

See the medical conditions and disease areas that this research is targeting or investigating.

Statistical Process Control Charts

Study Design

Understand how the trial is structured, including allocation methods, masking strategies, primary purpose, and other design elements.

Allocation Method

RANDOMIZED

Intervention Model

PARALLEL

Primary Study Purpose

HEALTH_SERVICES_RESEARCH

Blinding Strategy

NONE

Participants cannot be blinded as this is a behavioural intervention.

Some of the researchers can be blinded. Specifically, it is not possible to blind reviewers R1 and R2 to the board papers group or time-period, as those researchers are extracting charts from the published board papers. R3 and R4 will be blinded and will be instructed to inform R1 if those researchers are unblinded at any point, and whether/how often those researchers are unblinded will be reported in the final manuscript.

Study Groups

Review each arm or cohort in the study, along with the interventions and objectives associated with them.

Waitlist control group

Hospitals assigned to this group will be placed in on a waitlist to receive the training intervention at a later date

Group Type NO_INTERVENTION

No interventions assigned to this group

"Making data count" intervention group

The Making Data Count training intervention was designed by NHS-Improvement to improve knowledge about SPC charts and to increase their uptake. Training sessions are tailored for two sets of attendees: board members and data analysts. Board member and analyst training sessions are delivered as close as possible in time, typically within the same month. Training sessions for board members are usually delivered over about one-and-a-half hours and focus more heavily on the benefits of control charts compared to other charts. Training sessions for analysts are usually delivered over three hours and focus more heavily on the structure and interpretation of the individual and moving range charts (X-mR charts).

Group Type EXPERIMENTAL

Making Data Count Training intervention

Intervention Type BEHAVIORAL

The Making Data Count training intervention was designed by NHS-Improvement to improve knowledge about SPC charts and to increase their uptake. Training sessions are tailored for two sets of attendees: board members and data analysts. Board member and analyst training sessions are delivered as close as possible in time, typically within the same month. Training sessions for board members are usually delivered over about one-and-a-half hours and focus more heavily on the benefits of control charts compared to other charts. Training sessions for analysts are usually delivered over three hours and focus more heavily on the structure and interpretation of the individual and moving range charts (X-mR charts).

Interventions

Learn about the drugs, procedures, or behavioral strategies being tested and how they are applied within this trial.

Making Data Count Training intervention

The Making Data Count training intervention was designed by NHS-Improvement to improve knowledge about SPC charts and to increase their uptake. Training sessions are tailored for two sets of attendees: board members and data analysts. Board member and analyst training sessions are delivered as close as possible in time, typically within the same month. Training sessions for board members are usually delivered over about one-and-a-half hours and focus more heavily on the benefits of control charts compared to other charts. Training sessions for analysts are usually delivered over three hours and focus more heavily on the structure and interpretation of the individual and moving range charts (X-mR charts).

Intervention Type BEHAVIORAL

Eligibility Criteria

Check the participation requirements, including inclusion and exclusion rules, age limits, and whether healthy volunteers are accepted.

Inclusion Criteria

* NHS Hospital
* Placed on a red-list for predominantly using R-A-G or two-point data presentations in their board papers.
Eligible Sex

ALL

Accepts Healthy Volunteers

Yes

Sponsors

Meet the organizations funding or collaborating on the study and learn about their roles.

University of Birmingham

OTHER

Sponsor Role collaborator

University of Warwick

OTHER

Sponsor Role lead

Responsible Party

Identify the individual or organization who holds primary responsibility for the study information submitted to regulators.

Kelly Ann Schmidtke

Assistant Professor

Responsibility Role PRINCIPAL_INVESTIGATOR

Locations

Explore where the study is taking place and check the recruitment status at each participating site.

University of Warwick

Coventry, , United Kingdom

Site Status

Countries

Review the countries where the study has at least one active or historical site.

United Kingdom

References

Explore related publications, articles, or registry entries linked to this study.

Schmidtke KA, Kudrna L, Quinn L, Bird P, Hemming K, Venable Z, Lilford R. Cluster randomised evaluation of a training intervention to increase the use of statistical process control charts for hospitals in England: making data count. BMJ Qual Saf. 2025 Aug 18;34(9):621-630. doi: 10.1136/bmjqs-2024-017094.

Reference Type DERIVED
PMID: 39237263 (View on PubMed)

Provided Documents

Download supplemental materials such as informed consent forms, study protocols, or participant manuals.

Document Type: Study Protocol and Statistical Analysis Plan

View Document

Other Identifiers

Review additional registry numbers or institutional identifiers associated with this trial.

BSREC 100/20-21

Identifier Type: -

Identifier Source: org_study_id