Effects of Checklists in Surgical Care - a Study on Complications, Death and Quality of Patient Administrative Data
NCT ID: NCT01872195
Last Updated: 2015-06-11
Study Results
The study team has not published outcome measurements, participant flow, or safety data for this trial yet. Check back later for updates.
Basic Information
Get a concise snapshot of the trial, including recruitment status, study phase, enrollment targets, and key timeline milestones.
COMPLETED
NA
21000 participants
INTERVENTIONAL
2013-06-30
2015-03-31
Brief Summary
Review the sponsor-provided synopsis that highlights what the study is about and why it is being conducted.
We hypothesise
1. An updated systematic review of the research literature provide evidence that safety checklists use does enhance safety and reduces patient mortality and morbidity
2. Implementation of the patient safety checklist system will reduce patient mortality and morbidity in the checklist cohort, and subsequent effects on length of stay
3. The sensitivity and specificity of ICD-10 coding vs. medical journal information is poor, with study results to be adjusted accordingly.
Related Clinical Trials
Explore similar clinical trials based on study characteristics and research focus.
Safety Improvement and Checklist Application
NCT01343069
Impact of a Checklist on the Rate of Late Cancellation in Ambulatory Surgery
NCT01732159
Checklist Application and Mortality
NCT01356446
Surgical Checklist Success in Latin America
NCT02646345
Team, Competence and Safety Climate in the Operating Room
NCT02329691
Detailed Description
Dive into the extended narrative that explains the scientific background, objectives, and procedures in greater depth.
Patient safety checklists have been introduced and recommended as a standard of surgical care (Birkmeyer, 2010; de Vries et al., 2011). Studies based on data from electronic patient administrative systems show that checklist use may reduce mortality and morbidity in surgery (de Vries et al., 2010; van Klei et al., 2012; Haynes et al., 2009). Safe Surgery checklists have been recommended by the World Health Organization (WHO) since 2008 as a strategy to avoid adverse events (AE) during surgery. More than 6000 hospitals have implemented Safe Surgery checklists in their operating theatres (OTs) (http://www.who.int/patientsafety/safesurgery/en/), including Haukeland University Hospital (HUH).
This multicentre research project will also introduce a system of patient safety checklists at each point of care during the surgical patients' stay, not only in the operating theatres (OTs). The system combines new checklists on patient care (parts of SURPASS) with the already established Safe Surgery checklist (WHO) in the OTs. At the same time securing reliability, validity and quality of the patient, morbidity and mortality data will be an essential part of the study.
Today the discharging physician reviews the medical journal and makes a medical summary including coding diseases and complications relevant for the current admission. International Classification of Diseases (ICD-10) codes are used to set diagnoses for clinical, epidemiological and quality purposes (http://www.who.int/classifications/icd/ICD10Volume2\_en\_2010.pdf). The ICD-10 codes are also used for registrations on national mortality and morbidity in the Norwegian National Patient Register (NPR). Questions have been raised as to the accuracy and quality of the data in such registers in Norway, e.g. in patients with sepsis (Flaatten, 2004), and intensive care patients (Aardal et al., 2005). In a Danish study on relations between ICD-10 coding in the National Registry of Patients and the hospitals' discharge summary and medical records, a high reliability between ICD-10 scores and co-morbidity was found (Thygesen et al., 2011). To our knowledge similar studies have not been done in Norway. As a crucial part of this investigation we concurrently will evaluate the reliability and validity of our patient administrative data by comparing the post discharge ICD-10 codes to actual data available directly from medical journal systems as documented by health care personnel in the journal texts.
2.0 Objective
The main objectives of this study are to:
* Perform a systematic review of published studies on effects of safety checklists in medicine.
* Explore effects on morbidity and mortality after implementing a system of patient safety checklists at each point of care during the surgical patients' stay (elements of SURPASS and the WHO Safe Surgery list combined), in a cohort of surgical patients in different surgical departments in one hospital, with patients from departments not having the system introduced serving as controls from three hospitals.
* Investigate the validity of the post discharge ICD-10 codes for complications compared to actual information found in medical journal systems texts.
3.0 Methods 3.1 The projects and design
1. Systematic review A systematic review on effects of safety checklists in medicine was done on May 29th, 2012 in the databases MEDLINE, Cochrane library, EMBASE and Web of Science, limited to only humans. The criteria were pre-set and included all time published quantitative studies in any language in the in-hospital and pre-hospital setting where safety checklists were the sole intervention, and effects of using checklists, generated as measurable outcomes. 7408 singular articles were found. To ensure the transparency of the reviewing process we used the PRISMA guidelines (Liberati et al., 2009). 34 studies met our inclusion criteria. The majority of the included studies measured effects pre-and post-intervention and was classified as having an observational design. . This systematic review has identified that safety checklists can be effective safety tools in various clinical settings. Their use has reduced patient mortality and morbidity. In addition, safety checklist use has been associated with better human performance, improved compliance with evidence-based practices, promoted consistency of care, and reduction of technical omissions. None of the included studies reported that safety checklists have negative effects on patient safety issues.
2. Implement the new patient safety checklist system and measure effects on morbidity, mortality and length of hospital stay.
A prospective stepped wedge trial design (Brown \& Lilford, 2006; Brown et al., 2008) will be used when implementing the validated patient safety checklist system in the Neurosurgical Department, the Orthopaedic Clinic and the Department of Gynaecology and Obstetrics at HUH. Patients from departments not using the patient safety checklist system serve as controls, this includes the Head and Neck Clinic (HUH), the Thoracic Surgery Section of the Heart Department (HUH) and two hospitals outside our own municipality (Health Trust Førde, and Health Trust Fonna - Haugesund Hospital). Primary end-points to be measured prospectively include length of hospital stay and morbidity and mortality utilizing the ICD-10 codes for complications collected electronically from the hospital patient administrative systems.
3. Validation of morbidity and mortality data Today ICD-10 codes are produced by discharging physicians to summarize diagnoses at discharge and any complications having occurred during patient stay. In order to validate HUH's and Health Trust Førde's ICD-10 coding on patient morbidity and mortality we will randomize inclusion for quality check comparing the ICD-10 codes used at discharge to all actual information on morbidity and mortality as documented in the electronic patient journal (EPJ) - DIPS. This validation should include approximately 700 patients, all having undergone major surgery. Such a comparison is essential to gain knowledge on the quality of generated ICD-10 data and thus important to the quality of results in this study.
3.2 Intervention study sample Three surgical units at HUH (Department of Neurosurgery, Orthopaedic Clinic, and Department of Gynaecology and Obstetrics) will have the checklist system implemented. Approximately 3700 patients will be included before and 3700 patients after checklist implementation. The Control Group includes 7400 patients.
3.4 Data collection For the study on mortality and morbidity we will extract ICD-10 codes used at discharge from the hospitals NPR file, as all Norwegian hospitals report their ICD-10 codes and procedure codes to NPR. In addition to registering all ICD-10 codes on each patient, we will collect demographic data (age, gender, height and weight), American Society of Anaesthesiologists Physical Health Classification (ASA), dates of admission and discharge, and all surgical procedures and major treatments. Data will be processed through Webport using a system previously developed locally for the WHO Surgical Safety Checklist project.
The primary end points, morbidity and mortality, are registered during hospitalization and postoperatively up to 30 days. Morbidity will be registered as major complications according to the American College of Surgeons' National Surgical Quality Improvement Program (http://www.facs.org/cqi/outcomes.html): organ/space surgical site infection, wound dehiscence, deep vein thrombosis, pulmonary embolism, pneumonia, re-intubation, ventilator use longer than 24 hours, cardiac arrest, myocardial infarction, sepsis, shock, coma longer than 24 hours, prosthetic/graft failure, and bleeding. Additional complications to these, as reported by de Vries (2010) will be included in order to make comparisons possible.
The study investigating reliability and validity of the ICD-10 codes will be done in detail: A prospective random selection of 700 patients, 200 patients from Health Trust Førde and 500 patients from the HUH, all having undergone major surgery. Present knowledge should suggest one or several major complications caused by procedures or iatrogenic causes in at least 17 % the surgical patients (de Vries, 2010). Then an inclusion of 700 patients is needed in order to find such complications in 119 cases. We will identify all post discharge ICD-10 codes for each patient. These codes will be thoroughly reviewed for accuracy and completeness by comparing to the actual information as documented by physicians and nurses in the EPJs throughout the total hospital stay. Primary outcome is here to investigate that registered ICD-10 codes have adequate sensitivity and specificity compared to the information in the patients' medical journal.
3.5 Statistics Descriptive and inferential statistical methods will be used to analyse data. Confidence intervals (95% CI) for sensitivity and specificity will be calculated using the normal approximation for the standard error of proportions.
Mortality and morbidity will be analysed as to time of measurement, e.g. pre and post intervention, and surgical unit, i.e. using or not using the checklist. Multiple regression analysis and other appropriate statistical tools will be used to adjust for covariates to mortality and morbidity. Calculation of sample size and power, with an expected mortality rate decrease (0.015 vs. 0.008) requires a sample size of 3641 patients in both baseline and post intervention groups with an alpha (0.05, 2-tailed), power is 80%. To calculate sample size and power for morbidity mitigation from 27% to 17% (de Vries et al., 2010) requires a much smaller sample size of 234 in baseline and post intervention groups to constitute an 80% power with alpha at 0.05, 2-tailed. Statistical analysis will be conducted with appropriate statistical software e.g. Statistical Package for the Social Sciences, Stata or R.
Conditions
See the medical conditions and disease areas that this research is targeting or investigating.
Study Design
Understand how the trial is structured, including allocation methods, masking strategies, primary purpose, and other design elements.
NON_RANDOMIZED
PARALLEL
PREVENTION
NONE
Study Groups
Review each arm or cohort in the study, along with the interventions and objectives associated with them.
* Before checklists
The comprehensive patient safety checklist system
The comprehensive patient safety checklist system
The comprehensive patient safety checklist system follows each patient from admission to discharge with separate short checklists at each point of care: On admission to the hospital and ward (operating theatre nurse, ward doctor, surgeon, anaesthesiologist, ward nurse - 5 lists), in the operating theatre (here covered by the WHO-Safe Surgery checklist), at the recovery/ICU unit (nurse- 1 list), at discharge from the hospital (ward doctor, ward nurse - 2 lists).
* After checklists
Without the comprehensive patient safety checklist system
The comprehensive patient safety checklist system
The comprehensive patient safety checklist system follows each patient from admission to discharge with separate short checklists at each point of care: On admission to the hospital and ward (operating theatre nurse, ward doctor, surgeon, anaesthesiologist, ward nurse - 5 lists), in the operating theatre (here covered by the WHO-Safe Surgery checklist), at the recovery/ICU unit (nurse- 1 list), at discharge from the hospital (ward doctor, ward nurse - 2 lists).
Interventions
Learn about the drugs, procedures, or behavioral strategies being tested and how they are applied within this trial.
The comprehensive patient safety checklist system
The comprehensive patient safety checklist system follows each patient from admission to discharge with separate short checklists at each point of care: On admission to the hospital and ward (operating theatre nurse, ward doctor, surgeon, anaesthesiologist, ward nurse - 5 lists), in the operating theatre (here covered by the WHO-Safe Surgery checklist), at the recovery/ICU unit (nurse- 1 list), at discharge from the hospital (ward doctor, ward nurse - 2 lists).
Eligibility Criteria
Check the participation requirements, including inclusion and exclusion rules, age limits, and whether healthy volunteers are accepted.
Inclusion Criteria
Exclusion Criteria
ALL
No
Sponsors
Meet the organizations funding or collaborating on the study and learn about their roles.
Haukeland University Hospital
OTHER
Responsible Party
Identify the individual or organization who holds primary responsibility for the study information submitted to regulators.
Principal Investigators
Learn about the lead researchers overseeing the trial and their institutional affiliations.
Eirik Søfteland, MD, PhD
Role: PRINCIPAL_INVESTIGATOR
Haukeland University Hospital
Locations
Explore where the study is taking place and check the recruitment status at each participating site.
Haukeland University Hospital
Bergen, , Norway
Countries
Review the countries where the study has at least one active or historical site.
References
Explore related publications, articles, or registry entries linked to this study.
Brown C, Hofer T, Johal A, Thomson R, Nicholl J, Franklin BD, Lilford RJ. An epistemology of patient safety research: a framework for study design and interpretation. Part 2. Study design. Qual Saf Health Care. 2008 Jun;17(3):163-9. doi: 10.1136/qshc.2007.023648.
Birkmeyer JD. Strategies for improving surgical quality--checklists and beyond. N Engl J Med. 2010 Nov 11;363(20):1963-5. doi: 10.1056/NEJMe1009542. No abstract available.
Brown CA, Lilford RJ. The stepped wedge trial design: a systematic review. BMC Med Res Methodol. 2006 Nov 8;6:54. doi: 10.1186/1471-2288-6-54.
de Vries EN, Eikens-Jansen MP, Hamersma AM, Smorenburg SM, Gouma DJ, Boermeester MA. Prevention of surgical malpractice claims by use of a surgical safety checklist. Ann Surg. 2011 Mar;253(3):624-8. doi: 10.1097/SLA.0b013e3182068880.
de Vries EN, Prins HA, Crolla RM, den Outer AJ, van Andel G, van Helden SH, Schlack WS, van Putten MA, Gouma DJ, Dijkgraaf MG, Smorenburg SM, Boermeester MA; SURPASS Collaborative Group. Effect of a comprehensive surgical safety system on patient outcomes. N Engl J Med. 2010 Nov 11;363(20):1928-37. doi: 10.1056/NEJMsa0911535.
de Vries EN, Ramrattan MA, Smorenburg SM, Gouma DJ, Boermeester MA. The incidence and nature of in-hospital adverse events: a systematic review. Qual Saf Health Care. 2008 Jun;17(3):216-23. doi: 10.1136/qshc.2007.023622.
Haynes AB, Weiser TG, Berry WR, Lipsitz SR, Breizat AH, Dellinger EP, Herbosa T, Joseph S, Kibatala PL, Lapitan MC, Merry AF, Moorthy K, Reznick RK, Taylor B, Gawande AA; Safe Surgery Saves Lives Study Group. A surgical safety checklist to reduce morbidity and mortality in a global population. N Engl J Med. 2009 Jan 29;360(5):491-9. doi: 10.1056/NEJMsa0810119. Epub 2009 Jan 14.
Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JP, Clarke M, Devereaux PJ, Kleijnen J, Moher D. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clin Epidemiol. 2009 Oct;62(10):e1-34. doi: 10.1016/j.jclinepi.2009.06.006. Epub 2009 Jul 23.
Thygesen SK, Christiansen CF, Christensen S, Lash TL, Sorensen HT. The predictive value of ICD-10 diagnostic coding used to assess Charlson comorbidity index conditions in the population-based Danish National Registry of Patients. BMC Med Res Methodol. 2011 May 28;11:83. doi: 10.1186/1471-2288-11-83.
van Klei WA, Hoff RG, van Aarnhem EE, Simmermacher RK, Regli LP, Kappen TH, van Wolfswinkel L, Kalkman CJ, Buhre WF, Peelen LM. Effects of the introduction of the WHO "Surgical Safety Checklist" on in-hospital mortality: a cohort study. Ann Surg. 2012 Jan;255(1):44-9. doi: 10.1097/SLA.0b013e31823779ae.
Storesund A, Haugen AS, Flaatten H, Nortvedt MW, Eide GE, Boermeester MA, Sevdalis N, Tveiten O, Mahesparan R, Hjallen BM, Fevang JM, Storksen CH, Thornhill HF, Sjoen GH, Kolseth SM, Haaverstad R, Sandli OK, Softeland E. Clinical Efficacy of Combined Surgical Patient Safety System and the World Health Organization's Checklists in Surgery: A Nonrandomized Clinical Trial. JAMA Surg. 2020 Jul 1;155(7):562-570. doi: 10.1001/jamasurg.2020.0989.
Storesund A, Haugen AS, Waehle HV, Mahesparan R, Boermeester MA, Nortvedt MW, Softeland E. Validation of a Norwegian version of SURgical PAtient Safety System (SURPASS) in combination with the World Health Organizations' Surgical Safety Checklist (WHO SSC). BMJ Open Qual. 2019 Jan 7;8(1):e000488. doi: 10.1136/bmjoq-2018-000488. eCollection 2019.
Other Identifiers
Review additional registry numbers or institutional identifiers associated with this trial.
Regional Health Authority
Identifier Type: OTHER_GRANT
Identifier Source: secondary_id
REK Vest 2012/560
Identifier Type: -
Identifier Source: org_study_id
More Related Trials
Additional clinical trials that may be relevant based on similarity analysis.