Impact Evaluation of Maternity Homes Access in Zambia

NCT ID: NCT02620436

Last Updated: 2019-06-18

Basic Information

• Recruitment Status: COMPLETED
• Clinical Phase: NA
• Total Enrollment: 4798 participants
• Study Classification: INTERVENTIONAL
• Study Start Date: 2016-03-31
• Study Completion Date: 2018-12-31

Brief Summary

Objectives: The primary objective of this evaluation is to determine if well-constructed and well-resourced Maternity Waiting Homes are utilized by pregnant women living at distance from the health facility and are associated with improved pregnancy outcomes, particularly for women living farthest from health facilities. Findings from this evaluation will be provided to policymakers formulating policy decisions affecting the implementation of the Maternity Home Model and, if applicable, will be used as evidence for programmatic decisions made by the Ministry in deciding to take this model to scale beyond the districts proposed for this project.

Primary Impact Evaluation Question: Does the Minimum Core Maternity Home Model increase access to high quality intrapartum care among mothers living more than 10 km from the facilities compared to the standard of care?

Study Design: We propose a quasi-experimental pre-post design wherein one implementing partner (BU/ZCAHRD) will use a cluster-randomized matched pair design and one implementing partner (University of Michigan/Africare) will utilize a matched-pair, two-group comparison design with no randomization.

Methods: Using mixed-methods, we will collect data from two main sources: 1) Household Surveys and 2) In-depth Interviews. A quantitative household survey will be conducted among 2,400 randomly-selected households at both baseline (2015) and endline (2018) among recently delivered women (delivered in the last 12 months) living more than 10 km from the intervention and comparison facilities.

15% of the households enrolled in the study will be randomly selected to participate in an In-Depth Interview (IDI). Content will include perceptions of labor and delivery practices, barriers to accessing care, knowledge and awareness of MSs, perceptions of the quality of MS, perceptions of respectful care at the facility, post-natal care, costs, and perceptions of MS ownership.

Detailed Description

BACKGROUND: Although Zambia's maternal mortality rate has decreased from 591 maternal deaths per 100,000 live births since 2007 (2007 Zambia DHS), the maternal mortality rate in 2014 was unacceptably high at 398 maternal deaths per 100,000 live births. The WHO strongly recommends 'skilled care at every birth' as a strategy to reduce maternal deaths. However, it remains unanswered how to best deliver high-quality birth and postpartum care, particularly in rural and remote areas where distance and poor transportation services severely restrict access to care.

The Government of the Republic of Zambia (GRZ) is committed to improving maternal health and has initiated a large cooperative effort that aims to do so through the Ministry of Health (MOH), Ministry of Community Development, Mother and Child Health (MCDMCH), and several local and international organizations. Within this context, MHs-temporary lodgings located near health facilities with skilled care for pregnant mothers who are close to term-represent a potentially useful strategy to improve access to skilled obstetric care, particularly for those living farthest from the health facilities. MHs provide pregnant women with the option of planning ahead and traveling to health facilities well before labor begins, and have existed in various forms since the 1950s. However, there is insufficient evidence of the effectiveness of MHs in improving access to delivery services and improving maternal outcomes. While some evidence suggests MH utilization is correlated with improved maternal health outcomes (Gaym, Lori), a Cochrane review found no randomized, quasi-randomized or cluster-randomized trials assessing the effectiveness of MHs in low resource settings (van Lonkhuijzen L). Rigorous evidence on the impacts of MHs on maternal and perinatal health outcomes is needed.

The Maternity Homes Alliance (MHA) - a partnership between GRZ and implementing partners working in collaboration with academic institutions, and evaluation advisor, - seek to help women overcome the "distance problem" by implementing MHs, with the hypothesis that offering women access to quality MHs will bring women closer to facility-based delivery and postpartum care, ultimately improving health outcomes. If systematically implemented on a large scale with optimal maintenance, management and community acceptability and utilization, MHs have the potential to remove the distance barrier and increase access to safe delivery for women living farthest from the health facilities.

INTERVENTION: This project will implement high quality MHs in Southern, Eastern and Luapula Provinces in an effort to increase access to quality intrapartum care among the most vulnerable women. Following a formative evaluation that found that MHs could be an acceptable option to improve access to safe deliveries in rural Zambia, in-country partners, ZCAHRD and Africare, will implement a Core Maternity Home Intervention Model in 10 sites each, totaling 20 intervention sites.

OBJECTIVES: The main objective of the evaluation is to understand if MHs can effectively increase access to safe delivery, particularly for women living farthest from health facilities. Findings from this evaluation will be used to inform program decisions regarding implementation of the Maternity Home Model and, if applicable, to advocate for programmatic improvements as the Maternity Home Model is taken to scale beyond the districts proposed for this project.

Primary question:

1. Does the Minimum Core Maternity Home Model increase the number of facility deliveries among mothers living more than 10 km from the facilities compared to facilities with no improved maternity home services?

Secondary questions:

1. To what degree does the Minimum Core Maternity Home Model change maternal and neonatal health outcomes among those living more than 10 km from the facility compared to the standard of care?

2. How does the awareness and perceptions of MHs by communities located more than 10 km from the health facility change over the period of this study?

3. How does awareness and perceptions of HF associated safe delivery and HF delivery intention among pregnant women living in communities located more than 10 km from the health facility change over time?

4. What is the financial impact that use of the MH has on the families of women who utilize it compared to women who do not utilize it?

5. How does the perception of quality of care differ between intervention and comparison sites?

STUDY DESIGN: This is a quasi-experimental pre-post design wherein one implementing partner (BU/ZCAHRD) will use a cluster-randomized matched-pair design and one implementing partner (University of Michigan/Africare) will utilize a non-randomized matched-pair, comparison design. The framework of the study design is shown below:

Table 2: Quasi-experimental Study Design to Evaluate the Impact of MHs

BU/ZCAHRD UMich/Africare Overall R O1 X O2 NR O1 X O2 NR O1 X O2 R O1 _ O2 NR O1 _ O2 NR O1 _ O2 X = Minimum Core Maternity Home (see above) O = Observations at baseline (O1, in 2016) and endline (O2, in 2018) at intervention (X) and comparison (_) sites. R = cluster randomized; NR = not randomized.

Data will be pooled for analysis but sample sizes provide sufficient power to separately analyze the BU/ZCAHRD and UMich/Africare sites.

DATA SOURCES: We will collect data from two main sources:

1. Household Surveys

2. In-depth Interviews

Household Survey (O1, O2): A quantitative household survey will be conducted at baseline (2016) and endline (2018) among women who have delivered in the last 12 months) living more than 10 km from the intervention and comparison facilities. This approach will capture the experiences of those who utilized the facility in their catchment, other facilities, and those did who not access a facility for delivery, allowing us to more accurately estimate the impact of the MH intervention.

In-depth Interviews (IDI) (O1, O2): IDIs will be conducted among a sample of respondents identified for the household survey to gain a deeper understanding of community perceptions. Content will include perceptions of labor and delivery practices, barriers to accessing care, knowledge and awareness of MHs, perceptions of the quality of maternity homes, perceptions of respectful care at the facility, post-natal care, costs, and perceptions of MH ownership.

STUDY SITES: Selection and Randomization BU/ZCAHRD will select the 20 sites or 10 pairs matched on transfer time to CEmONC and clinic delivery volume. Pairs were randomized into the intervention group and control groups, yielding 10 intervention and 10 control sites.

UMich/Africare will purposively select 10 intervention sites and identify 10 comparison sites, matched on transfer time to CEmONC and clinic volume. This totals 20 intervention and 20 comparison sites across the Alliance. The unit of randomization (for BU/ZCAHRD) and matching (both partners) is the facility and its catchment area.

SAMPLING STRATEGY: We will employ multi-stage random sampling. First, we will randomly select a sample of 10 clusters (villages within the catchment area more than 10k from facility) from each study catchment area with probability proportionate to population size. Second, we will list all households within the selected villages, randomly order them, visit each in that order and screen for eligibility, continuing down the list until the nth eligible household in each village is identified. Third, we will randomly select, if applicable, one eligible woman from each household.

FOLLOW UP: At each observation point (O1 and O2) we will select a new cross-sectional sample using the same methodology. Therefore, households will not be followed up over time.

DATA QUALITY CONTROL STRATEGY: For quality control, first, enumerators will participate in a 5-day training. Second, enumerators will be overseen by experienced supervisors. These individuals will review surveys for quality nightly. Third, supervisors will randomly select a 5% subsample of households for each of the enumerators they oversee and revisit these households to re-conduct a subset of survey questions. Data collected by supervisors will be compared to data originally collected by enumerators to check reliability. Fourth, data will be uploaded and transferred nightly to the data analysis team in Boston (see Data Entry and Storage section below) and the analysis team will review in real time for consistency and quality.

DATA ENTRY AND STORAGE: Survey data will be captured on the tablets and saved to the tablets' internal memory. Each evening, a supervisor will review and encrypt surveys, then upload the surveys nightly to a secure server administered by SurveyCTO. The project team will download the encrypted data using the SurveyCTO Client software, and decrypt the data using a decryption key generated by the BU/ZCAHRD team themselves.

The project staff will oversee data entry, management, and storage for qualitative data. All qualitative data will be translated into English and transcribed within 1 month of being collected. Digital recorders and paper copies of qualitative notes will be kept in a locked cabinet until they are fully translated and transcribed, at which point audio files will be deleted and notes shredded. The electronic transcriptions will be kept in a password-protected file. The qualitative transcriptions will not contain identifying information, only a study id number. Only the study team will have access to identifiable quantitative and qualitative data.

SAMPLE SIZE: We will recruit 2,400 women into the survey, 1,200 from each study group per round for a study sample of 4,800 households plus 50 pilots at each round. After accounting for the clustered sampling design (ICC estimated at 0.04 based on previous work), and assuming an alpha of .05, this sample will provide us with 80% power to detect a minimum of 10 percentage point difference in the anticipated impact of the MH intervention on the primary outcome of facility delivery.

For the IDIs, we estimate a sample of 360 at baseline and endline, but will stop if we reach saturation or predictability before the full 360.

DATA ANALYSIS: All quantitative analyses will be conducted in SAS version 9.4 (SAS Institute, Cary, NC). Our quantitative analytic plan is threefold, yielding descriptive, bivariate and multivariate statistics. First, we will begin with a descriptive analysis of the sample for the household level characteristics and respondent level demographics.

Second, we will also look for differences in outcomes within the matched pairs. Categorical variables will be compared between intervention and control groups using the chi-squared test if cell sizes are sufficient or Fisher's exact test if cell sizes are small; continuous variables will be compared using t-tests if normally distributed or non-parametric Wilcoxon rank sum tests if distribution is non-normal.

Third, we will calculate crude and adjusted logistic or linear regression models depending on the outcome variable. We will calculate the relative risk or odds ratios comparing the intervention to control arms, adjusting for any imbalanced covariates.

All qualitative data will be analyzed in Nvivo 10 © (Doncaster, Australia). We will conduct a content analysis of the in-depth interview transcripts. Coding themes have been identified a priori according to the outline of the interview guide. Additional themes will be included if they emerge during analysis. We will triangulate findings with the quantitative data to identify consistencies, inconsistencies or additional themes to be explored.

Conditions

Maternal Health

Study Design

• Allocation Method: RANDOMIZED
• Intervention Model: PARALLEL
• Primary Study Purpose: HEALTH_SERVICES_RESEARCH
• Blinding Strategy: NONE

Study Groups

Core Mother Shelter Model

Existing mother shelters will be renovated, and mother shelters will be built at intervention sites, to meet the Core Mother Shelter Model. This model includes ensuring a safe infrastructure with four walls, a roof, doors and windows that lock, a toilet, running water, and beds.

Group Type: EXPERIMENTAL

Core Mother Shelter Model

Intervention Type: OTHER

1. Infrastructure, Supplies, Equipment: All MHs will have: latrines, lockable cupboards, doors, windows, lighting, mattresses, mosquito nets, cooking space and utensils, and a bathing site.

2. Policies, Management, Finances:. The policies, management, and financial structures will follow the same general principles, but will be site-specific to account for cultural variation.

3. Linkages with Health Facilities: Each MH will be operationally linked to the health facility and 1) ensure daily check-ins by a health facility staff; 2) ensure every pregnant woman has someone able to contact a staff if she is incapacitated; and 3) will orient women to procedures upon arrival. Clinical services will be conducted at the health facility.

Standard of Care

Existing mother shelters with no changes made, except to ensure that they can provide standard of care.

Group Type: NO_INTERVENTION

No interventions assigned to this group

Interventions

Core Mother Shelter Model

1. Infrastructure, Supplies, Equipment: All MHs will have: latrines, lockable cupboards, doors, windows, lighting, mattresses, mosquito nets, cooking space and utensils, and a bathing site.

2. Policies, Management, Finances:. The policies, management, and financial structures will follow the same general principles, but will be site-specific to account for cultural variation.

3. Linkages with Health Facilities: Each MH will be operationally linked to the health facility and 1) ensure daily check-ins by a health facility staff; 2) ensure every pregnant woman has someone able to contact a staff if she is incapacitated; and 3) will orient women to procedures upon arrival. Clinical services will be conducted at the health facility.

Intervention Type: OTHER

Other Intervention Names

Maternity Waiting Home

Eligibility Criteria

Inclusion Criteria

The target population includes all pregnant women within 1-2 weeks of estimated delivery date resident within the 20 intervention site catchment areas, particularly those living at the greatest distant from care (i.e. resident > 10 km from the health facility).

To insure that the facility is resourced appropriately to adequately manage obstetric complications, the study MSs will be selected from among a list of eligible facilities with a minimum standard of available care, defined as either A or B, below:

Criteria for A:

• Able to provide at least 5 of 7 BEmONC signal functions
• <2 hours travel time to a CEmONC referral facility, and
• Have a minimum of 150 deliveries per year

Criteria for B:

• At least one skilled birth attendant on staff
• Routinely provide active management of third stage of labor (AMTSL)
• No stock outs of oxytocin in the last 12 months
• No stock outs of magnesium sulfate in the last 12 months, and
• <2 hours travel time to a referral facility

• Household with someone who has delivered a baby within the past 12 months
• Respondent must be age 15 or older (emancipated minor)
• Proxy respondent (if woman deceased) must be over the age of 18
• Resident of the village identified for sampling (>10 km from the facility)

• Minimum Eligible Age: 15 Years
• Eligible Sex: FEMALE
• Accepts Healthy Volunteers: No

Sponsors

University of Michigan

OTHER

Sponsor Role: collaborator

Right to Care

OTHER

Sponsor Role: collaborator

Merck for Mothers

OTHER

Sponsor Role: collaborator

Bill and Melinda Gates Foundation

OTHER

Sponsor Role: collaborator

Boston University

OTHER

Sponsor Role: lead

Responsible Party

Nancy Scott

Assistant Professor

Responsibility Role: PRINCIPAL_INVESTIGATOR

Principal Investigators

Nancy Scott, DrPH

Role: PRINCIPAL_INVESTIGATOR

Boston University

Locations

Mbabala

Choma, , Zambia

Countries

Zambia

References

Hogan MC, Foreman KJ, Naghavi M, Ahn SY, Wang M, Makela SM, Lopez AD, Lozano R, Murray CJ. Maternal mortality for 181 countries, 1980-2008: a systematic analysis of progress towards Millennium Development Goal 5. Lancet. 2010 May 8;375(9726):1609-23. doi: 10.1016/S0140-6736(10)60518-1. Epub 2010 Apr 9.

Reference Type: BACKGROUND

PMID: 20382417 (View on PubMed)

Scheirer MA, Dearing JW. An agenda for research on the sustainability of public health programs. Am J Public Health. 2011 Nov;101(11):2059-67. doi: 10.2105/AJPH.2011.300193. Epub 2011 Sep 22.

Reference Type: BACKGROUND

PMID: 21940916 (View on PubMed)

Eckermann S, Dawber J, Yeatman H, Quinsey K, Morris D. Evaluating return on investment in a school based health promotion and prevention program: the investment multiplier for the Stephanie Alexander Kitchen Garden National Program. Soc Sci Med. 2014 Aug;114:103-12. doi: 10.1016/j.socscimed.2014.05.056. Epub 2014 Jun 2.

Reference Type: BACKGROUND

PMID: 24922607 (View on PubMed)

Perez D, Lefevre P, Castro M, Sanchez L, Toledo ME, Vanlerberghe V, Van der Stuyft P. Process-oriented fidelity research assists in evaluation, adjustment and scaling-up of community-based interventions. Health Policy Plan. 2011 Sep;26(5):413-22. doi: 10.1093/heapol/czq077. Epub 2010 Dec 12.

Reference Type: BACKGROUND

PMID: 21149346 (View on PubMed)

Rawat R, Nguyen PH, Ali D, Saha K, Alayon S, Kim SS, Ruel M, Menon P. Learning how programs achieve their impact: embedding theory-driven process evaluation and other program learning mechanisms in alive & thrive. Food Nutr Bull. 2013 Sep;34(3 Suppl):S212-25. doi: 10.1177/15648265130343S207.

Reference Type: BACKGROUND

PMID: 24261078 (View on PubMed)

Gabrysch S, Civitelli G, Edmond KM, Mathai M, Ali M, Bhutta ZA, Campbell OM. New signal functions to measure the ability of health facilities to provide routine and emergency newborn care. PLoS Med. 2012;9(11):e1001340. doi: 10.1371/journal.pmed.1001340. Epub 2012 Nov 13.

Reference Type: BACKGROUND

PMID: 23152724 (View on PubMed)

Ngoma T, Kaiser JL, Morgan AJ, Vian T, Hamer DH, Rockers PC, Sakanga V, Biemba G, Bwalya M, Scott NA. Implementation fidelity of a multisite maternity waiting homes programme in rural Zambia: application of the conceptual framework for implementation fidelity to a complex, hybrid-design study. BMJ Public Health. 2025 Jan 16;3(1):e001215. doi: 10.1136/bmjph-2024-001215. eCollection 2025.

Reference Type: DERIVED

PMID: 40017989 (View on PubMed)

Kaiser JL, Fiorillo RM, Vian T, Ngoma T, Kuhfeldt KJ, Munro-Kramer ML, Hamer DH, Bwalya M, Sakanga VR, Lori JR, Ahmed Mdluli E, Rockers PC, Biemba G, Scott NA. Qualitative application of the diffusion of innovation theory to maternity waiting homes in rural Zambia. Implement Sci Commun. 2025 Feb 4;6(1):18. doi: 10.1186/s43058-025-00696-y.

Reference Type: DERIVED

PMID: 39905510 (View on PubMed)

Lee HE, Veliz PT, Maffioli EM, Munro-Kramer ML, Sakala I, Chiboola NM, Ngoma T, Kaiser JL, Rockers PC, Scott NA, Lori JR. The role of Savings and Internal Lending Communities (SILCs) in improving community-level household wealth, financial preparedness for birth, and utilization of reproductive health services in rural Zambia: a secondary analysis. BMC Public Health. 2022 Sep 12;22(1):1724. doi: 10.1186/s12889-022-14121-9.

Reference Type: DERIVED

PMID: 36096779 (View on PubMed)

Fong RM, Kaiser JL, Ngoma T, Vian T, Bwalya M, Sakanga VR, Lori JR, Kuhfeldt KJ, Musonda G, Munro-Kramer M, Rockers PC, Hamer DH, Ahmed Mdluli E, Biemba G, Scott NA. Barriers and facilitators to facility-based delivery in rural Zambia: a qualitative study of women's perceptions after implementation of an improved maternity waiting homes intervention. BMJ Open. 2022 Jul 25;12(7):e058512. doi: 10.1136/bmjopen-2021-058512.

Reference Type: DERIVED

PMID: 35879007 (View on PubMed)

Scott NA, Kaiser JL, Ngoma T, McGlasson KL, Henry EG, Munro-Kramer ML, Biemba G, Bwalya M, Sakanga VR, Musonda G, Hamer DH, Boyd CJ, Bonawitz R, Vian T, Kruk ME, Fong RM, Chastain PS, Mataka K, Ahmed Mdluli E, Veliz P, Lori JR, Rockers PC. If we build it, will they come? Results of a quasi-experimental study assessing the impact of maternity waiting homes on facility-based childbirth and maternity care in Zambia. BMJ Glob Health. 2021 Dec;6(12):e006385. doi: 10.1136/bmjgh-2021-006385.

Reference Type: DERIVED

PMID: 34876457 (View on PubMed)

Henry EG, Ngoma T, Kaiser JL, Fong RM, Vian T, Hamer DH, Rockers PC, Biemba G, Scott NA. Evaluating implementation effectiveness and sustainability of a maternity waiting homes intervention to improve access to safe delivery in rural Zambia: a mixed-methods protocol. BMC Health Serv Res. 2020 Mar 12;20(1):191. doi: 10.1186/s12913-020-4989-x.

Reference Type: DERIVED

PMID: 32164728 (View on PubMed)

Kaiser JL, Fong RM, Ngoma T, McGlasson KL, Biemba G, Hamer DH, Bwalya M, Chasaya M, Scott NA. The effects of maternity waiting homes on the health workforce and maternal health service delivery in rural Zambia: a qualitative analysis. Hum Resour Health. 2019 Dec 4;17(1):93. doi: 10.1186/s12960-019-0436-7.

Reference Type: DERIVED

PMID: 31801578 (View on PubMed)

Lori JR, Perosky J, Munro-Kramer ML, Veliz P, Musonda G, Kaunda J, Boyd CJ, Bonawitz R, Biemba G, Ngoma T, Scott N. Maternity waiting homes as part of a comprehensive approach to maternal and newborn care: a cross-sectional survey. BMC Pregnancy Childbirth. 2019 Jul 4;19(1):228. doi: 10.1186/s12884-019-2384-6.

Reference Type: DERIVED

PMID: 31272402 (View on PubMed)

Perosky JE, Munro-Kramer ML, Lockhart N, Musonda GK, Naggayi A, Lori JR. Maternity waiting homes as an intervention to increase facility delivery in rural Zambia. Int J Gynaecol Obstet. 2019 Aug;146(2):266-267. doi: 10.1002/ijgo.12864. Epub 2019 Jun 20.

Reference Type: DERIVED

PMID: 31099092 (View on PubMed)

Scott NA, Kaiser JL, Vian T, Bonawitz R, Fong RM, Ngoma T, Biemba G, Boyd CJ, Lori JR, Hamer DH, Rockers PC. Impact of maternity waiting homes on facility delivery among remote households in Zambia: protocol for a quasiexperimental, mixed-methods study. BMJ Open. 2018 Aug 10;8(8):e022224. doi: 10.1136/bmjopen-2018-022224.

Reference Type: DERIVED

PMID: 30099401 (View on PubMed)

Related Links

http://www.un.org/millenniumgoals/maternal.shtml

United Nations Millennium Develpment Goals

Other Identifiers

H-34526

Identifier Type: -

Identifier Source: org_study_id