Critical incident audit and feedback are recommended interventions to improve the quality of obstetric care. To evaluate the effect of audit at district level in Thyolo, Malawi, we assessed the incidence of facility-based severe maternal complications (severe acute maternal morbidity (SAMM) and maternal mortality) during two years of audit and feedback.
Between September 2007 and September 2009, we included all cases of maternal mortality and SAMM that occurred in Thyolo District Hospital, the main referral facility in the area, using validated disease-specific criteria. During two- to three-weekly audit sessions, health workers and managers identified substandard care factors. Resulting recommendations were implemented and followed up. Feedback was given during subsequent sessions. A linear regression analysis was performed on facility-based severe maternal complications. During the two-year study period, 386 women were included: 46 died and 340 sustained SAMM, giving a case fatality rate of 11.9%. Forty-five cases out of the 386 inclusions were audited in plenary with hospital staff. There was a reduction of 3.1 women with severe maternal complications per 1000 deliveries in the district health facilities, from 13.5 per 1000 deliveries in the beginning to 10.4 per 1000 deliveries at the end of the study period. The incidence of uterine rupture and major obstetric hemorrhage reduced considerably (from 3.5 to 0.2 and from 5.9 to 2.6 per 1000 facility deliveries respectively).
Our findings indicate that audit and feedback have the potential to reduce serious maternal complications including maternal mortality. Complications like major hemorrhage and uterine rupture that require relatively straightforward intrapartum emergency management are easier to reduce than those which require uptake of improved antenatal care (eclampsia) or timely intravenous medication or HIV-treatment (peripartum infections).
Citation: van den Akker T, van Rhenen J, Mwagomba B, Lommerse K, Vinkhumbo S, et al. (2011) Reduction of Severe Acute Maternal Morbidity and Maternal Mortality in Thyolo District, Malawi: The Impact of Obstetric Audit. PLoS ONE 6(6): e20776. doi:10.1371/journal.pone.0020776
Editor: Peter McCulloch, University of Oxford, United Kingdom
Received: January 10, 2011; Accepted: May 11, 2011; Published: June 3, 2011
Copyright: © 2011 van den Akker et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This study was entirely self-funded. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Despite countless conferences and policy documents, an unacceptably high number of women does not survive childbirth in many low-income countries, particularly in sub-Saharan Africa . Women die at home because of delay in the decision to seek care (‘phase-I delay’), or during transport to the appropriate level of health facility (‘phase-II delay’). Moreover, even if women make it to the appropriate level of care in time, the often considerable time elapse until onset of correct treatment (‘phase-III delay’) leads to mortality or serious morbidity .
In order to improve obstetric care and reduce delay, critical incident audit and feedback have been recommended by the World Health Organization (WHO) and other institutions , . Audit can be defined as any summary of clinical performance of health care over a specified period of time, and is commonly used to identify substandard care factors including modifiable behaviors of health professionals . Combined with effective feedback to these professionals and other stakeholders, audit is suggested as a potentially useful strategy to improve health care delivery , .
Maternal and perinatal mortality reviews are currently applied in many institutions around the globe . Audit of severe acute maternal morbidity (SAMM) is increasingly perceived as a useful complementary . However, despite their widespread institutionalization, empirical evidence for benefits of audit and feedback remains limited , .
Especially in low-resource countries, which carry by far the highest burden of maternal mortality and morbidity, the effects of audit are poorly understood . In Malawi, where the maternal mortality ratio stood at a devastating 1,140 per 100,000 live births in 2008 , only one observational study suggested that audit may have contributed to a modest reduction in facility-based maternal mortality in three districts over a three-year period between 2005 and 2007 .
In Thyolo District, Malawi, systematic audit and feedback started being performed in August 2007. Evaluation of one-year audit results showed a reduction in the incidence of uterine rupture at district hospital level by 68% (from 19.2 to 6.1 per 1000 deliveries; OR 0.32, 95% CI: 0.16–0.63) . Following this positive outcome, we sought to examine whether this achievement had been sustained and quantify the effect of audit on overall district-wide facility-based maternal health outcomes over a longer period of time. This evaluation became even more important in light of a considerable increase in intrapartum care provided in district health facilities during the study period, putting the quality of care in these under-resourced sites to an additional test .
Therefore, we undertook this study to evaluate changes in incidence of facility-based maternal mortality and SAMM during a two-year period of intensive audit and feedback in the district.
Materials and Methods
The study was performed in full accordance with the guidelines for operational research of the National Research Council and the Health Sciences Research Committee of the Ministry of Health of Malawi and with the Helsinki declaration of 1975, as revised in 1983 , . Verbal approval was obtained from the National Health Sciences Research Committee from the Ministry of Health, Malawi, which ruled that formal approval was not necessary for this type of study. In addition, the National Health Sciences Research Committee as well as the District Health Office of the Ministry of Health ruled that written consent was not necessary for this type of operational research which should in fact be routine practice in any Malawian district hospital in order to monitor clinical performance . Nevertheless, verbal informed consent was obtained from all included women or their relatives (in case of maternal mortality) before collecting their information into the database. All results were de-identified and none of the information collected in the database could be traced back to any individual patient. The District Health Office of the Ministry of Health took part in the study design and ensured that the study was performed conform national guidelines.
This was a facility-based prospective cohort study.
Study period and setting
From September 1st, 2007, to September 1st, 2009, this study was performed in Thyolo District, a predominantly rural area in Southern Malawi, a very low income country in sub-Saharan Africa. The district had a population of 587 455 in 2008 and an HIV-prevalence rate of 21% in 2004 .
The publicly-funded Thyolo District Hospital is the largest health facility and most important secondary referral center in the area; 4363 deliveries were conducted in the facility in 2008. During the same year, an additional 11 556 health facility deliveries took place in 28 smaller government, mission and private facilities throughout the district, adding up to a total of 15 919 facility deliveries, almost 55% of the estimated 29 400 deliveries in the district that year (based on a birth rate of 50‰) . Between 2007 and 2009 the number of women delivering at a health facility steadily increased, probably due to the provision of culturally-sensitive non-monetary incentives. The increase was largest in peripheral primary care centers compared to the semi-urban district hospital (94% versus 38% in two years). The increase in the district hospital could be attributed primarily to increased referrals from peripheral sites .
Due to a very low number of physicians in the district, clinical officers –a cadre of “non-physician clinicians”- perform the bulk of clinical work, including major surgery such as caesarean section . With limited availability of registered nurse/midwives, their workload is high and most deliveries are conducted by lower nursing cadres. These clinical and nursing cadres with less professional training have expressed particular interest in continuous professional development at the workplace such as provided by audit and feedback sessions .
We included all cases of maternal mortality and SAMM that occurred in any of the district health facilities into the study which was labeled “4M-study”: maternal mortality and morbidity in Thyolo District. All mortality and morbidity cases were included regardless of additional maternal or gestational factors (e.g. underlying condition of the mother, gestational age at the time of the complication, multiple gestation etc.).
We used the definition of maternal mortality as given in the 10th version of the International Classification of Diseases: the death of a woman while pregnant or within 42 days of termination of pregnancy, irrespective of the duration and site of the pregnancy, from any cause related to or aggravated by the pregnancy or its management but not from accidental or incidental causes .
At present, there is no universally accepted case definition of SAMM , . In the literature, three types of inclusion criteria for SAMM are reported: (1) organ-system failure based criteria; (2) management-based criteria (e.g. emergency hysterectomy and/or admission into an intensive care unit); (3) disease-specific criteria , –. The WHO is in the process of comparing these three types of criteria for SAMM in order to arrive at a universally acceptable definition . In Malawian district hospitals without intensive care units or extensive diagnostic capacity, disease-specific criteria are considered to be the most convenient and comprehensive .
Therefore, we chose disease-specific criteria and included pregnant and recently delivered women up to 6 weeks postpartum with one or more of the following entities:
- uterine rupture, defined as the occurrence of clinical symptoms (pain, fetal distress, acute loss of contractions, hemorrhage) or intrauterine fetal death that led to laparotomy, at which the diagnosis was confirmed, or laparotomy for uterine rupture after vaginal birth ; to this definition we added rupture confirmed by autopsy or clinical symptoms with a high suspicion of rupture in case of death;
- eclampsia or severe pre-eclampsia, defined as any case of pre-eclampsie with a maternal indication for termination of pregnancy;
- major obstetric hemorrhage (including hemorrhage from complicated abortions and ectopic pregnancies) defined as a fulfilled need for transfusion of at least two units of 450 milliliters of whole blood (we adjusted the commonly cited criterion of four units because of scarcity of blood for transfusion in the local setting) or a hemoglobin level below 6 g/dl measured after vaginal bleeding or an estimated blood loss of more than 1 liter;
- severe obstetric and non-obstetric peripartum infections, defined as all infections for which intravenous antibiotics or intravenous anti-malarials were prescribed or surgical treatment was performed, as well as neoplasms resulting primarily from HIV-infection (e.g. Kaposi's sarcoma and HIV-associated lymphoma);
- any other complication the clinician considered severe, with the qualification ‘severe’ confirmed by at least two senior clinicians.
Data collection and analysis
Patients were identified and included into the study by clinicians and nurses who received assistance from medical students from Leiden University, the Netherlands, during daily ward rounds in the obstetric department and thrice-weekly rounds in the women's medical and surgical wards. Each inclusion was also verified with a senior clinician. Upon discharge or upon confirmation of death of any hospitalized patient, medical records (antenatal card, labor graph and medical case file) of each woman were again screened for relevant diagnoses according to SAMM criteria. Staff responsible for including women into the study were unaware of the specific objective to evaluate overall trends in maternal outcome.
We postulated that cases seen at the district hospital (the main referral institution for primary level facilities in the district) comprised the overwhelming majority of SAMM and maternal mortality cases occurring in district health facilities. According to district health protocols, all women with severe maternal complications should be referred to secondary level for appropriate observation and treatment. In order to justify our hypothesis and control for underreporting at primary care level, we searched records of ten smaller primary care centers for cases fitting inclusion criteria at the end of the study period. We were not able to identify any further inclusions from records in these facilities other than cases that had been referred to the district hospital and that had already been included into the study at that level.
All relevant data were entered into a Microsoft Excel database and, based on the assumption that audit and feedback would account for a decrease in maternal complications, linear regression analyses were performed with IBM® SPSS® Statistics 17.0 software package with “quarter” as independent variable, and maternal complications, maternal mortality and SAMM per 1000 deliveries per quarter as dependent variables. We also assessed trends for each individual SAMM diagnosis and for the number of HIV-positive women included into the study.
Audit sessions were held every two to three weeks, involving members of each cadre of clinical staff, as well as members of the District Health Management Team. External gynecologist-obstetricians were occasionally invited to join for audit. During audit sessions, cases of maternal mortality and SAMM were presented by hospital staff on a rotational basis and discussed by all available health workers and managers, usually between 30 and 45 staff. The hospital team of clinicians and nurses who were taking part in the audit sessions and assessed clinical care remained almost unchanged throughout the two-year study period. Those responsible for supporting departments such as the pharmacy and the transport system joined from time to time. Intention was to evaluate all cases which senior clinicians or audit organizers considered to be of educational value. Occasionally, audits were also held at smaller peripheral health centers.
The benchmark against which substandard care was measured were national and district health office protocols, as well as WHO-protocols on all relevant conditions , . If health workers identified substandard care factors, they were asked to recommend measures for improvement. Implementation of these recommendations, depending on the nature of each suggested measure, was performed by the management team as well as by individual professionals. Evaluation of these initiatives took place on a regular basis during subsequent audit sessions.
During the two-year study period, 386 women with serious pregnancy-related complications presented to the district hospital: 46 women died and 340 sustained SAMM, giving a case fatality rate of 11.9% (46 out of 386 cases) and a morbidity/mortality-ratio of 7.4.
In the 340 women who sustained SAMM (101 (30%) of whom were HIV-positive), 375 SAMM diagnoses were made: 31 (8.3%) of these women had two inclusion diagnoses, and two women had three. These 375 SAMM diagnoses were comprised of: 119 (32%) severe infections or HIV-related complications, 119 (32%) cases of major obstetric hemorrhage, 75 (20%) cases of eclampsia or severe pre-eclampsia, 43 (11%) uterine ruptures, and 19 (5%) other severe maternal complications according to the clinician (Figure 1, Box S1).
Figure 1. Diagnoses comprising SAMM; n = 375.doi:10.1371/journal.pone.0020776.g001
Of the 119 women with infection-related morbidity (55 (46%) of whom were HIV-positive), 81 had an obstetric infection (36 (44%) HIV-positive), 37 a non-obstetric infection (18 (49%) HIV-positive) and one was diagnosed with HIV-related Kaposi 's sarcoma. Of the 119 cases of major obstetric hemorrhage, eight (7%) were caused by ectopic pregnancies and seven (6%) by complications of abortion.
Of the 46 women who died, 23 (50%) died of infection or severe complication of HIV-infection, ten (22%) of major obstetric hemorrhage, five (11%) of uterine rupture and three (7%) of eclampsia. Two died of other causes (sudden cardiac arrest during caesarean section and hepatocellular carcinoma) and in three cases the cause of death remained unclear (Figure 2). Of all 46 women who died, 19 (41%) were HIV-positive. Of the 23 women who died from infectious causes, eight (35%) had obstetric infections of whom four were HIV-positive, two HIV-negative and two had an unknown HIV-status. Thirteen (57%) women died from non-obstetric infections (of whom nine women were HIV-positive, three HIV-negative and one had an unknown HIV-status) and two from HIV-related Kaposi 's sarcoma.
Figure 2. Maternal mortality and associated causes; n = 46.doi:10.1371/journal.pone.0020776.g002
Case fatality rates were 16% (23/142) for severe infection (9% for obstetric infection and 26% for non-obstetric infection), 10% for uterine rupture, 8% for major obstetric hemorrhage, 4% for (severe pre-) eclampsia. In HIV-positive women who sustained infection, the case fatality rates were 10% for obstetric infection (4/40) and 33% for non-obstetric infection (9/27).
In total, 45 cases were audited in plenary with hospital staff: 24 cases of maternal mortality and 21 cases of SAMM. Practically all hospital clinicians (medical doctors and clinical officers) and nurses had themselves been involved in the management of at least one of the audited cases. In 30 cases (67%) more than half of the auditors assessed care to have been below acceptable standards. A selection of substandard care factors identified at health facility level is shown in table 1; a selection of recommendations put forward by staff in table 2.
Table 1. Selection of substandard care factors identified.doi:10.1371/journal.pone.0020776.t001
Table 2. Selection of recommendations by staff.doi:10.1371/journal.pone.0020776.t002
The following actions were taken based on these recommendations: (1) formal classroom refresher training on labor graph use, emergency obstetric care and labor monitoring was given twice during the study period with assistance from Médecins Sans Frontières Belgium, Malawi mission, Thyolo project (MSF); a selected group of health workers attended a drill course in advanced life-support in obstetrics (ALSO); ward supervision by senior clinicians was scaled up; (2) updated and appropriate district protocols were posted in each health facility (where unavailable or outdated WHO-protocols were used), presence of these protocols was checked during quarterly supervision rounds with additional logistics and human resources provided by MSF; (3) regular on-job coaching was provided including bedside teachings by medical doctors, quality and attendance of morning handovers was enhanced, follow-up charts for hypertensive disorders were implemented (courtesy Dr. T. Meguid, ) and their use was monitored by ward supervisors; (4) if audit resulted in recommendations for the primary care level, the relevant health centers were visited and given direct personal feedback by senior health workers who were usually members of the district health management team; health centers were also assessed during the regular supervision rounds for appropriate record keeping and the availability of material resources and other requirements for maternal care; (5) ambulance use became more stringently monitored, with help from MSF, but increasing the efficacy of the transport system remained a challenge due to regular breakdown of vehicles and a lack of resources for maintenance and repair; (6) standards-of-practice were more closely monitored by senior clinicians and district health management and oral and written warnings were given in case of misconduct; (7) visits to critical patients were performed at least daily, and usually twice daily, by senior clinicians, including on weekend days.
Table 3 shows the number of women who died or sustained SAMM per quarter throughout the study period. A linear regression identified a reduction of 3.1 inclusions for severe maternal complications (SAMM and mortality combined) per 1000 deliveries (regression coefficient −0.382; p = 0.01) from 13.5 to 10.4 complications per 1000 deliveries over the two-year period in which 33 254 facility-deliveries occurred in the district. This means that in (0.5 * 3.1 * (33 254/1000) = ) 52 women severe maternal complications were averted. The number of HIV-positive women did not change significantly (regression coefficient −0.196; p = 0.254). Linear regression analyses for facility-based maternal deaths and the number of women with SAMM showed downward trends for both (regression coefficients −0.189 per 1000 deliveries per quarter (p = 0.07) and −0.194 per 1000 deliveries per quarter (p = 0.08) respectively) (Figure 3).
Figure 3. Women with severe maternal complications.doi:10.1371/journal.pone.0020776.g003
Table 3. Number of study inclusions per quarter.doi:10.1371/journal.pone.0020776.t003
The numbers of diagnoses made in each diagnostic category per quarter, combining SAMM and mortality, are shown in table 4. There were significant reductions in hemorrhages from 5.9 to 2.6 per 1000 deliveries (regression coefficient −0.411; p = 0.006) and uterine ruptures from 3.5 to 0.2 per 1000 deliveries (regression coefficient −0.417; p = 0.036). No significant trends were found for (pre-) eclampsia (regression coefficient 0.108; p = 0.330) or peripartum infections (regression coefficient −0.078; p = 0.62).
Table 4. Number of diagnoses per category per quarter (SAMM and maternal mortality combined).doi:10.1371/journal.pone.0020776.t004
Uterine ruptures at district hospital level further decreased to 3.7 per 1000 hospital deliveries (excluding deliveries at peripheral primary care centers) in the second year of study, from 6.1 per 1000 after audit in the first year and an initial pre-audit incidence of 19.2 per 1000 hospital deliveries .
To our knowledge this is one of the first studies quantifying improvements in maternal outcome during a prolonged period of systematic audit on a district-wide scale in sub-Saharan Africa , , . Although the study design does not allow for the establishment of a definite causal relationship between the observed reduction in maternal complications and obstetric audit, our findings add importantly to the limited body-of-evidence indicating that audit and feedback may reduce severe maternal complications at district level. In light of the absence of randomized trials and given the challenges to document and report complications in under-resourced settings, we advocate the continued implementation of obstetric audit based on these findings , . The morbidity/mortality-ratio of 7.4 is similar to several other international studies, although this ratio is highly variable between different studies as a result of the absence of international SAMM criteria .
A number of possible study limitations merit discussion. First, our study setting is a real-time district health care system rather than a controlled study environment. Therefore, our findings do not allow for the identification of a causal relationship between audit and maternal outcome. However, since audit and feedback were the most significant injection into the quality of obstetric care in the district, the progressive and significant decline in severe maternal complications is likely to be a result of their implementation. Other factors are unlikely to have had significant impact. The socioeconomic and demographic characteristics of the district population were unlikely to have changed much over these two years.
Second, it is possible that the eagerness among staff to identify and include cases over time decreased. This is unlikely, however, due to the fact that the health worker responsible for study inclusions rotated on a two- to three-monthly basis. Moreover, these data collection staff were unaware of the objective to perform a trend analysis and were always supervised by the same team of dedicated senior clinicians.
Nevertheless, it is important to note that our SAMM and mortality figures are minimum figures. Like in any other operational research study underreporting may have occurred , particularly as some women may have had complications in peripheral facilities and failed to be referred or adequately recorded. Due to human resource and logistic constraints it was not possible to perform a detailed assessment of all delivery records in all peripheral facilities to acquire a better idea of underreporting at primary care level. However, from the sample assessed it appeared that underreporting was low. Also, it is unlikely that the frequency of underreporting would have changed much throughout the study period. In a similar nation-wide study from The Netherlands, underreporting was 2 and 3% for uterine rupture and eclampsia respectively, and 29% for major hemorrhage . In our single-location study setting, the underreporting of hemorrhage is likely to be lower. We think it is unlikely that more than one or two cases of SAMM would have been underreported every quarter, and underreporting of mortality is even more unlikely. Such low rates of underreporting would not alter our conclusions.
The idea that audit and feedback were the main driver behind the decline in severe maternal complications is enhanced by the finding that the major reductions were found in the incidence figures for major obstetric hemorrhage and uterine rupture. These are the complications on which improved intrapartum care will have the most direct impact. Since audit and feedback focused primarily on improved intrapartum care and health worker performance during obstetric emergencies, it is not surprising that the declines in major hemorrhage and uterine rupture were significant and contrasted with the trends for eclampsia and peripartum infection.
Prevention of eclampsia will require increased uptake of appropriate antenatal care. Both an increased uptake and an improved quality of antenatal care are notoriously difficult to achieve. Lack of health worker time, irregular antenatal attendance and faulty blood pressure equipment prohibited significant improvements in antenatal blood pressure monitoring in Thyolo.
Since the HIV-prevalence among women with peripartum infections was high (almost 50%), it is likely that the incidence of these infections will reduce as uptake of HIV-treatment increases. In Thyolo, antiretroviral therapy (ART) was scaled up since 2003 with a positive impact on the survival of HIV-positive (pregnant) women as well as on the availability of health workers , . The scaling up of ART was completed by August 2007 (before the beginning of the study period) and sustained thereafter without a further increase in ART-uptake . Based on this information, it is likely that the most significant reduction in peripartum infections due to increased uptake of HIV-treatment took place already before the onset of this study (this is confirmed by anecdotal evidence from district health workers). The impact of HIV-treatment on a further reduction of peripartum infections is likely to become evident over a longer study period with a larger study sample.
In conclusion, audit of SAMM can be a useful tool for district health workers and managers, with the capacity to tangibly improve maternal outcome. By addressing health professionals' behavior audit has the capacity to avoid phase-III delay. If health managers and those responsible for transport are part of audit, phase-II delay may also be reduced. And eventually, if improvements in obstetric care are noticed throughout the community, audit may even positively influence care-seeking behavior and lead to a decrease of phase-I delay . However, the impact of audit on pregnancy outcome as well as on staff motivation and performance warrants additional quantitative as well as qualitative research. Further scrutiny of the role of infectious causes including HIV in maternal health is also required.
Rest group inclusions.
We thank all health staff and managers in Thyolo District for their tremendous efforts towards improving the quality of obstetric care. We thank Dr. Uwe Graf and Dr. Tarek Meguid for their involvement in audit in the district. Finally, we acknowledge Mr. George Khanyizira for helpful comments during the revision stage.
Conceptualized this study: TvdA J. van Roosmalen. Contributed to study design and took part in data collection: TvdA J. van Rhenen BM KL SV. Performed the analysis: TvdA J. van Rhenen. Took a lead in organizing audit sessions which were authorized by BM: TvdA KL SV. Wrote the first draft of the manuscript: TvdA. Edited the manuscript: J. van Rhenen BM KL SV J. van Roosmalen. Contributed significantly to the intellectual content of this paper: TvdA J. van Rhenen BM KL SV J. van Roosmalen.
- 1. Hogan MC, Foreman KJ, Naghavi M, Ahn SY, Wang M, et al. (2010) Maternal mortality for 181 countries, 1980–2008: a systematic analysis of progress towards Millennium Development Goal 5. Lancet 375: 1609–23.
- 2. Thaddeus S, Maine D (1994) Too far to walk: maternal mortality in context. Soc Sci Med 38: 1091–110.
- 3. Gulmezoglu AM, Say L, Betran AP, Villar J, Piaggio G (2004) WHO systematic review of maternal mortality and morbidity: methodological issues and challenges. BMC Med Res Methodol 4: 16.
- 4. Pattinson RC, Say L, Makin JD, Bastos MH (2005) Critical incident audit and feedback to improve perinatal and maternal mortality and morbidity. Cochrane Database Syst Rev CD002961.
- 5. Jamtvedt G, Young JM, Kristoffersen DT, O'Brien MA, Oxman AD (2006) Audit and feedback: effects on professional practice and health care outcomes. Cochrane Database Syst Rev CD000259.
- 6. Shankar A, Bartlett L, Fauveau V, Islam M, Terreri N (2008) Delivery of MDG 5 by active management with data. Lancet 371: 1223–4.
- 7. Kongnyuy EJ, Leigh B, van den Broek N (2008) Effect of audit and feedback on the availability, utilisation and quality of emergency obstetric care in three districts in Malawi. Women Birth 21: 149–55.
- 8. Van den Akker T, Mwagomba B, Irlam J, van Roosmalen J (2009) Using audits to reduce the incidence of uterine rupture in a Malawian district hospital. Int J Gynecol Obstet 107: 289–94.
- 9. Van den Akker T, Radge G, Mateyu A, Mwagomba B, Bemelmans M, et al. (2011) Can non-monetary incentives increase health facility deliveries? The experience in Thyolo District, Malawi. Int Health 3: 66–68.
- 10. National Health Sciences Research Committee, Government of Malawi (2001) Summary Guidelines for Writing a Research Proposal.
- 11. National Research Council of Malawi, Government of Malawi (2002) Procedures and Guidelines for the Conduct of Research in Malawi.
- 12. National Statistical Office (2005) Malawi Demographic and Health Survey 2004. Government of Malawi, Lilongwe.
- 13. Manzi M, Zachariah R, Teck R, Buhendwa L, Kazima J, et al. (2005) High acceptability of voluntary counselling and HIV-testing but unacceptable loss to follow up in a prevention of mother-to-child HIV transmission programme in rural Malawi: scaling-up requires a different way of acting. Trop Med Int Health 10: 1242–50.
- 14. Mullan F, Frehywot S (2007) Non-physician clinicians in 47 sub-Saharan African countries. Lancet 370: 2158–63.
- 15. Bakker W, van den Akker T, Mwagomba B, Khukulu R, van Elteren M, et al. (2011) Health workers' perceptions of obstetric critical incident audit in Thyolo District, Malawi. Submitted for publication.
- 16. World Health Organization (2007) International Statistical Classification of Diseases and Related Health Problems, 10th revision.
- 17. Pattinson RC, Hall M (2003) Near misses: a useful adjunct to maternal death enquiries. Br Med Bull 67: 231–43.
- 18. Penney G, Brace V (2007) Near miss audit in obstetrics. Curr Opin Obstet Gynecol 19: 145–50.
- 19. Say L, Pattinson RC, Gulmezoglu AM (2004) WHO systematic review of maternal morbidity and mortality: the prevalence of severe acute maternal morbidity (near miss). Reprod Health 1: 3.
- 20. Mantel GD, Buchmann E, Rees H, Pattinson RC (1998) Severe acute maternal morbidity: a pilot study of a definition for a near-miss. Br J Obstet Gynaecol 105: 985–90.
- 21. Waterstone M, Bewley S, Wolfe C (2001) Incidence and predictors of severe obstetric morbidity: case-control study. BMJ 322: 1089–93.
- 22. Baskett TF, Sternadel J (1998) Maternal intensive care and near-miss mortality in obstetrics. Br J Obstet Gynaecol 105: 981–4.
- 23. Filippi V, Ronsmans C, Gohou V, Goufodji S, Lardi M, et al. (2005) Maternity wards or emergency obstetric rooms? Incidence of near-miss events in African hospitals. Acta Obstet Gynecol Scand 84: 11–6.
- 24. Say L, Souza JP, Pattinson RC, WHO working group on maternal mortality and morbidity classifications (2009) Maternal near-miss – Towards a standard tool for monitoring quality of maternal health care. Best Pract Res Clin Obstet Gynaecol 23: 287–96.
- 25. Oladapo OT, Sule-Odu AO, Olatunji AO, Daniel OJ (2005) “Near-miss” obstetric events and maternal deaths in Sagamu, Nigeria: a retrospective study. Reprod Health 2: 9.
- 26. Zwart JJ, Richters JM, Ory F, de Vries JI, Bloemenkamp KW, et al. (2008) Severe maternal morbidity during pregnancy, delivery and puerperium in the Netherlands: a nationwide population-based study of 371,000 pregnancies. BJOG 115: 842–50.
- 27. WHO, UNFPA, UNICEF, World Bank (2006) Pregnancy, Childbirth, Postpartum and Newborn Care. A Guide for Essential Practice. Geneva.
- 28. World Health Organization (2003) Managing Complications in Pregnancy and Childbirth. A Guide for Midwives and Doctors. Geneva.
- 29. Drost E, van Lonkhuijzen LR, Meguid T, Landis Lewis D, Zeeman GG (2010) Implementing safe motherhood: a low-cost intervention to improve the management of eclampsia in a referral hospital in Malawi. BJOG 117: 1553–7.
- 30. Dumont A, Gaye A, de Bernis L, Chaillet N, Landry A, et al. (2006) Facility-based maternal death reviews: effects on maternal mortality in a district hospital in Senegal. Bull World Health Organ 84: 218–24.
- 31. Mbaruku G, Bergström S (1995) Reducing maternal mortality in Kigoma, Tanzania. Health Policy Plan 10: 71–8.
- 32. Wagaarachchi PT, Graham WJ, Penney GC, McCaw-Binns A, Yeboah Antwi K, et al. (2001) Holding up a mirror: changing obstetric practice through criterion-based clinical audit in developing countries. Int J Gynecol Obstet 74: 119–30.
- 33. Zachariah R, Harries AD, Ishikawa N, Rieder HL, Bissell K, et al. (2009) Operational research in low-income countries: what, why, and how? Lancet Infect Dis 9: 711–7.
- 34. Bemelmans M, van den Akker T, Ford N, Philips M, Zachariah R, et al. (2010) Providing universal access to antiretroviral therapy in Thyolo, Malawi through task shifting and decentralization of HIV/AIDS care. Trop Med Int Health 15: 1413–1420. doi:10.1111/j.1365-3156.2010.02649.x.
- 35. Bemelmans M, van den Akker T, Pasulani O, Tayub NS, Hermann K, et al. (2011) Keeping health staff healthy: evaluation of a workplace initiative to reduce morbidity and mortality from HIV/AIDS in Malawi. J Int AIDS Soc 14: 1.