Skip to main content

A systematic review and synthesis of the strengths and limitations of measuring malaria mortality through verbal autopsy

Abstract

Background

Lack of valid and reliable data on malaria deaths continues to be a problem that plagues the global health community. To address this gap, the verbal autopsy (VA) method was developed to ascertain cause of death at the population level. Despite the adoption and wide use of VA, there are many recognized limitations of VA tools and methods, especially for measuring malaria mortality. This study synthesizes the strengths and limitations of existing VA tools and methods for measuring malaria mortality (MM) in low- and middle-income countries through a systematic literature review.

Methods

The authors searched PubMed, Cochrane Library, Popline, WHOLIS, Google Scholar, and INDEPTH Network Health and Demographic Surveillance System sites’ websites from 1 January 1990 to 15 January 2016 for articles and reports on MM measurement through VA. Inclusion criteria: article presented results from a VA study where malaria was a cause of death; article discussed limitations/challenges related to measurement of MM through VA. Two authors independently searched the databases and websites and conducted a synthesis of articles using a standard matrix.

Results

The authors identified 828 publications; 88 were included in the final review. Most publications were VA studies; others were systematic reviews discussing VA tools or methods; editorials or commentaries; and studies using VA data to develop MM estimates. The main limitation were low sensitivity and specificity of VA tools for measuring MM. Other limitations included lack of standardized VA tools and methods, lack of a ‘true’ gold standard to assess accuracy of VA malaria mortality.

Conclusions

Existing VA tools and methods for measuring MM have limitations. Given the need for data to measure progress toward the World Health Organization’s Global Technical Strategy for Malaria 20162030 goals, the malaria community should define strategies for improving MM estimates, including exploring whether VA tools and methods could be further improved. Longer term strategies should focus on improving countries’ vital registration systems for more robust and timely cause of death data.

Background

Lack of valid and reliable data on malaria deaths, especially in endemic countries which house the greatest burden, continues to be a problem that plagues the global health community. In light of the recent adoption of the sustainable development goals (SDGs) and the World Health Organization’s Global Technical Strategy for Malaria 20162030 [1, 2], it presents a challenge to the community on how best to capture malaria mortality data to assess progress on the ambitious goals and targets set within these agendas. Accurate data on malaria mortality at the national and subnational levels is essential for effective policy-making and programme planning; it will also be critical for countries as they move toward low transmission or pre-elimination status to monitor and evaluate progress and to adapt programmatic strategies as the burden declines.

Measuring malaria-specific mortality at the population level is challenging due to the lack of complete vital registration systems in most low- and middle-income countries, the difficulty in clinical assessment of malaria, and the fact that most malaria deaths occur outside of the formal health care system [3,4,5]. To address this gap, the verbal autopsy (VA) method was developed to ascertain cause of death (COD) at the population level. Global and country specific data on malaria mortality is thus largely derived from incomplete vital registration data and supplemented with VA data, and in some instances inpatient mortality data, to produce estimates of the number of malaria deaths.

Verbal autopsy consists of an interview conducted with a family member or an individual familiar with the deceased using a structured questionnaire to gather information about the signs and symptoms, and their duration experienced by the deceased, and events leading up to the death. The information collected is use to determine the individual COD using the International Classification of Diseases, Tenth Edition (ICD-10) [6]. The COD is assigned either directly by a trained physician or other automated methods. Verbal autopsy has been used as a valuable interim method to provide COD data, as countries work toward improving their civil and vital registration systems.

Despite the wide use of VA, there are many recognized limitations of VA tools and methods [7,8,9,10,11]. The World Health Organization (WHO) in recent years has commissioned systematic reviews of VA tools and methods and held technical consultation meetings, in an effort to update and standardize VA methods and tools to address some of these limitations, including comparability of VA data across study sites [10,11,12,13]. These reviews however, have had a more broad focus on how best to standardize tools and methods and have not thoroughly examined the specific limitations of VA methods and tools for measuring malaria mortality. Many VA studies have noted some of the specific limitations of VA tools and methods for measuring malaria mortality [14,15,16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31,32]; however, to date no systematic review has been conducted to examine the challenges and limitations of VA for measuring malaria mortality and to determine how VA methods could be improved to provide more robust estimates of malaria mortality. A systematic review of the literature was conducted to document how VA tools and approaches have been used to measure malaria mortality and the key challenges and limitations of existing tools and methods.

Methods

The authors searched PubMed, the Cochrane Library, Popline, the WHOLIS, and Google Scholar, from 1 January 1990 to 15 January 2016. The search terms were “malaria” or “malaria mortality” and “cause specific mortality” and “verbal autopsy”/“post mortem interview”/“mortality surveillance”/“verbal post mortem.” We also searched available INDEPTH Network websites (27 websites from INDEPTH Network health and demographic surveillance system (HDSS) sites in Africa (21), Asia (5), and Oceana (1)) to identify additional programme reports, articles, and gray literature from the organization on malaria-specific mortality. References of included publications were also reviewed for other relevant studies. The inclusion criteria were publications that presented results from a VA study where malaria was an identified COD and/or publication that discussed limitations or challenges related to the measurement of malaria mortality through VA. The review was restricted to articles published in English.

Two authors independently searched the databases and websites. The titles and abstracts of the identified studies and reports were screened to determine if they met the inclusion criteria. Full texts of publications that passed the screening were reviewed to determine eligibility. A narrative synthesis of the publications that met the inclusion criteria was conducted. A narrative description was developed and information was extracted on key characteristics for each of the included publications using a standard matrix. Using this matrix, the reviewers carried out a thematic analysis of key challenges and limitations of measuring malaria mortality through VA.

Results

Overview of the inclusion strategies

The authors identified a total of 828 publications; 788 of these were identified through the database search and 40 through a review of the INDEPTH Network websites’ publications and reports. After removal of duplicates, the abstracts of 676 publications were reviewed for eligibility, and of these, 149 publications were selected for a full text review. In the full-text review of publications, 18 additional publications were identified through a review of references and 70 of the publications were excluded on the basis of non-inclusion of malaria deaths in the VA study or the publication did not discuss measurement of malaria mortality through VA. A total of 93 publications were included in the review; however, only 88 publications had the full text for review. Key information from the five publications not available for review is, therefore, unavailable and not included in the final synthesis (Fig. 1).

Fig. 1
figure 1

Flowchart showing the selection of publications on malaria mortality and verbal autopsy

Summary of articles included in the synthesis

Of the 88 publications included in the final review and synthesis, 64 were VA studies where malaria was included as a cause of death (one of which discussed the methods used in a VA validation study, but did not include results from the study). Of the 64 VA studies, 14 were VA validation studies and five were VA comparative methods studies. Nine of the publications were commentaries (4), systematic review or synthesis articles or reports discussing VA methods (4), and an editorial that discussed the issue of measurement of malaria mortality through VA. Eight of the articles presented global (4), regional (3), and country-level (1) malaria mortality estimates that drew from VA data and other sources to develop the estimates. The other publications included studies that used VA data/records to look at the effectiveness of interventions (4), the prevalence of care-seeking behavior prior to a malaria death (1), the impact of chloroquine resistance on malaria mortality (1); and the effect of misclassification bias in VA studies (1). The five publications that did not have the full text available included three VA studies and two studies that drew on VA data to assess the effectiveness of an intervention.

Key characteristics of the identified publications were extracted (Additional file 1), including the type of article; if it was a VA study or a study that used VA data, the setting/location of the study, the populations included, the sample size, the timeframe of the study, the VA instrument used in the study, the methods used for determining cause of death in the study, the reported sensitivity, specificity and positive predictive value in the study for malaria deaths, and information on or the criteria used to determine a malaria death in the study; and lastly, any challenges or limitations discussed related to the measurement of malaria mortality through verbal autopsy. Of the publications that were of VA studies, the majority were conducted in or included sites in Africa (60), while 14 of the studies included sites in Asia and 5 included sites in Central America (Mexico). Thirty of the VA studies included populations of all ages, 15 studies were specifically on children under 5 years only, seven included adults only (15 years and above), and one included only pregnant women ages 15–49. The remaining included either a specific age group or a combination of a few specific age groups. The most common method used to code the COD in VA studies was physician review (22), followed by Interpreting Verbal Autopsy Version 4 (InterVA-4) (12), while 30 studies used a combination of methods to code the COD (20). The majority of VA studies (51 of 64) did not include any information on how a malaria death was coded or the criteria used to code a malaria death; only 16 of the studies included detailed information on this, with the definition varying considerably across the studies. Of the 88 publications, 60 of them included discussions on limitations and challenges related to the measurement of malaria mortality through VA.

Varying and low levels of sensitivity and specificity of malaria verbal autopsy tools

The most commonly cited limitation of measuring malaria mortality through VA was the varying and overall low levels of sensitivity and specificity of VA tools for measuring malaria mortality [3, 14, 16,17,18,19,20,21, 23, 24, 30,31,32,33,34,35,36,37,38,39,40,41,42,43]. This is confirmed through the results from the VA validation studies; with sensitivity ranging from 19 to 75% and specificity ranging from 69 to 100%. Several reasons were noted in the literature for the low and varying sensitivity and specificity. Verbal autopsy performs well for CODs that have a distinct set of signs and symptoms such as measles and malnutrition [21]. However, for malaria, it presents symptoms that overlap with other common CODs, including acute respiratory infections (ARI) and meningitis [43,44,45,46,47,48,49,50,51,52], which can result in misclassification bias. In areas with high HIV prevalence, it was also noted that it is more difficult to accurately attribute COD to malaria or HIV due to the overlap in symptoms [15, 41, 53].

The malaria epidemiological context also influences misclassification bias, resulting in either an under or over estimation of the malaria mortality burden [14, 16, 26, 31, 43, 48, 49, 54, 55]. In high transmission areas, it was suggested that malaria mortality is overestimated due to the practice of assigning malaria as the COD for cases of acute febrile illness where no other cause is evident [14]. Many studies have attributed this as bias introduced by the experience and knowledge of the physicians coding the deaths [7, 39, 45, 47,48,49, 52, 56,57,58]. However, a few studies note the reverse finding, that the malaria mortality burden is actually underestimated in high transmission areas and overestimated in medium to low malaria prevalence areas [26, 37]. In areas where malaria is highly seasonal, this also influences the COD determination and can lead to classification bias with malaria deaths more commonly classified during the peak transmission season [46, 52, 59]. Seasonality of other diseases that have overlapping symptoms with malaria, such as meningitis, can further influence COD determination and result in classification bias [46]. Another reason noted for the varying sensitivity and specificity includes the difficulty of assigning malaria as the underlying or as an indirect cause of death, where other factors could have contributed to the death [14, 35, 53, 60, 61]. For example, a few studies noted the difficulty in distinguishing between anaemia and malaria deaths [35, 53, 60], and the under recording of anaemia deaths as a result [35, 53]. Lastly, the availability of medical information, and more specifically, information on confirmed malaria through testing is often not available in VA data [57, 62, 63].

Lack of comparability of verbal autopsy malaria mortality findings across sites

The lack of standardization in the application of VA tools and methods was another commonly cited limitation [14, 16, 18, 36, 41, 56, 64,65,66,67]. This includes differences in the format and content captured in VA questionnaires used across studies, and the specific age groups for which the questionnaires are designed [16, 64]. There are wide variations in the implementation of VA studies, including in the training provided to physicians, the type of interviewers used, respondent selection procedures, and the length of the recall period for capturing deaths [16, 52, 67]. The list of CODs and the specific coding or algorithms used to assign deaths, and specifically malaria deaths, varies substantially across VA studies [16]. VA studies also differ on whether one or more cause of death is assigned for each case and whether the narrative or open-ended section of the questionnaire is used to determine the cause of death [16, 67]. The majority of VA studies examined in this review provided limited information on the tools and methods used in the study, and specific details on how a malaria death was coded.

Inadequacy of a gold standard in comparing malaria verbal autopsy study results

Another common limitation noted is the use of hospital medical records as the gold standard for which to compare VA study results. Hospital records in the settings in which VA studies take place often have data quality challenges [36, 42, 65] and typically reflect a different population than those of community-based VA studies [16, 28, 34, 36, 47, 58, 65, 68,69,70,71]. This is particularly so for malaria, where the majority of malaria deaths occur outside of the formal health system and lack information on confirmed malaria diagnosis [63].

General limitations of verbal autopsy

Other general limitations of VA studies that were noted include the small sample sizes of studies that limit the precision of estimates [16, 19], recall bias among respondents that can result in misclassification bias [35], and the fact that many deaths in VA studies cannot be determined and are either excluded from the study (due to incomplete information) or are classified as an ‘unknown’ cause of death [39, 49, 72, 73].

Discussion

Over the past few decades VA has been increasingly used as a valuable interim measure to provide data on mortality rates and the main COD in low- and middle-income countries, where civil and vital registration systems are incomplete and lacking quality data on mortality. Thus, filling a large gap in providing essential information for effective health policy and programmatic planning, particularly in contexts where resources are very limited. VA has been widely used to measure malaria-specific mortality, particularly in sub-Saharan Africa (SSA) where the greatest burden of the disease exists and where there is the largest gap in COD data. Although it is widely used, it is generally recognized in VA studies and by the global malaria community that VA does not perform particularly well, regardless of the COD assignment methods used, for determining malaria mortality. Though, to date, no collaborative efforts have been made to thoroughly examine and address the main challenges and limitations of VA for measuring malaria mortality.

This synthesis of the literature revealed the main limitation of VA for malaria mortality measurement to be its overall low and varying sensitivity and specificity, the reasons for which are multifaceted. The nonspecific symptoms of malaria make it difficult to distinguish malaria deaths from other common illnesses, most notably acute febrile illnesses such as ARI and meningitis, thus introducing misclassification bias. Due to this, in a few VA studies reviewed, malaria deaths were lumped under the category of ‘fever’ or ‘acute febrile illness’ death [51, 74,75,76]. The underlying COD profile also influences the sensitivity and specificity. A few studies for example noted the difficulty of distinguishing malaria from HIV deaths in high HIV prevalence areas due to the overlapping symptoms, suggesting that in these contexts malaria deaths are likely to be overestimated, while HIV-related deaths are underestimated [15, 41, 53]. Due to the complex aetiology of malaria, it can also be difficult to identify whether malaria was the direct or an underlying COD, or an indirect COD. A few studies noted the difficulty in distinguishing between a malaria and anaemia death [60, 61]; in the study by Murray et al. the authors note that they redistributed a proportion of anaemia deaths to malaria deaths due to this reason. Malaria infection has also been shown to associated with an increased risk for potentially fatal invasive bacterial infections, including non-typhoidal Salmonellae [77]; in these cases, malaria will not be recorded as the COD despite its role in indirectly influencing the death. The malaria epidemiological context, including areas where malaria is highly seasonal, also influences the sensitivity and specificity of VA for malaria mortality, with potential bias introduced by physicians’ backgrounds and experience [39, 42, 45, 47,48,49, 52, 56,57,58, 61, 62]; resulting in either an under or over estimation of the malaria mortality burden.

The lack of standardization of tools and methods used in VA studies is another key challenge, as it makes comparability of malaria mortality findings across sites and over time difficult [11, 14, 36, 56, 64, 78]. This challenge is further exacerbated by the lack of detailed information provided in published studies on the tools and methods used, which was evident in this review. While the lack of standardized tools and methods is a recognized overarching issue in general for VA studies, it further complicates being able to assess from the literature what the best practices are for measuring malaria mortality through VA. For example, most VA studies in the review did not provide information on the criteria used to assign a malaria COD and for the studies that did include this information, the criteria used ranged widely across studies; thus providing little insight on the most accurate cause of death assignment for a malaria death. On the other hand, VA can still be a valuable tool for monitoring and evaluating trends in malaria mortality in specific settings over time when the same methods are applied consistently, as they are affected by the same set of biases over time [56, 79].

A number of the studies also discussed the challenge of not having a ‘true’ gold standard by which to test the performance of VA and, therefore, caution in the interpretation of validation study findings [16, 28, 34, 36, 42, 47, 58, 65, 68, 69, 71]. For malaria specifically, it is not just a challenge of incomplete and poor quality records, but in many validation sites the coverage of parasitological testing is incomplete and therefore, the malaria COD diagnosis is made without a confirmed laboratory test. The population health metrics research consortium (PHMRC) gold standard VA validation study initiated in 2005 is helping to address this issue through the development and use of stringent diagnostic criteria to identify gold standard deaths, thus providing a better understanding for VA performance for malaria mortality measurement across different COD assignment methods and guidance for future validation studies [65].

To provide more robust malaria mortality estimates moving forward, it is pertinent that the global malaria community come together to review the limitations of malaria mortality data sources and methods and define a strategy for how these methods could be improved upon. Given the significant contribution of VA data in informing global malaria mortality estimates, it will be important for the strategy to include revisiting current VA tools and methods for measuring malaria mortality to determine if updates could provide improved estimates. This could be an opportunity for the field to better refine and improve the criteria used for assigning malaria deaths in VA studies and ultimately improve the sensitivity and specificity of current VA tools. There is also a strong need for better collaboration across VA experts and transparency of methods used in VA studies to ensure better standardization of VA methods and to allow for greater comparability across study findings. Further, in view of the increasing coverage of parasitological testing in malaria endemic countries, it is possible, as shown in the PMHRC validation study, to use more stringent diagnostic criteria for assigning malaria deaths.

Lessons learned from this study should be used to inform future VA validation studies. It is also important we continue to explore new strategies. Very recently, minimally invasive tissue sampling (MITS) for autopsy has emerged as a potential new method for determining COD in developing countries where full autopsies are not possible [80,81,82]. This technique offers the potential for improved diagnostic accuracy of COD, and could potentially in the long term obviate the need for VA studies. Exploration and development of these new strategies should happen alongside longer-term efforts to improve civil and vital registration systems in low- and middle-income countries.

Conclusions

This review sheds light on the key limitations for measuring malaria mortality through VA. It also highlights the need for the global malaria community to come together to define a strategy for improving current methods for more robust measurement of malaria mortality in the future, an effort that should include exploring whether VA tools and methods can be improved. This will be pertinent to measure progress toward the ambitious malaria control and elimination goals set forth in the Sustainable Development Goals and the Global Technical Strategy for Malaria 20162030. Longer-term strategies should focus on improving countries’ vital registration systems for more accurate and timely cause of death data.

References

  1. WHO. Global technical strategy for malaria 2016–2030. Geneva: World Health Organization; 2015.

    Google Scholar 

  2. United Nations. Resolution adopted by the General Assembly on 25 September 2015: transforming our world: the 20130 Agenda for Sustainable Development. UN General Assembly: 2015; New York, USA.

  3. Ye Y, Kyobutungi C, Ogutu B, Villegas L, Diallo D, Tinto H, et al. Malaria mortality estimates: need for agreeable approach. Trop Med Int Health. 2013;18:219–21.

    Article  PubMed  Google Scholar 

  4. Snow RW. Sixty years trying to define the malaria burden in Africa: have we made any progress? BMC Med. 2014;12:227.

    Article  PubMed  PubMed Central  Google Scholar 

  5. Mathers CD, Fat DM, Inoue M, Rao C, Lopez AD. Counting the dead and what they died from: an assessment of the global status of cause of death data. Bull World Health Organ. 2005;83:171–7.

    PubMed  PubMed Central  Google Scholar 

  6. WHO. Verbal autopsy standards: the 2012 WHO verbal autopsy instrument release candidate 1. Geneva: World Health Organization, Health Metrics Network, and INDEPTH Network; 2012.

  7. AbouZahr C, Rampatige R, Lopez A, de Savigny D. When civil registration is inadequate: interim methods for generating vital statistics. Pac Health Dialog. 2012;18:215–30.

    PubMed  Google Scholar 

  8. Joshi R, Lopez AD, MacMahon S, Reddy S, Dandona R, Dandona L, et al. Verbal autopsy coding: are multiple coders better than one? Bull World Health Organ. 2009;87:51–7.

    Article  PubMed  Google Scholar 

  9. Garenne M, Fauveau V. Potential and limits of verbal autopsies. Bull World Health Organ. 2006;84:164.

    Article  PubMed  PubMed Central  Google Scholar 

  10. WHO. A brief global review of the practice of verbal autopsy. Geneva: World Health Organization; 2007.

    Google Scholar 

  11. Soleman N, Chandramohan D, Shibuya K. Verbal autopsy: current practices and challenges. Bull World Health Organ. 2006;84:239–45.

    Article  PubMed  PubMed Central  Google Scholar 

  12. WHO. Technical consultation on verbal autopsy tools: final report. Geneva: World Health Organization; 2005.

  13. WHO. Verbal autopsy standards. Ascertaining and attributing causes of death. Geneva, World Health Organization. http://www.who.int/healthinfo/statistics/verbalautopsystandards/en/. Accessed 30 May 2016.

  14. Abdullah S, Adazu K, Masanja H, Diallo D, Hodgson A, Ilboudo-Sanogo E, et al. Patterns of age-specific mortality in children in endemic areas of sub-Saharan Africa. Am J Trop Med Hyg. 2007;77(6 Suppl):99–105.

    PubMed  Google Scholar 

  15. Desai M, Buff AM, Khagayi S, Byass P, Amek N, van Eijk A, et al. Age-specific malaria mortality rates in the KEMRI/CDC health and demographic surveillance system in western Kenya, 2003–2010. PLoS ONE. 2014;9:e106197.

    Article  PubMed  PubMed Central  Google Scholar 

  16. Korenromp EL, Williams BG, Gouws E, Dye C, Snow RW. Measurement of trends in childhood malaria mortality in Africa: an assessment of progress toward targets based on verbal autopsy. Lancet Infect Dis. 2003;3:349–58.

    Article  PubMed  Google Scholar 

  17. Adazu K, Lindblade KA, Rosen DH, Odhiambo F, Ofware P, Kwach J, et al. Health and demographic surveillance in rural western Kenya: a platform for evaluating interventions to reduce morbidity and mortality from infectious diseases. Am J Trop Med Hyg. 2005;73:1151–8.

    PubMed  Google Scholar 

  18. Anker M, Black RE, Coldham C, Kalter H, Quigley MA, Ross D, et al. A standard verbal autopsy method for investigating causes of death in infants and children. Geneva: World Health Organization; 1999.

    Google Scholar 

  19. Deressa W, Fantahun M, Ali A. Malaria-related mortality based on verbal autopsy in an area of low endemicity in a predominantly rural population in Ethiopia. Malar J. 2007;6:128.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Todd JE, De Francisco A, O’Dempsey TJ, Greenwood BM. The limitations of verbal autopsy in a malaria-endemic region. Ann Trop Paediatr. 1994;14:31–6.

    Article  CAS  PubMed  Google Scholar 

  21. Snow RW, Armstrong JR, Forster D, Winstanley MT, Marsh VM, Newton CR, et al. Childhood deaths in Africa: uses and limitations of verbal autopsies. Lancet. 1992;340:351–5.

    Article  CAS  PubMed  Google Scholar 

  22. de Savigny D, Binka F. Monitoring future impact on malaria burden in sub-saharan Africa. Am J Trop Med Hyg. 2004;71(2 Suppl):224–31.

    PubMed  Google Scholar 

  23. Hyder AA, Morrow RH. Measures of health and disease in populations. In: Merson MH, Black RE, Mills AJ, editors. International public health: diseases, programs, systems, and policies. London: Jones & Bartlett, Publs; 2006. p. 1–42.

    Google Scholar 

  24. Kaatano GM, Mashauri FM, Kinung’hi SM, Mwanga JR, Malima RC, Kishamawe C, et al. Patterns of malaria related mortality based on verbal autopsy in Muleba District, north-western Tanzania. Tanzan J Health Res. 2009;11:210–8.

    CAS  PubMed  Google Scholar 

  25. Kesteman T, Randrianarivelojosia M, Mattern C, Raboanary E, Pourette D, Girond F, et al. Nationwide evaluation of malaria infections, morbidity, mortality, and coverage of malaria control interventions in Madagascar. Malar J. 2014;13:465.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Mpimbaza A, Filler S, Katureebe A, Kinara SO, Nzabandora E, Quick L, et al. Validity of verbal autopsy procedures for determining malaria deaths in different epidemiological settings in Uganda. PLoS ONE. 2011;6:e26892.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  27. Quigley MA. Commentary: verbal autopsies—from small-scale studies to mortality surveillance systems. Int J Epidemiol. 2005;34:1087–8.

    Article  PubMed  Google Scholar 

  28. Quigley MA, Chandramohan D, Rodrigues LC. Diagnostic accuracy of physician review, expert algorithms and data-derived algorithms in adult verbal autopsies. Int J Epidemiol. 1999;28:1081–7.

    Article  CAS  PubMed  Google Scholar 

  29. Quigley MA, Armstrong Schellenberg JR, Snow RW. Algorithms for verbal autopsies: a validation study in Kenyan children. Bull World Health Organ. 1996;74:147–54.

    CAS  PubMed  PubMed Central  Google Scholar 

  30. Rowe AK. Should verbal autopsy results for malaria be adjusted to improve validity? Int J Epidemiol. 2005;34:712–3.

    Article  PubMed  Google Scholar 

  31. Rowe AK, Rowe SY, Snow RW, Korenromp EL, Schellenberg JRA, Stein C, et al. Estimates of the burden of mortality directly attributable to malaria for children under 5 years of age in Africa for the year 2000. Int J Epidemiol. 2006;34:712–3.

    Article  Google Scholar 

  32. Selemani M, Mrema S, Shamte A, Shabani J, Mahande MJ, Yeates K, et al. Spatial and space-time clustering of mortality due to malaria in rural Tanzania: evidence from Ifakara and Rufiji health and demographic surveillance system sites. Malar J. 2015;14:369.

    Article  PubMed  PubMed Central  Google Scholar 

  33. Anker M. The effect of misclassification error on reported cause-specific mortality fractions from verbal autopsy. Int J Epidemiol. 1997;26:1090–6.

    Article  CAS  PubMed  Google Scholar 

  34. Chandramohan D, Maude GH, Rodrigues LC, Hayes RJ. Verbal autopsies for adult deaths: their development and validation in a multicentre study. Trop Med Int Health. 1998;3:436–46.

    Article  CAS  PubMed  Google Scholar 

  35. de Savigny D, Mayombana C, Mwageni E, Masanja H, Minhaj A, Mkilindi Y, et al. Care-seeking patterns for fatal malaria in Tanzania. Malar J. 2004;3:27.

    Article  PubMed  PubMed Central  Google Scholar 

  36. Fottrell E, Byass P. Verbal autopsy: methods in transition. Epidemiol Rev. 2010;32(1):38–55.

    Article  PubMed  Google Scholar 

  37. Lozano R, Lopez AD, Atkinson C, Naghavi M, Flaxman AD, Murray C. Performance of physician-certified verbal autopsies: multisite validation study using clinical diagnostic gold standards. Popul Health Metr. 2011;9:32.

    Article  PubMed  PubMed Central  Google Scholar 

  38. Murray CJ, Ortblad KF, Guinovart C, Lim SS, Wolock TM, Roberts DA, et al. Global, regional, and national incidence and mortality for HIV, tuberculosis, and malaria during 1990–2013: a systematic analysis for the Global Burden of Disease Study 2013. Lancet. 2014;384:1005–70.

    Article  PubMed  PubMed Central  Google Scholar 

  39. Ramroth H, Ndugwa RP, Muller O, Ye Y, Sie A, Kouyate B, et al. Decreasing childhood mortality and increasing proportion of malaria deaths in rural Burkina Faso. Glob Health Action. 2009;2(1):1909.

    Article  Google Scholar 

  40. Rowe AK, Rowe SY, Snow RW, Korenromp EL, Schellenberg JRA, Stein C, et al. The burden of malaria mortality among African children in the year 2000. Int J Epidemiol. 2006;35:691–704.

    Article  PubMed  PubMed Central  Google Scholar 

  41. Sacarlal J, Nhacolo AQ, Sigauque B, Nhalungo DA, Abacassamo F, Sacoor CN, et al. A 10 year study of the cause of death in children under 15 years in Manhica, Mozambique. BMC Public Health. 2009;9:67.

    Article  PubMed  PubMed Central  Google Scholar 

  42. Setel PW, Whiting DR, Hemed Y, Chandramohan D, Wolfson LJ, Alberti KG, et al. Validity of verbal autopsy procedures for determining cause of death in Tanzania. Trop Med Int Health. 2006;11:681–96.

    Article  PubMed  Google Scholar 

  43. Snow RW, Craig MH, Newton C, Steketee RW. The public health burden of Plasmodium falciparum malaria in Africa. Working Paper 11. Disease Control Priorities Project, Bethesda, Maryland, USA: Fogarty International Center, National Institutes of Health; 2003.

  44. Baqui AH, Black RE, Arifeen SE, Hill K, Mitra SN, Al Sabir A. Causes of childhood deaths in Bangladesh: results of a nationwide verbal autopsy study. Bull World Health Organ. 1998;76:161–71.

    CAS  PubMed  PubMed Central  Google Scholar 

  45. Becher H, Kynast-Wolf G, Sie A, Ndugwa R, Ramroth H, Kouyate B, et al. Patterns of malaria: cause-specific and all-cause mortality in a malaria-endemic area of west Africa. Am J Trop Med Hyg. 2008;78:106–13.

    PubMed  Google Scholar 

  46. Etard JF, Le Hesran JY, Diallo A, Diallo JP, Ndiaye JL, Delaunay V. Childhood mortality and probable causes of death using verbal autopsy in Niakhar, Senegal, 1989–2000. Int J Epidemiol. 2004;33:1286–92.

    Article  PubMed  Google Scholar 

  47. Hammer GP, Some F, Muller O, Kynast-Wolf G, Kouyate B. Pattern of cause-specific childhood mortality in a malaria endemic area of Burkina Faso. Malar J. 2006;5:47.

    Article  PubMed  PubMed Central  Google Scholar 

  48. im Kampe EO. Seasonal patterns of all—cause & malaria mortality in rural Burkina Faso 1998–2007. University of Heidelberg; 2012.

  49. im Kampe EO, Muller O, Sie A, Becher H. Seasonal and temporal trends in all-cause and malaria mortality in rural Burkina Faso, 1998–2007. Malar J. 2015;14:300.

    Article  Google Scholar 

  50. Jaffar S, Leach A, Greenwood A, Jepson A, Muller O, Ota M, et al. Changes in the pattern of infant and childhood mortality in upper river division, The Gambia, from 1989 to 1993. Trop Med Int Health. 1997;2:28–37.

    Article  CAS  PubMed  Google Scholar 

  51. Kante AM, Nathan R, Helleringer S, Sigilbert M, Levira F, Masanja H, et al. The contribution of reduction in malaria as a cause of rapid decline of under-five mortality: evidence from the Rufiji health and demographic surveillance system (HDSS) in rural Tanzania. Malar J. 2014;13:180.

    Article  PubMed  PubMed Central  Google Scholar 

  52. Ramroth H, Lorenz E, Rankin JC, Fottrell E, Ye M, Neuhann F, et al. Cause of death distribution with InterVA and physician coding in a rural area of Burkina Faso. Trop Med Int Health. 2012;17:904–13.

    Article  PubMed  Google Scholar 

  53. Arudo J, Gimnig JE, ter Kuile FO, Kachur SP, Slutsker L. Comparison of government statistics and demographic surveillance to monitor mortality in children less than five years old in rural western Kenya. Am J Trop Med Hyg. 2003;68(Suppl 4):30–7.

    PubMed  Google Scholar 

  54. Gray RH. Verbal autopsy: using interviews to determine causes of death in children, vol 32. Baltimore: Johns Hopkins University, School of Hygiene and Public Heath, Institute for International Programs; 1991. p. 11.

  55. Kahn K, Tollman SM, Garenne M, Gear JS. Validation and application of verbal autopsies in a rural area of South Africa. Trop Med Int Health. 2000;5:824–31.

    Article  CAS  PubMed  Google Scholar 

  56. Adjuik M, Smith T, Clark S, Todd J, Garrib A. Cause-specific mortality rates in sub-Saharan Africa and Bangladesh. Bull World Health Organ. 2006;84:181–8.

    Article  PubMed  PubMed Central  Google Scholar 

  57. Duthé G. Malaria resurgence in Senegal: measuring malaria mortality in Mlomp. Population. 2009;63:443–67.

    Article  Google Scholar 

  58. Rankin JC, Lorenz E, Neuhann F, Ye M, Sie A, Becher H, et al. Exploring the role narrative free-text plays in discrepancies between physician coding and the InterVA regarding determination of malaria as cause of death, in a malaria holo-endemic region. Malar J. 2012;11:51.

    Article  PubMed  PubMed Central  Google Scholar 

  59. Gray RH. Interview based diagnosis of morbidity and causes of death. Presented at the International Union for the Scientific Study of Population Cairo, Egypt, November 4–7; 1991. p. 50.

  60. Hamel MJ, Adazu K, Obor D, Sewe M, Vulule J, Williamson JM, et al. A reversal in reductions of child mortality in western Kenya, 2003–2009. Am J Trop Med Hyg. 2011;85:597–605.

    Article  PubMed  PubMed Central  Google Scholar 

  61. Murray CJ, Rosenfeld LC, Lim SS, Andrews KG, Foreman KJ, Haring D, et al. Global malaria mortality between 1980 and 2010: a systematic analysis. Lancet. 2012;379:413–31.

    Article  PubMed  Google Scholar 

  62. Murray CJ, Lozano R, Flaxman AD, Serina P, Phillips D, Stewart A, et al. Using verbal autopsy to measure causes of death: the comparative performance of existing methods. BMC Med. 2014;12:5.

    Article  PubMed  PubMed Central  Google Scholar 

  63. Whiting DR, Setel PW, Chandramohan D, Wolfson LJ, Hemed Y, Lopez AD. Estimating cause-specific mortality from community-and facility-based data sources in the United Republic of Tanzania: options and implications for mortality burden estimates. Bull World Health Organ. 2006;84:940–8.

    Article  PubMed  PubMed Central  Google Scholar 

  64. Mortality GBD, Causes of Death C. Global, regional, and national age-sex specific all-cause and cause-specific mortality for 240 causes of death, 1990–2013: a systematic analysis for the Global Burden of Disease Study 2013. Lancet. 2015;385:117–71.

    Article  Google Scholar 

  65. Murray CJ, Lopez AD, Black R, Ahuja R, Ali SM, Baqui A, et al. Population Health Metrics Research Consortium gold standard verbal autopsy validation study: design, implementation, and development of analysis datasets. Popul Health Metr. 2011;9:27.

    Article  PubMed  PubMed Central  Google Scholar 

  66. Setel PW, Rao C, Hemed Y, Whiting DR, Yang G, Chandramohan D, et al. Core verbal autopsy procedures with comparative validation results from two countries. PLoS Med. 2006;3:e268.

    Article  PubMed  PubMed Central  Google Scholar 

  67. Vella V, Cooperation EI, Ababa A. Potential use of verbal autopsies to record the causes of death in Ethiopia. 2010. http://www.epidemiologicalconsulting.com/pdf/z_potential_use_of_verbal_autopsies.pdf. Accessed 30 May 2016.

  68. Aleksandrowicz L, Malhotra V, Dikshit R, Gupta PC, Kumar R, Sheth J, et al. Performance criteria for verbal autopsy-based systems to estimate national causes of death: development and application to the Indian Million Death Study. BMC Med. 2014;12:21.

    Article  PubMed  PubMed Central  Google Scholar 

  69. Dhingra N, Jha P, Sharma VP, Cohen AA, Jotkar RM, Rodriguez PS, et al. Adult and child malaria mortality in India: a nationally representative mortality survey. Lancet. 2010;376:1768–74.

    Article  PubMed  PubMed Central  Google Scholar 

  70. Oti SO, Kyobutungi C. Research verbal autopsy interpretation: a comparative analysis of the InterVA model versus physician review in determining causes of death in the Nairobi DSS. Popul Health Metr. 2010;8:21.

    Article  PubMed  PubMed Central  Google Scholar 

  71. Chandramohan D, Greenwood B, Cox J, Mswia R, Setel P. Relationship between malaria endemicity and acute febrile illness mortality in children. Bull World Health Organ. 2001;79:375–6.

    CAS  PubMed  PubMed Central  Google Scholar 

  72. Awini E, Sarpong D, Adjei A, Manyeh AK, Amu A, Akweongo P, et al. Estimating cause of adult (15+ years) death using InterVA-4 in a rural district of southern Ghana. Global Health Action. 2014;7(1):25543.

    Article  Google Scholar 

  73. Bawah AA, Binka FN. How many years of life could be saved if malaria were eliminated from a hyperendemic area of northern Ghana? Am J Trop Med Hyg. 2007;77(6 Suppl):145–52.

    PubMed  Google Scholar 

  74. Chandramohan D, Setel P, Quigley M. Effect of misclassification of causes of death in verbal autopsy: can it be adjusted? Int J Epidemiol. 2001;30:509–14.

    Article  CAS  PubMed  Google Scholar 

  75. Molbak K, Aaby P, Ingholt L, Hojlyng N, Gottschau A, Andersen H, et al. Persistent and acute diarrhoea as the leading causes of child mortality in urban Guinea Bissau. Trans R Soc Trop Med Hyg. 1992;86:216–20.

    Article  CAS  PubMed  Google Scholar 

  76. Sankoh OA, Kynast-Wolf G, Kouyaté B, Becher H. Patterns of adult and old-age mortality in rural Burkina Faso. J Public Health Med. 2003;25:372–6.

    Article  PubMed  Google Scholar 

  77. Church J, Maitland K. Invasive bacterial co-infection in African children with Plasmodium falciparum malaria: a systematic review. BMC Med. 2014;12:31.

    Article  PubMed  PubMed Central  Google Scholar 

  78. Baiden F, Bawah A, Biai S, Binka F, Boerma T, Byass P, et al. Setting international standards for verbal autopsy. Bull World Health Organ. 2007;85:570–1.

    Article  PubMed  PubMed Central  Google Scholar 

  79. Setel PW, Sankoh O, Rao C, Velkoff VA, Mathers C, Gonghuan Y, et al. Sample registration of vital events with verbal autopsy: a renewed commitment to measuring and monitoring vital statistics. Bull World Health Organ. 2005;83:611–7.

    PubMed  PubMed Central  Google Scholar 

  80. Bassat Q, Ordi J, Vila J, Ismail MR, Carrilho C, Lacerda M, et al. Development of a post-mortem procedure to reduce the uncertainty regarding causes of death in developing countries. Lancet Glob Health. 2013;1:e125–6.

    Article  PubMed  Google Scholar 

  81. Castillo P, Ussene E, Ismail MR, Jordao D, Lovane L, Carrilho C, et al. Pathological methods applied to the investigation of causes of death in developing countries: minimally invasive autopsy approach. PLoS ONE. 2015;10:e0132057.

    Article  PubMed  PubMed Central  Google Scholar 

  82. Martinez MJ, Massora S, Mandomando I, Ussene E, Jordao D, Lovane L, et al. Infectious cause of death determination using minimally invasive autopsies in developing countries. Diagn Microbiol Infect Dis. 2016;84:80–6.

    Article  PubMed  Google Scholar 

Download references

Authors’ contributions

SH and YY conceived the study. SH, YE, GA, KAN and KPA conducted the literature review and synthesis of the articles. SH wrote the first draft of the manuscript. YY provided guidance throughout development of the manuscript. All authors contributed to reviewing the manuscript. All authors read and approved the final manuscript.

Acknowledgements

This paper was the result of a collaborative effort between the MEASURE Evaluation project, the Kintampo Health Research Centre, and INDEPTH Network.

This work was supported by the United States President’s Malaria Initiative (PMI) through the United States Agency for International Development (USAID) under the terms of MEASURE Evaluation cooperative agreement AIDOAAL-14-00004. MEASURE Evaluation is implemented by the Carolina Population Center at the University of North Carolina at Chapel Hill, in partnership with ICF International; John Snow, Inc.; Management Sciences for Health; Palladium; and Tulane University. Views expressed are not necessarily those of PMI, USAID, or the United States Government.

Competing interests

The authors declare that they have no competing interests.

Availability of data and materials

Not applicable.

Consent for publication

Not applicable.

Ethics approval and consent to participate

Not applicable.

Funding

Not applicable.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Samantha Herrera.

Additional file

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Herrera, S., Enuameh, Y., Adjei, G. et al. A systematic review and synthesis of the strengths and limitations of measuring malaria mortality through verbal autopsy. Malar J 16, 421 (2017). https://doi.org/10.1186/s12936-017-2071-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12936-017-2071-x

Keywords