- Open Access
From intervention to impact: modelling the potential mortality impact achievable by different long-lasting, insecticide-treated net delivery strategies
Malaria Journal volume 11, Article number: 327 (2012)
The current target of universal access to long-lasting, insecticide-treated nets (LLIN) is 80% coverage to reduce malaria deaths by 75% by 2015. So far, campaigns have been the main channel for large-scale delivery of LLINs, however the World Health Organization has recommended that equal priority should be given to delivery via routine antenatal care (ANC) and immunization systems (EPI) to target pregnant women and children from birth. These various channels of LLIN delivery are targeted to children of different ages. Since risk of mortality varies with child age and LLIN effectiveness declines with net age, it was hypothesized that the age at which a child receives a new LLIN, and therefore the delivery channel, is important in optimizing the health impact of a net.
A simple dynamic mathematical model was developed of delivery and impact of LLINs among children under five years of age and their household members, incorporating data on age-specific malaria death rates, net use by household structure, and net efficacy over time.
The presented analysis finds that supplementing a universal mass campaign with extra ANC delivery would achieve a 1.4 times higher mortality reduction than campaign delivery alone, reflecting that children born in the years between campaigns would otherwise have access to old nets or no nets at an age of high risk. The relative advantage of supplementary ANC delivery is still present though smaller if malaria transmission levels are lower or if there is a strong mass effect achieved by mass campaigns.
These results indicate that LLIN delivery policies must take into account the age of greatest malaria risk. Emphasis should be placed on supporting routine delivery of LLINs to young children as well as campaigns.
Long-lasting, insecticide-treated nets (LLINs) are one of the most efficacious preventive interventions against malaria morbidity and mortality available and form a cornerstone of the Roll Back Malaria (RBM) Partnership’s scaling-up for impact strategy to reduce malaria-related mortality by 75% from 2000 levels by 2015. To achieve this level of impact, RBM has set the target of reaching and sustaining 80% universal coverage with LLINs, meaning that 80% of all members of populations at risk of malaria should be sleeping under an ITN. Although this represents a move away from the previous emphasis on targeting pregnant women and children under five years, these vulnerable groups are still a priority for control programmes.
The RBM strategic plan recommends that the 80% universal coverage target is achieved using a combination of campaigns and continuous channels such as routine antenatal clinics (ANC) and the expanded programme of immunization (EPI) for LLIN delivery, the so-called “catch-up” and “keep-up” approach. According to the 2011 World Malaria Report, 38 African countries have adopted a policy of LLIN distribution through ANC clinics, 29 through EPI clinics, and 36 through mass campaigns (not mutually exclusive figures). In practice, largely due to infrastructural challenges and equity concerns, significant emphasis has so far been placed on mass campaigns through which hundreds of millions of LLINs have been distributed in sub-Saharan Africa since 2002.
Despite these tremendous efforts, emerging data indicate that use of LLINs is not sustained at high levels over time. For example, in Togo and Sierra Leone, the percentage of children under five sleeping under a net dropped to around 50% a year after mass distribution campaigns, and was only 25-30% 18 months later[5, 6]. In other countries such as Rwanda and Kenya, use has remained constant for a longer period after an initial dropout, albeit only half or less of children were using LLINs, which still falls considerably short of the 80% coverage target. Routine delivery can achieve high coverage among vulnerable groups, for example, a study of LLINs distributed free through ANC in one district in Uganda showed 99% retention and use seven months after distribution. Household ownership and use of LLINs by children under five both approximately doubled to around 80% and 60%, respectively, following free distribution to infants at completion of their EPI schedule in Malawi; no significant improvement in either indicator was seen in a comparison district.
Nationally representative data on LLIN ownership and utilization used to measure progress towards the RBM targets is collected via standard RBM malaria modules included in Demographic and Health Surveys (DHS), UNICEF Multiple Indicator Cluster Surveys (MICS) and Malaria Indicator Surveys (MIS). However, questions on the source of LLINs being used by household members is a relatively recent addition and very few countries, therefore, have data on the relative contribution of campaigns and specific routine or continuous delivery channels (e g, ANC, EPI, school- or community-based delivery) to LLIN ownership. Thus, although the RBM strategic plan calls for a combination of routine and campaign delivery, there are currently few publicly documented studies or datasets from which strategy and implementation questions can be answered.
Coverage achieved by different delivery systems will influence the potential impact on mortality that LLIN programmes can have, likewise the well-documented discrepancy between ownership and use. Universal campaigns can at least initially achieve high coverage across the population, reducing transmission and potentially achieving high vector mortality, thereby protecting even those in the community not sleeping under nets. However, in addition to coverage, the timing at which LLINs reach children may also have important implications for optimizing mortality impact since risk of mortality and LLIN effectiveness are not constant parameters over time: risk of death from malaria tends to decrease with a child’s age in areas of high transmission, while the mortality burden may peak in older age groups as malaria transmission intensity decreases; and an LLIN gradually loses insecticide and gains holes, making it less effective over time. This study therefore hypothesized that the greatest potential impact on mortality will be achieved by covering children with a new LLIN at the age that they are most vulnerable. This may have implications for the optimal choice of delivery system or the delivery system mix.
It is clear from available evidence that campaigns alone are not currently achieving or sustaining the 80% targets for LLIN use[5, 13, 14]. Conversely, it is unclear how routine delivery can be optimized to complement campaigns, as recommended by RBM. In the context of the Millennium Development Goals (MDG), there is a need to investigate potential achievements beyond improving universal ownership and use of LLINs towards impact on under-five mortality. To answer these questions in the absence of complete empirical data, a simple mathematical model has been designed that uses the best available data to make predictions about the expected impact of different LLIN distribution strategies. In addition to assessing which distribution strategies could maximize mortality impact, the model also explores the potential mortality impact per LLIN delivered, which is an intermediate step towards cost-effectiveness and value for money. Efficiency is increasingly important as malaria-endemic countries and their major health donors face increasing financing constraints for health programmes. For example after years of increase, global funding for malaria levelled off in 2010 compared to 2009.
A similar modelling approach to the Lives Saved Tool (LiST) model was adopted, where the protective effect of interventions is applied to annual mortality figures to calculate number of deaths prevented. A model was developed describing ownership and use of LLINs among children under five years old and their household members, with an LLIN being received from either routine delivery systems that focus specifically on children under-five (ANC or EPI) or a mass distribution campaign. The impact of LLINs on under five-year-old, malaria-specific, mortality rate over time is estimated over 15 years starting in 2012. Outcomes of interest were computed in six-month time steps: malaria mortality, net distribution, and changes in net efficacy over time (unlike a full transmission model which would need a much shorter time step). Model input parameters are based on data from a number of African countries representing different malaria transmission profiles on demographics, net use in relation to household size and structure, net efficacy and its decline over time. What follows is an overview of the model parameters and construction; further details of the model and equations are given in Additional file1.
Model population demographics
The under five-year-old population was modelled in six-month age bands. Three different distributions of age-specific death rates were explored within this group, representing high, medium and low malaria transmission. For the high transmission scenario, age-specific malaria mortality rates averaged across five sites in sub-Saharan Africa were used, where malaria mortality peaks in the youngest children and declines as children age towards five years (Figure1a). These rates were reported per 13 weeks in the first two years of life and per 26 weeks thereafter. For the scenario of medium transmission levels, the malaria-specific death rate distribution identified in a recent review in two medium transmission intensity sites with seasonal transmission was used (Figure1a). For low transmission settings there is little data on malaria mortality, therefore the age-distribution of malaria-related hospital admissions among under-fives in five sites was used as a proxy in order to test a scenario in which malaria mortality would peak at an older age. For low and medium transmission settings absolute malaria mortality rates in the under five-year-old age group were estimated from Rowe et al.. The age-specific death rates and the proportion of children in each age band were assumed to remain constant over time. While immunity to malaria was not explicitly incorporated in the model, the effects of immunity on age patterns of malaria mortality are implicit in the mortality data from endemic areas. It was decided not to model changes in immunity due to the uncertainties in its effects and timescales, although this would be an interesting future question to explore.
Demographics in older children and adults are not explicitly modelled but coverage and use of LLINs among this group as a whole is tracked in order to model the potential mass effect in the total population acting upon children under five years (see below).
LLIN impact on mortality
Use of a new LLIN is assumed to reduce malaria mortality by 55%. It is assumed that this relative reduction is constant across age groups in children under five and across transmission intensity settings. A decline in efficacy of the LLIN over time due to decay of the insecticide and incremental damage resulting in holes is modelled. Based on available field data for LLINs, efficacy remains high for two to three years then declines more rapidly (Additional file1: Figure S2). The proportion of deaths averted was assumed to decline proportionately with LLIN efficacy. LLINs were assumed to have a constant impact within each six-month time period, with their efficacy equal to that expected midway through the six-month interval. Loss of nets was modelled as a constant probability of discard over time, with an average LLIN lifespan of three years and a maximum of five years, which is broadly in line with field observations although there are variations between areas[13, 21].
Four different delivery strategies for LLIN distribution are included in the model: giving an LLIN (i) to pregnant women at ANC clinic attendance; (ii) to infants attending EPI (routine delivery); or distributing LLINs via mass distribution campaigns, involving (iii) children under five only (targeted campaign); or, (iv) the whole population (universal campaign). Each delivery strategy may be implemented alone or in combination. The assumptions associated with each strategy are described as follows.
Routine delivery strategies
ANC delivers a LLIN to the mother during pregnancy. It is assumed for simplicity that the LLIN is not used until the child is born, i e, a LLIN delivered through ANC is assumed to be zero months old when the child is zero months old. This analysis, therefore, focuses only on the direct protective effect to the newborn infant after birth, not the protective effect on mothers during the pregnancy and associated protection for the unborn infant.
In the model, LLINs delivered via EPI are received by the infant at age six months. With the exception of BCG vaccination, which is scheduled to be administered at birth, EPI visits are scheduled from one to nine months. However, based on a multi-country analysis of actual timing of EPI attendance it is assumed that a high proportion of infants are brought late for their first EPI visit, or do not receive an LLIN until their second EPI visit due to imperfect distribution, giving an average age of six months when an LLIN is received. Once an ANC or EPI LLIN delivery programme has started, coverage is modelled as being constant over time.
Mass distribution campaigns
A targeted campaign delivers one LLIN to each child under five, while a universal campaign delivers two LLINs to each household. Campaigns are carried out every three years.
LLIN ownership by individuals and by households
Average LLIN ownership over time was calculated both for children in each six-month age group among the under-fives, and as a total by household, according to the combined coverage of all the delivery strategies described above (see also, Additional file1). Although children may not personally be given an LLIN via ANC, EPI or a targeted campaign, the model allows for the fact that they may have access to one owned by their household. The analysis was stratified by the number of under-fives in the household. The probability of owning zero, one, or two or more LLINs at each time was calculated for an individual child based on nets obtained from ANC, EPI or targeted campaign delivery channels (Additional file1: Figure S1). The analysis was stratified by the age of the net. Any child in a household owning more than one net was assumed to be using the newest net.
When combining ANC and EPI coverage it was assumed that access to these routine services was not independent, based on data from recent DHS conducted in sub-Saharan Africa (Additional file1: Table S2)[25, 26]. It was assumed that routine and campaign coverage were independent of each other.
Household LLIN ownership (0, 1, 2+) was calculated and stratified by the number of children under five living in the household (0, 1, 2, or 3+) and the age of the newest net. The probability of a child belonging to a household with a given number of under-five children was set according to the household structure recorded in the Tanzania DHS survey in 2005 (Additional file1: Table S3), since the net use data (Additional file1: Table S4) was also from Tanzania. Household LLIN ownership depends on the probability of having under-five children who have received LLIN(s) through ANC, EPI and/or targeted campaigns, and the probability of the household having received LLINs through a universal campaign (Additional file1: Figure S3). Ownership of LLINs from other sources such as schools, community-based strategies and the private sector is not considered.
Use of LLIN
Data on the reported proportion of individuals sleeping under an LLIN according to the number of children under five present in the household and the number of LLINs owned, was taken from the 2008 household survey of the Tanzania National Voucher Scheme, a detailed dataset available to the authors (Additional file1: Table S4). Use of LLINs by under-five children was higher if the household owned multiple LLINs, and if there were fewer other under-five children in the household. Each child was no more likely to use their ‘own’ net than another net owned by the household. It was assumed that the efficacy of the LLIN in reducing mortality was reduced proportionately with use.
Increased vector mortality resulting from the presence of LLINs in a community can result in an overall reduction in infectious biting, leading to reduced child mortality among individuals not sleeping under an LLIN as well as those directly protected[29, 30]. This ‘mass effect’ has been observed in some trials but not in others. Since this parameter has large uncertainty different scenarios were explored in sensitivity analyses.
Number of LLINs owned and use in individuals of all ages was computed as a weighted average, incorporating household structure and its influence on LLIN use (Additional file1: Tables S3 and S4). This analysis was stratified by the age of the net, assuming that everyone in the household uses the newest LLIN. Although there is some evidence that older children and adults would not use the newest nets, this behaviour was not included since the only influence of these older age groups on our outcome of interest, under-five mortality, is via mass effect, which was varied in sensitivity analysis. Mass effect was modelled as a reduction in mortality rate among LLIN non-users achieved by local LLIN coverage among other individuals. The relationship between coverage and mass effect is uncertain and therefore three scenarios were explored (Additional file1: Figure S4): (i) a mass effect is seen at low LLIN coverage (as suggested by mathematical models e g); (ii) there is almost no mass effect until LLIN coverage is very high; and, (iii) no mass effect. The maximum reduction in mortality among non-users of LLINs achieved by the mass effect was the same as achieved among LLIN users by direct protection.
Simple model: individual LLIN ownership by individual LLIN delivery channel
Initially, a simplified version of the model was explored to contrast routine vs campaign delivery strategies in the absence of any other LLINs in the household or mass effect. In this calculation, impact is considered over a five-year period in time and it is assumed either that 80% of newborns have received an LLIN from a routine source each year, or that 80% of under-fives received an LLIN from a targeted campaign at the start of the period. To ensure similar numbers of LLINs are distributed in each scenario, it was assumed that there was no repeat campaign delivery during the five-year period, although for the full simulations that follow a three-year campaign cycle was used. Discard of nets is included, and net use is assumed constant at 60% of nets owned.
Figure1 demonstrates how the potential number of preventable deaths essentially depends on when a new LLIN is given in relation to the age of greatest risk of malaria mortality. LLINs delivered to infants through routine services give the greatest efficacy in the youngest age groups, which then declines over time due to loss of efficacy as the net ages and due to discard of nets (Figure1B). The average efficacy of LLINs among the population of under-five children delivered through a one-off targeted campaign increases with the age of the child (Figure1C). This is because if the campaign is only carried out every five years (as in this initial simple version of the model), only one in five children will receive an LLIN while still under one year of age. Younger children will then age into the older groups whilst still owning the net. There would be benefits of campaign nets among children over five but the focus of this analysis is only on the under-fives.
Routine LLIN delivery at birth predicts more deaths averted among under-fives than a campaign LLIN delivery in high and medium transmission settings (Figure2A and2B), while in a low transmission scenario both delivery methods are estimated to have a very similar effect (Figure2C). This is because for high and medium levels of malaria transmission intensity, a greater proportion of under-five deaths coincide with the period of greatest average LLIN coverage and efficacy for an LLIN delivered at birth (Figure2). The ratio of under-five malaria deaths averted per LLIN delivered through routine delivery vs campaign delivery decreases with transmission intensity (from 2.21 at high transmission intensity to 1.31 and 1.04 at medium and low transmission intensities, respectively) reflecting the shift in risk of malaria mortality to older age groups. However, sharing of LLINs among members of the household and mass effect of the intervention may affect these comparisons of routine vs campaign delivery strategies, and these factors are therefore incorporated in the analysis that follows.
Predicted mortality impact of individual LLIN delivery channels incorporating household structure
The effects of household structure on ownership and use of LLINs by under fives in the household were incorporated to generate the full model. The number of malaria deaths averted per 1,000 children under five every six months and the cumulative under-five deaths averted per 1,000 LLINs delivered were calculated for each delivery scenario. All children were included in these calculations whether they received an LLIN or not. In the base case, the universal target of 80% coverage (taken here to be ownership of 1+ LLINs) was assumed for each delivery channel and any potential mass effect on the vector population was ignored (Figure3). For the campaign delivery channels, the mortality impact measures are smoothed to provide the mean across the three-year peak and trough campaign cycle.
In all malaria transmission settings, the pattern of malaria deaths averted for routine delivery channels shows a gradual increase initially as infants are covered with an LLIN and age into older age groups, then reaches equilibrium once the first infants to receive the intervention are five years old. The level of this equilibrium and the relative impact of LLINs delivered via ANC compared to EPI differ by transmission intensity, reflecting the different age patterns of malaria mortality. For example, in the high transmission setting, 1.47 deaths per 1,000 children could be averted per six months by LLINs delivered through ANC and used from birth, compared to 1.35 by LLINs delivered through EPI at six months of age (Figure3Ai); this is because in a high transmission setting, it is assumed that EPI delivery would miss a vulnerable period during the first six months of life. For areas of medium or low transmission, the mortality impact is greater for LLINs delivered through EPI than those delivered through ANC (Figures3Bi and 3Ci), reflecting the greater mortality risk for slightly older children, although this analysis does not include the indirect benefits of protecting pregnant women by ANC delivery.
The pattern for campaign delivery demonstrates three-yearly cycles of peaks in deaths averted immediately following the campaign, followed by troughs as the efficacy of the LLINs declines and more children are born into the cohort without LLINs. Universal campaigns are predicted to have a slightly higher mortality impact than targeted campaigns (Figures3Ai, 3Bi and 3Ci) due to the higher number of LLINs delivered; however, the impact per net is lower although the difference is not very large (Figures3Aii, 3Bii and 3Cii). Both universal and targeted campaign delivery channels show a smaller impact per LLIN delivered than the routine channels. In a high transmission setting, the difference is considerable, with about half the number of deaths among under-fives averted per LLIN delivered by campaign compared to those delivered through ANC or EPI (Figure3Aii). This pattern is true for all transmission settings (Figures3Bii, 3Cii). However, campaign nets would have a greater effect on mortality among the over fives, which is not quantified here.
Sensitivity analysis: impact of mass effect
The impact of mass effect on predicted number of deaths averted in a high transmission setting was explored 15 years post-intervention when smoothed mortality impact has reached a steady equilibrium. In the scenario where mass effect was present only at high levels of LLIN use, the predicted impact was almost identical to the base case of no mass effect (Figure4A and4B). This is because even when coverage in terms of delivering nets is 80%, net discard and lack of net use reduce the potential for mass effect.
In the scenario where a strong mass effect was present at lower levels of LLIN use, the predicted mortality impact was considerably greater when compared to the scenario without any mass effect (Figure4A). However, the relative impact of routine vs campaign delivery strategies is only slightly reduced with increasing mass effect. For example, with no mass effect the predicted mean cumulative number of deaths averted per 1,000 LLINs delivered through ANC is 2.13 times greater than for universal campaigns, while with mass effect at low LLIN coverage, the ratio is 1.92 (Figure4B). In the model this is because the campaign delivery system results in peaks and troughs in coverage among the population over time, and is able to achieve a mass effect on the vector population during the peak coverage, while routine delivery channels achieve a medium and constant level of coverage, which has less mass effect on the vector population. Similar patterns of predicted mortality impact are found for medium and low transmission settings when the two different patterns of mass effect are explored (results not shown).
Predicted mortality impact of combinations of routine and campaign LLIN delivery channels
Different combinations of routine and campaign delivery channels were explored to predict the potential impact of LLIN delivery strategies under different operational conditions. “High” coverage was set at 80% ownership of one or more nets delivered through the specified delivery channel to reflect the RBM targets for universal coverage; “low” coverage was set at 50% ownership to reflect results reported in the literature from evaluations of campaign and routine delivery programmes. Of particular current interest to policy makers is the magnitude of potential added value if routine continuous LLIN delivery is added to regular universal or targeted campaigns. Three combinations of coverage were therefore explored: high campaign with high routine; low campaign with high routine; high campaign with low routine; these were compared to three-yearly universal campaigns conducted without any routine distribution. In a high transmission intensity setting, adding ANC delivery to a universal campaign results in a 1.4-fold increase in deaths averted compared to campaign delivery alone (Figure5). The relative impact of adding ANC delivery to a universal campaign vs a universal campaign on its own is lower as the assumed level of mass effect increases (Figure5A). For example, where there is mass effect at low LLIN coverage levels, there is only a 1.1-fold additional effect of adding ANC vs campaign only. This is because the campaign has a greater impact on its own when there is strong mass effect.
While the absolute number of deaths averted per 1,000 children is always predicted to increase if multiple delivery channels are modelled (higher numbers of nets are delivered, resulting in higher household LLIN ownership which increases net use) (Figure5A), impact on deaths averted per 1,000 LLINs delivered decreases due to some overlap in coverage (Figure5B). Similar patterns were found when transmission intensity was varied.
Higher coverage of routine LLIN delivery channels, whether in combination with low or high universal campaign coverage, maintains a greater number of deaths averted between campaigns (Figure5B).
Similar patterns were found for the predicted impact of different combinations of delivery channels in areas of medium and low malaria transmission, although total malaria mortality is lower and so the numbers of deaths averted are fewer (results not shown). There were two differences of note. Firstly, in both medium and low transmission scenarios, LLINs delivered through EPI had a greater potential impact than those delivered through ANC, reflecting the greater risk of malaria mortality in older age groups. Secondly, adding ANC delivery to campaign delivery gave a slightly smaller relative gain in low to medium settings although the difference was not great. For example, ANC added to a campaign still increased the number of deaths averted 1.3-fold at low transmission (vs 1.4-fold in a higher transmission scenario).
This model supports the hypothesis that the maximum impact of LLINs in terms of reduction in under-five mortality will be achieved if a child receives and uses a new LLIN nearest to the age at which they are at greatest risk of dying from malaria. If delivering LLINs through two different channels, then a combination of one routine delivery channel that gives LLINs to infants together with a targeted or universal campaign is predicted to achieve optimal impact, since new nets reach both younger and older children. This analysis found that delivering nets through additional channels in any combination of ANC, EPI and a targeted or universal campaign always prevented a higher number of deaths (i e, saturation of LLINs in the community was not predicted). If considering ‘efficiency’ where the impact on mortality is presented in relation to the number of LLINs delivered, delivery of a very large number of nets will improve mortality outcomes but reduce efficiency since there will be some overlap in coverage. The balance between effectiveness and efficiency presents a dilemma for control programmes and ministries of health. This model predicts the greatest efficiency for delivery of LLINs through ANC or EPI if only one delivery channel is used; however these routine delivery systems alone do not achieve high enough coverage. Maximum effectiveness is achieved by delivering through as many channels as possible. Perhaps the compromise is LLIN delivery through one routine channel, the choice of which will depend upon context in terms of transmission intensity, together with regular campaigns, which would achieve good levels of effectiveness for a medium level of efficiency.
Nevertheless, the cost per LLIN delivered for each delivery system combination has to be considered. Provider-side financial cost per treated net delivered through routine ANC at district scale ranged from US$7.64 in Kenya to US$8.83 in Uganda and US$8.20 in Burkina Faso. National-level distribution through ANC in Eritrea had an estimated financial cost of US$10.67 per treated net. Provider-side financial cost per treated net delivered through a district-scale targeted campaign ranged from US$3.71 in Tanzania to US$11.53 in Ghana and $10.88 in Zambia, where treated net delivery was integrated with immunization campaigns and US$8.30 in Uganda where LLINs were delivered through a stand-alone targeted campaign. Note, all figures are adjusted for inflation and are presented in 2010 US$. Although difficult to ascertain with confidence due to methodological differences in the studies, the data suggest that LLIN delivery costs are comparable across delivery channels; national-level routine net distributions in Eritrea and Malawi suggest that there may be economies of scale[34, 39]. So far there are no published studies of the costs of universal campaigns, which represent a relatively recent shift in policy. Similarly, the authors are not aware of data on costs and effects of combinations of delivery channels
Equity should also be considered, and evidence suggests that the same children may be missed by all interventions due to low socio-economic status or living in remote areas that may be underserved even by mass campaigns. Although socio-economic equity tends to increase with LLIN coverage and will become less of an issue as coverage reaches over 80%, sustained coverage of this magnitude is still elusive in most countries. It was considered that ANC and EPI attendance are not independent, with mothers more likely to attend both ANC and EPI or neither, however it was assumed that LLIN delivery through routine and campaign channels is independent, which may not be correct, particularly if routine health facilities are utilized for mass campaign distribution. This assumption was made in large part due to a lack of empirical evidence on the level of overlap between children or households reached by routine and campaign LLINs; to overcome this limitation requires data on source of each LLIN in a household, not currently collected in a standard manner by nationally representative surveys. Furthermore correlations between individuals in a household in terms of net receipt or use were not considered.
The results presented here support the RBM-recommended strategy of a combination of routine and campaign LLIN delivery. However, the focus over the last few years has been on campaigns and the process of ‘catch up’ to progress towards the universal coverage goal. Reasonable results have been shown for a number of routine delivery strategies[7, 8, 28, 34], although progress towards ownership and use targets is inevitably slower than that achieved by mass campaign distributions, reflecting the complexity of delivering interventions through the infrastructure of a health system. Although many countries have policies for delivery of LLINs through ANC and/or EPI, it is not clear that the policies are effectively implemented in all countries. The model predicts that without the contribution of routine LLINs then the mortality impact achievable in the under-five group by campaigns alone is less impressive, particularly in the years between campaigns, and achievement of the mortality MDG becomes less likely. More information is needed on the facilitating factors and barriers to successful LLIN distribution through routine channels. In addition, the question remains of how to reach the children likely to be missed by both routine and campaign channels; any LLIN delivery strategy is likely to need some mechanism of extended outreach for covering hard-to-reach individuals and communities[40, 42].
This analysis used a simple model, which has the advantage of greater transparency and fewer assumptions about uncertain factors, but also has limitations. For example, the data used to model household structure and its influence on net use is specific to Tanzania and this may show different patterns in other countries with alternative household structures; it would be of interest to explore the effect of altering these parameters on model predictions in future analyses. The model also does not allow for changing immunity profiles as a result of LLIN introduction, which may shift mortality burden to older age groups. This factor was not included because the timescale over which immunity is lost is highly uncertain, and therefore any model dependent on this would be extremely reliant on which assumptions were made. So far there is no evidence that LLINs do shift mortality to older ages[43–45]. However if such a change did occur, having good coverage of mass campaigns in combination with routine services would be especially important to ensure older as well as younger children access new and efficacious nets. Benefits to members of the population over five years old are not quantified, which may be important with declining malaria transmission levels in many countries. However the results are valid for under five-year-olds, and the decision to focus on this group reflects the importance of health impact for children under five in the early randomized controlled trials that demonstrated the potential of insecticide-treated nets as a highly effective malaria control tool, and the continued MDG focus on reducing child mortality as well as focus of health indicators on the under fives. The focus on under-fives has particular implications for the interpretation of the predicted impact of targeted campaigns, where further benefit was not tracked once the child is older than five years, nor use of the LLIN by others in the household after this time. Furthermore, the focus on under-five mortality only may underestimate the benefit of universal campaigns in comparison to campaigns targeted to the under fives. Ideally the model would be fitted to mortality reductions observed over time in one or more large-scale LLIN delivery programmes. However, a suitable dataset would require detailed data on LLIN distributions, household ownership, usage and mortality over time, which to our knowledge is not available in any existing dataset.
A constant relative risk of malaria mortality among LLIN users vs non-users was assumed throughout the under-five cohort, as supported by evidence from an intervention trial. However in a different trial, insecticide-treated nets appeared to have a larger effect among younger children (<3 years). If this is the case, the results presented in this analysis would underestimate the difference between the impact of ANC and EPI, compared to campaign delivery. This analysis also does not quantify benefits to the mother (or newborn) due to prevention of malaria in pregnancy by the use of an LLIN and, therefore, the benefit of ANC delivery is likely to be underestimated. The use of LLINs during pregnancy has been shown to increase mean birth weight and reduce the risk of miscarriages or stillbirth. Although maternal malaria appears to influence the risk of infant mortality, this relationship is complex and the true magnitude of an effect or the potential reduction in infant mortality that may be achievable by LLIN use during pregnancy is unclear[19, 49]. Therefore, these factors were not included in the current model in order to avoid the introduction of additional uncertainty and complexity.
One of the arguments for the expansion of LLIN delivery to all age groups rather than only the biologically vulnerable is the potential reduction in transmission and related health burden at the community level (the mass effect), which has been demonstrated by field data[30, 50] and supported by mathematical models[29, 51]. The inclusion of mass effect in this model goes some way to investigating the influence of universal coverage strategies on predicted health impact. Nevertheless, uncertainties remain around the threshold of LLIN use that is needed to achieve benefits for non-users and the present model predictions were sensitive to the inclusion and pattern of mass effect. The magnitude of impact was larger and the difference in impact between routine and campaign delivery was smaller when mass effect was included. More empirical field data is needed to understand the magnitude of benefits for non-users at different levels of LLIN use.
There is some evidence that the proportional reduction in all-cause under-five mortality achieved by insecticide-treated nets is higher at low transmission intensities but this variation is not well quantified and therefore was not included. While the exact mortality rate ratio affects the estimate of the number of deaths averted, it does not affect comparison of the relative impact of different delivery strategies. Malaria mortality is notoriously difficult to measure, since malaria symptoms resemble other illnesses and malaria may exacerbate other health conditions, causing indirect deaths; therefore, while the parameters in this model are based on detailed reviews[11, 17–19], the absolute number of deaths prevented should be interpreted cautiously. Nonetheless, this analysis should provide a robust comparison of different strategies and broadly contrast areas where malaria deaths peak in younger vs older children. We assumed homogeneous conditions across the modelled population, for example regarding transmission intensity and use of nets. To capture a more realistic heterogeneous population, for example to model potential impact of campaigns targeted at particular geographical areas, it would be necessary to vary these factors in order to represent sub-populations of interest.
Previous mathematical models have examined the effects of LLINs on malaria transmission at a population level, using a full transmission model framework and focusing on reductions in prevalence of infection and effects on the vector population[51–53]; different modes of delivery and lifespan and efficacy of nets have also been considered. In this analysis a simpler framework is used and focus is specifically on mortality outcomes and the influence of overlap in net efficacy and age-specific mortality patterns within a vulnerable group, the under fives. Future work will incorporate these factors and outcomes within a full transmission model framework, enabling exploration of a range of outcomes in different age groups and the influence of dynamic changes in immunity and mortality impact of LLINs over time as transmission is reduced.
Mathematical modelling confirms that in order to maximize the number of deaths of children under five that can be averted by LLINs, delivery through routine ANC and/or immunization services is necessary in addition to delivery through campaigns. Regardless of the level of mass effect, average cumulative health impact (mean proportion of deaths averted per 1,000 LLINs delivered) was greater with LLINs delivered to an infant through ANC or EPI than with LLINs delivered through campaigns alone. This reflects that when a new LLIN is delivered to a child at their age of greatest risk of malaria mortality, the period of greatest vulnerability in the child coincides with the period of greatest protective efficacy in the net. Strong emphasis should be placed on supporting routine delivery of LLINs and not focusing resources purely on campaigns. A transition from a campaign focus to one balanced with routine service delivery will require a well-coordinated and funded effort between national programmes and their partners to assure well-functioning infrastructure for routine delivery is in place. More lessons need to be collated and capacity strengthened for effective delivery of LLINs through routine channels.
Lengeler C: Insecticide-treated bed nets and curtains for preventing malaria. Cochrane Database Syst Rev. 2004, 2: CD000363-
RBM: Global strategic plan: Roll back malaria 2005–2015. 2005, Geneva: Roll Back Malaria Partnership
Webster J, Lines J, Smith L: Protecting all pregnant women and children under five years living in malaria endemic areas in Africa with insecticide treated mosquito nets. 2005, Geneva: Roll Back Malaria
WHO: World Malaria Report 2011. 2011, Geneva: World Health Organisation
WHO: World Malaria Report 2009. 2009, Geneva: World Health Organisation
Wolkon A, Eng J, Terlouw D: Nine-month post campaign community-based cross-sectional ITN coverage survey. 2006, Atlanta: CDC
Kolaczinski JH, Kolaczinski K, Kyabayinze D, Strachan D, Temperley M, Wijayanandana N, Kilian A: Costs and effects of two public sector delivery channels for long-lasting insecticidal nets in Uganda. Malar J. 2010, 9: 102-
Mathanga DP, Luman ET, Campbell CH, Silwimba C, Malenga G: Integration of insecticide-treated net distribution into routine immunization services in Malawi: a pilot study. Trop Med Int Health. 2009, 14: 792-801.
Webster J, Kweku M, Dedzo M, Tinkorang K, Bruce J, Lines J, Chandramohan D, Hanson K: Evaluating delivery systems: complex evaluations and plausibility inference. Am J Trop Med Hyg. 2010, 82: 672-677.
Eisele TP, Keating J, Littrell M, Larsen D, Macintyre K: Assessment of insecticide-treated bednet use among children and pregnant women across 15 countries using standardized national surveys. Am J Trop Med Hyg. 2009, 80: 209-214.
Abdullah S, Adazu K, Masanja H, Diallo D, Hodgson A, Ilboudo-Sanogo E, Nhacolo A, Owusu-Agyei S, Thompson R, Smith T, Binka FN: Patterns of age-specific mortality in children in endemic areas of sub-Saharan Africa. Am J Trop Med Hyg. 2007, 77: 99-105.
Kilian A, Byamukama W, Pigeon O, Atieli F, Duchon S, Phan C: Long-term field performance of a polyester-based long-lasting insecticidal mosquito net in rural Uganda. Malar J. 2008, 7: 49-
Garcia-Basteiro AL, Schwabe C, Aragon C, Baltazar G, Rehman AM, Matias A, Nseng G, Kleinschmidt I: Determinants of bed net use in children under five and household bed net ownership on Bioko Island, Equatorial Guinea. Malar J. 2011, 10: 179-
West PA, Protopopoff N, Rowland MW, Kirby MJ, Oxborough RM, Mosha FW, Malima R, Kleinschmidt I: Evaluation of a national universal coverage campaign of long-lasting insecticidal nets in a rural district in north-west Tanzania. Malar J. 2012, 11: 273-
WHO: World Malaria Report 2011. Book World Malaria Report 2011. 2011, City: World Health Organisation
Eisele TP, Larsen DA, Walker N, Cibulskis RE, Yukich JO, Zikusooka CM, Steketee RW: Estimates of child deaths prevented from malaria prevention scale-up in Africa 2001–2010. Malar J. 2012, 11: 93-
Carneiro I, Roca-Feltrer A, Griffin JT, Smith L, Tanner M, Schellenberg JA, Greenwood B, Schellenberg D: Age-patterns of malaria vary with severity, transmission intensity and seasonality in sub-Saharan Africa: a systematic review and pooled analysis. PLoS One. 2010, 5: e8988-
Rowe AK, Steketee RW: Predictions of the impact of malaria control efforts on all-cause child mortality in sub-Saharan Africa. Am J Trop Med Hyg. 2007, 77: 48-55.
Eisele TP, Larsen D, Steketee RW: Protective efficacy of interventions for preventing malaria mortality in children in Plasmodium falciparum endemic areas. Int J Epidemiol. 2010, 39 (Suppl 1): i88-i101.
Habluetzel A, Diallo DA, Esposito F, Lamizana L, Pagnoni F, Lengeler C, Traore C, Cousens SN: Do insecticide-treated curtains reduce all-cause child mortality in Burkina Faso?. Trop Med Int Health. 1997, 2: 855-862.
Kilian A, Byamukama W, Pigeon O, Gimnig J, Atieli F, Koekemoer L, Protopopoff N: Evidence for a useful life of more than three years for a polyester-based long-lasting insecticidal mosquito net in Western Uganda. Malar J. 2011, 10: 299-
Marchant T, Hanson K, Nathan R, Mponda H, Bruce J, Jones C, Sedekia Y, Mshinda H, Schellenberg J: Timing of delivery of malaria preventive interventions in pregnancy: results from the Tanzania national voucher programme. J Epidemiol Community Health. 2011, 65: 78-82.
Clark A, Sanderson C: Timing of children's vaccinations in 45 low-income and middle-income countries: an analysis of survey data. Lancet. 2009, 373: 1543-1549.
Tsuang A, Lines J, Hanson K: Which family members use the best nets? An analysis of the condition of mosquito nets and their distribution within households in Tanzania. Malar J. 2010, 9: 211-
Carlson M, Smith Paintain L, Bruce J, Webster J, Lines J: Who attends antenatal care and expanded programme on immunization services in Chad, Mali and Niger? the implications for insecticide-treated net delivery. Malar J. 2011, 10: 341-
Measure-DHS. Demographic and Health Surveys.http://www.measuredhs.com/,
National Bureau of Statistics (Tanzania), ORC Macro: Tanzania Demographic and Health Survey 2004–05. 2005, Tanzania: National Bureau of Statistics and ORC Macro, Dar es Salaam
Hanson K, Marchant T, Nathan R, Mponda H, Jones C, Bruce J, Mshinda H, Schellenberg JA: Household ownership and use of insecticide treated nets among target groups after implementation of a national voucher programme in the United Republic of Tanzania: plausibility study using three annual cross sectional household surveys. BMJ. 2009, 339: b2434-
Killeen GF, Smith TA, Ferguson HM, Mshinda H, Abdulla S, Lengeler C, Kachur SP: Preventing childhood malaria in Africa by protecting adults from mosquitoes with insecticide-treated nets. PLoS Med. 2007, 4: e229-
Hawley WA, Phillips-Howard PA, ter Kuile FO, Terlouw DJ, Vulule JM, Ombok M, Nahlen BL, Gimnig JE, Kariuki SK, Kolczak MS, Hightower AW: Community-wide effects of permethrin-treated bed nets on child mortality and malaria morbidity in western Kenya. Am J Trop Med Hyg. 2003, 68: 121-127.
Baume CA, Marin MC: Intra-household mosquito net use in Ethiopia, Ghana, Mali, Nigeria, Senegal, and Zambia: are nets being used? Who in the household uses them?. Am J Trop Med Hyg. 2007, 77: 963-971.
Guyatt HL, Gotink MH, Ochola SA, Snow RW: Free bednets to pregnant women through antenatal clinics in Kenya: a cheap, simple and equitable approach to delivery. Trop Med Int Health. 2002, 7: 409-420.
De Allegri M, Marschall P, Flessa S, Tiendrebeogo J, Kouyate B, Jahn A, Muller O: Comparative cost analysis of insecticide-treated net delivery strategies: sales supported by social marketing and free distribution through antenatal care. Health Policy Plan. 2009, 25: 28-38.
Yukich JO, Zerom M, Ghebremeskel T, Tediosi F, Lengeler C: Costs and cost-effectiveness of vector control in Eritrea using insecticide-treated bed nets. Malar J. 2009, 8: 51-
Skarbinski J, Massaga JJ, Rowe AK, Kachur SP: Distribution of free untreated bednets bundled with insecticide via an integrated child health campaign in Lindi Region, Tanzania: lessons for future campaigns. Am J Trop Med Hyg. 2007, 76: 1100-1106.
Grabowsky M, Nobiya T, Ahun M, Donna R, Lengor M, Zimmerman D, Ladd H, Hoekstra E, Bello A, Baffoe-Wilmot A, Amofah G: Distributing insecticide-treated bednets during measles vaccination: a low-cost means of achieving high and equitable coverage. Bull World Health Organ. 2005, 83: 195-201.
Grabowsky M, Farrell N, Hawley W, Chimumbwa J, Hoyer S, Wolkon A, Selanikio J: Integrating insecticide-treated bednets into a measles vaccination campaign achieves high, rapid and equitable coverage with direct and voucher-based methods. Trop Med Int Health. 2005, 10: 1151-1160.
Willey BA, Smith Paintain L, Mangham L, Car J, Armstrong Schellenberg J: Strategies for scaling up delivery of insecticide-treated nets for malaria control: a systematic review. Bull World Health Organ. 2012, in press
Stevens W, Wiseman V, Ortiz J, Chavasse D: The costs and effects of a nationwide insecticide-treated net programme: the case of Malawi. Malar J. 2005, 4: 22-
Victora CG, Fenn B, Bryce J, Kirkwood BR: Co-coverage of preventive interventions and implications for child-survival strategies: evidence from national surveys. Lancet. 2005, 366: 1460-1466.
Kilian A, Wijayanandana N, Ssekitoleeko J: Review of delivery strategies for insecticide treated mosquito nets – are we ready for the next phase of malaria control efforts?. Tropikanet Journal. 2010, 1:
RBM Vector Control Working Group (VCWG) Continuous Distribution Workstream: Consensus Statement on Continuous Distribution Systems for Insecticide Treated Nets. 2011, Geneva: World Health Organization
Binka FN, Hodgson A, Adjuik M, Smith T: Mortality in a seven-and-a-half-year follow-up of a trial of insecticide-treated mosquito nets in Ghana. Trans R Soc Trop Med Hyg. 2002, 96: 597-599.
Diallo DA, Cousens SN, Cuzin-Ouattara N, Nebie I, Ilboudo-Sanogo E, Esposito F: Child mortality in a West African population protected with insecticide-treated curtains for a period of up to 6 years. Bull World Health Organ. 2004, 82: 85-91.
Lindblade KA, Eisele TP, Gimnig JE, Alaii JA, Odhiambo F, ter Kuile FO, Hawley WA, Wannemuehler KA, Phillips-Howard PA, Rosen DH: Sustainability of reductions in malaria transmission and infant mortality in western Kenya with use of insecticide-treated bednets: 4 to 6 years of follow-up. JAMA. 2004, 291: 2571-2580.
Binka FN, Kubaje A, Adjuik M, Williams LA, Lengeler C, Maude GH, Armah GE, Kajihara B, Adiamah JH, Smith PG: Impact of permethrin impregnated bednets on child mortality in Kassena-Nankana district, Ghana: a randomized controlled trial. Trop Med Int Health. 1996, 1: 147-154.
Gamble C, Ekwaru PJ, Garner P, ter Kuile FO: Insecticide-treated nets for the prevention of malaria in pregnancy: a systematic review of randomised controlled trials. PLoS Med. 2007, 4: e107-
Bardaji A, Sigauque B, Sanz S, Maixenchs M, Ordi J, Aponte JJ, Mabunda S, Alonso PL, Menendez C: Impact of malaria at the end of pregnancy on infant mortality and morbidity. J Infect Dis. 2011, 203: 691-699.
Guyatt HL, Snow RW: Malaria in pregnancy as an indirect cause of infant mortality in sub-Saharan Africa. Trans R Soc Trop Med Hyg. 2001, 95: 569-576.
Howard SC, Omumbo J, Nevill C, Some ES, Donnelly CA, Snow RW: Evidence for a mass community effect of insecticide-treated bednets on the incidence of malaria on the Kenyan coast. Trans R Soc Trop Med Hyg. 2000, 94: 357-360.
Smith DL, Hay SI, Noor AM, Snow RW: Predicting changing malaria risk after expanded insecticide-treated net coverage in Africa. Trends Parasitol. 2009, 25: 511-516.
Chitnis N, Schapira A, Smith T, Steketee R: Comparing the effectiveness of malaria vector-control interventions through a mathematical model. Am J Trop Med Hyg. 2010, 83: 230-240.
Griffin JT, Hollingsworth TD, Okell LC, Churcher TS, White M, Hinsley W, Bousema T, Drakeley CJ, Ferguson NM, Basanez MG, Ghani AC: Reducing Plasmodium falciparum malaria transmission in Africa: a model-based evaluation of intervention strategies. PLoS Med. 2010, 7: e1000324-
We would like to thank Rose Nathan, Hadji Mponda, Yovitha Sedekia, Tanya Marchant and Jane Bruce for sharing data from the 2008 Tanzania National Voucher Scheme evaluation household survey on ITN use according to household ITN ownership and demographics, and Michael White, Déirdre Hollingsworth and Jamie Griffin for useful discussions. Funding for this study was provided by the Norwegian Agency for Development Cooperation (NORAD), the DfID-funded TARGETS Research Consortium at the London School of Hygiene & Tropical Medicine and the Bill & Melinda Gates Vaccine Modelling Initiative at Imperial College. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
The authors declare that they have no competing interests.
JL, LSP, JW and KH devised the study design and objectives. LO developed the model. LO, LSP, JL, JW and KH contributed to parameterization, analysis and interpretation. LSP and LO wrote the first draft of the manuscript. All authors read, commented on and approved the final manuscript.
Lucy C Okell, Lucy Smith Paintain contributed equally to this work.
Electronic supplementary material
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
Rights and permissions
Open Access This article is published under license to BioMed Central Ltd. This is an Open Access article is distributed under the terms of the Creative Commons Attribution License ( https://creativecommons.org/licenses/by/2.0 ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
About this article
Cite this article
Okell, L.C., Paintain, L.S., Webster, J. et al. From intervention to impact: modelling the potential mortality impact achievable by different long-lasting, insecticide-treated net delivery strategies. Malar J 11, 327 (2012). https://doi.org/10.1186/1475-2875-11-327
- Roll Back Malaria
- Malaria Mortality
- Delivery Channel
- Mortality Impact