- Open Access
Assessing whether universal coverage with insecticide-treated nets has been achieved: is the right indicator being used?
- Hannah Koenker1Email authorView ORCID ID profile,
- Fred Arnold2,
- Fatou Ba3,
- Moustapha Cisse3,
- Lamine Diouf3,
- Erin Eckert4,
- Marcy Erskine5,
- Lia Florey4,
- Megan Fotheringham4,
- Lilia Gerberg4,
- Christian Lengeler6, 7,
- Matthew Lynch1,
- Abraham Mnzava8,
- Susann Nasr9,
- Médoune Ndiop3,
- Stephen Poyer10,
- Melanie Renshaw11,
- Estifanos Shargie9,
- Cameron Taylor2,
- Julie Thwing12,
- Suzanne Van Hulle13,
- Yazoumé Ye2,
- Josh Yukich14 and
- Albert Kilian15
© The Author(s) 2018
- Received: 6 August 2018
- Accepted: 3 October 2018
- Published: 11 October 2018
Insecticide-treated nets (ITNs) are the primary tool for malaria vector control in sub-Saharan Africa, and have been responsible for an estimated two-thirds of the reduction in the global burden of malaria in recent years. While the ultimate goal is high levels of ITN use to confer protection against infected mosquitoes, it is widely accepted that ITN use must be understood in the context of ITN availability. However, despite nearly a decade of universal coverage campaigns, no country has achieved a measured level of 80% of households owning 1 ITN for 2 people in a national survey. Eighty-six public datasets from 33 countries in sub-Saharan Africa (2005–2017) were used to explore the causes of failure to achieve universal coverage at the household level, understand the relationships between the various ITN indicators, and further define their respective programmatic utility.
The proportion of households owning 1 ITN for 2 people did not exceed 60% at the national level in any survey, except in Uganda’s 2014 Malaria Indicator Survey (MIS). At 80% population ITN access, the expected proportion of households with 1 ITN for 2 people is only 60% (p = 0.003 R2 = 0.92), because individuals in households with some but not enough ITNs are captured as having access, but the household does not qualify as having 1 ITN for 2 people. Among households with 7–9 people, mean population ITN access was 41.0% (95% CI 36.5–45.6), whereas only 6.2% (95% CI 4.0–8.3) of these same households owned at least 1 ITN for 2 people. On average, 60% of the individual protection measured by the population access indicator is obscured when focus is put on the household “universal coverage” indicator. The practice of limiting households to a maximum number of ITNs in mass campaigns severely restricts the ability of large households to obtain enough ITNs for their entire family.
The two household-level indicators—one representing minimal coverage, the other only ‘universal’ coverage—provide an incomplete and potentially misleading picture of personal protection and the success of an ITN distribution programme. Under current ITN distribution strategies, the global malaria community cannot expect countries to reach 80% of households owning 1 ITN for 2 people at a national level. When programmes assess the success of ITN distribution activities, population access to ITNs should be considered as the better indicator of “universal coverage,” because it is based on people as the unit of analysis.
- Universal coverage
- Bed net coverage
- Mosquito net
Insecticide-treated nets (ITNs), which today are almost exclusively comprised of long-lasting insecticidal nets (LLINs), are the primary tool for malaria vector control in sub-Saharan Africa, and have been responsible for an estimated two-thirds of the reduction in the global burden of malaria in recent years . Over 1.5 billion ITNs have been distributed since the UN Secretary General called for a scale-up of ITN coverage in 2008, primarily through mass campaigns aiming at reaching universal coverage . In line with the definition of “universal health coverage”, the World Health Organization (WHO), in the 2017 update of its recommendations on achieving universal coverage with LLINs, defines “universal coverage” as “universal access to, and use of, LLINs” for the entire population at risk of malaria targeted in the control or elimination strategy . Usually the minimum target for universal coverage to be considered achieved is 80% both for access (ownership) and use. This definition of “universal coverage with ITNs” is not disputed, and there is general agreement how to quantify the need for ITNs.
Universal coverage campaigns use an algorithm to calculate the number of ITNs needed for procurement based on population. The definition applies the observation that on average two people share a net, meaning that if one net is given for every two people in a household, all members have a chance to use an ITN . For quantification of the number of ITNs needed for a national mass distribution campaign, the population is divided by 1.8 (and not by 2), to account for households with an odd number of members in which an additional net would be needed [3, 5]. Campaigns also tend not to count existing ITNs in the household, as these are most often older ITNs, with a limited useful life, and the effort of counting and including these in distribution planning would be intensive, and possibly of limited utility .
ITN indicators: advantages and limitations
Unit of analysis
What it measures
% HHs owning at least 1 ITN
Measures what proportion of households has 1 (or more) ITNs
Demonstrates the basic ‘reach’ of ITN distribution activities
Does not indicate the extent to which individuals have the opportunity to use an ITN—as 1 ITN is nearly always insufficient to enable ITN use by all household members
% HHs owning at least 1 ITN for 2 people
Measures what proportion of households has enough ITNs to protect all individuals in the household assuming 2 persons use each ITN
Correlates with WHO and mass campaigns goals of providing 1 ITN for every 2 people; easy to communicate with a broader audience
Underestimates coverage by totally ignoring households that have ITNs to cover a significant portion, but not all, of the individuals in the household
% population that used an ITN the night before the survey
Measures the level of ITN use of all age groups at the time of the survey
Provides an exact picture of what proportion of the population is individually protected by an ITN the night before the survey
Low ITN use often assumed to be a behavioural problem, but use is highly driven by ITN access, which is not accounted for by this indicator
% population with access to an ITN within the households
Provides an estimate of the proportion of the total population that could have slept under an ITN. Assuming two people share one ITN
Accounts for ITNs in all households and precisely counts all individuals that could use an ITN. Can be directly compared with ITN use to identify specific behavioural gaps
Can be challenging to conceptualize
The objective of this study is to explore reasons why the indicator “the proportion of households owning at least 1 ITN for 2 people” falls consistently far below target levels, and to evaluate the three ITN ownership coverage indicators to see which one is the right indicator to assess whether universal coverage has been achieved.
Eighty-six publicly available datasets from Demographic and Health Surveys (DHS) and Malaria Indicator Surveys (MIS) in 33 countries in sub-Saharan Africa (2005–2017) representing all available data sets for this period were downloaded with permission from dhsprogram.com. The proportion of households owning at least 1 ITN for 2 people (enough ITNs) and population access to an ITN within the household were calculated at the national level, according to standard RBM Monitoring and Evaluation Reference Group procedures . Mean household size was calculated using de jure (usual) members. All data preparations and analyses were done using Stata 14 software (Stata Corp, College Station, Texas, USA) and applying the sampling weights as provided in the data sets.
To provide data points at the higher end of the range of access and ownership, 12 surveys from eight countries were identified where national-level ownership of at least 1 ITN within the household exceeded 80%. A total of 121 regional or provincial estimates of the same indicators were calculated for these 12 surveys. For 59 surveys conducted in 2010–2016, ITN indicators were calculated by household size (a categorical variable of 1–3, 4–6, 7–10, and ≥ 11 de jure members) and extracted with their standard errors and confidence intervals adjusting for the cluster sampling design.
Country results for all described variables were then extracted into a new data set that also included country and region (where applicable), year and type of survey (MIS, DHS). Multivariable regression analysis was then used to analyse trends and relationships within this data set either as linear regression models or fractional polynomial models, using Stata’s fp command to identify the best fit. Analytical weights were created and applied to adjust for differences in size and variation of data sets. Unless otherwise indicated, statistical significance testing applied the Pearson design-based F-statistic for proportions and ordinary least squares linear regression for multivariable analysis.
In a simple plot of the national results for each of the three ITN coverage indicators plotted against household ownership of at least 1 ITN, it is observed that household ownership of at least 1 ITN for 2 people is consistently below population ITN access, which itself falls consistently below household ownership of at least 1 ITN (Fig. 1).
ITN indicators in household surveys conducted shortly after universal coverage campaigns
% households owning ≥ 1 ITN
% households owning ≥ 1 ITN per 2 people
% population with access to an ITN
Mean household size (de jure)
If one looks at the number of people that are assumed to be protected with the indicator of proportion of households owning at least 1 ITN for 2 people, only three individuals (10%) are counted. Compare this with the 19 people that are counted under the population access indicator. In effect, 16 individuals out of the 30 in this hypothetical village—53%—have access to an ITN that is ignored when looking only at the indicator of households with enough ITNs. This is the same as the crude difference between 63% population ITN access and 10% (3 of 30) population living in households that own enough ITNs. The ignored population can also be expressed as a percentage of population access: 16 individuals out of the 19 individuals with access to an ITN in this village are ignored by the indicator of households that own at least 1 ITN for 2 people, or 84%.
On average, across the 86 national surveys reviewed in this study, out of all the people with access to an ITN, 60% (95% CI 23–89%) are ignored when planners focus solely on the indicator of households owning at least 1 ITN for 2 people.
Currently, targets in national strategic plans or donor documents for all three ITN coverage indicators are usually set at 80% or above. This gives a perhaps unintended implication that the three indicators should increase together at the same rates. Moreover, universal coverage guidance from WHO and others calls for procuring ITNs with the goal of providing each household with 1 ITN for 2 people, again implying that by doing so, countries should expect to achieve 100% of households owning enough ITNs immediately after a mass campaign. These implied expectations contribute to confusion and frustration when post-campaign results—particularly for the indicator of households owning at least 1 ITN for 2 people—are far below target levels. This also has significant implications for donor funding. Performance frameworks, typically aligned to the household ownership indicators, may inadvertently set national programmes up for failure, and countries may be unnecessarily penalized based on the indicator targets, not all of which are achievable.
This work builds on previous work describing the utility of the ITN indicators and exploring the mathematical relationships between the indicators in order to model ITN coverage in years between surveys [6, 9, 11]. However, in terms of programmatic utility, each indicator must be considered with its advantages and limitations, in terms of interpreting the extent of ITN protection in a given population. The two household indicators can be compared to provide an ‘ownership gap’, and the two population indicators can be compared to provide a ‘use gap’ [9, 11].
The proportion of households owning at least 1 ITN is a minimal threshold that essentially describes the spatial reach of ITN distribution activities, but not the degree to which the population is protected. (The vast majority (80%) of households in endemic countries require more than a single ITN to protect all persons in the household—see Additional file 2). At the other end of the spectrum, the proportion of households owning at least 1 ITN for 2 people is an indicator of ‘perfect’ household coverage, and has never been reached at a national or even a subregional level. Households may miss qualifying as having ‘enough’ nets by only 1–2 nets, and this is often misinterpreted as these households not having any protection. The two household-level indicators—one representing minimal coverage, the other only ‘universal’ coverage—thus provide an incomplete and potentially misleading picture of personal protection and the success of an ITN distribution programme.
Larger households were far less likely than smaller households to own enough ITNs for all their household members. In fact, many individuals in these households that own some but not enough ITNs had access to a net, and (in most cases) were sleeping under one, as illustrated in Fig. 6. This individual protection is obscured when programme planners focus only on the household-level indicator.
Given these limitations of the household level indicators, the population ITN access indicator is a far better indicator of ‘universal coverage’ because it is based on individual people. It provides a clear picture of the proportion of individuals in a given setting that have the opportunity to use an ITN. It can also be directly compared to the proportion of the population that used an ITN the previous night, which enables detailed analysis of specific behavioral gaps nationally as well as among population subgroups. Ultimately, of course, ITN use is the key behavior required for malaria control, but people cannot use an ITN to which they do not have access. Recent research demonstrates clearly that rates of ITN use among those with access to an ITN with few exceptions are at or above an 80% target [10–13]. Therefore, increasing ITN access will lead directly to increases in ITN use.
It is important to consider and address the programmatic and policy factors that prevent households from obtaining enough ITNs. The primary programmatic reason is that larger households rarely receive the necessary number of ITNs during mass campaigns. During the process of household registration, programmes often put a cap on the number of ITNs any given household can receive to reduce the opportunity for fraud due to inflated numbers of household members. Second, during the process of distribution itself, campaign staff may also pragmatically ration ITNs if they think not enough are available, to remain certain that all households in their catchment area will receive at least some ITNs. Third, larger households, which tend to have more children than smaller households, may have some sleeping spaces in which more than 2 people are sharing an ITN  and, therefore, may not require (or be motivated to acquire) ITNs in the 1:2 ratio.
Policy decisions are also likely affecting the ability of large households to receive enough ITNs. The current guidance from the WHO recommends that mass campaigns be planned with a quantification algorithm of “population divided by 1.8,” which is intended to account for the odd-numbered households that require an additional ‘half net’ according to the 1 for 2 ratio. In 2017 the algorithm was updated by the WHO to allow a 10% buffer accounting for outdated census projections . However, when looking more closely at sleeping space patterns, researchers have found reasons to question the current quantification guidance. Analysis of discordant ITN-person pairs (e.g., two roommates in a household who do not share a sleeping space) as well as the trend that with increasing wealth and also increasing ITN access, the number of people per ITN decreases, imply that a more accurate expectation would be that each ITN only protects on average 1.6 people . Whether inaccurate population estimates or an inadequate quantification factor are the greater determinant of ITN gaps during mass campaigns remains to be explored.
Three possible solutions to these supply challenges can be considered. First, if the current levels of ITN access are considered sufficient in epidemiological terms to maintain malaria control, then no changes in distribution strategy are required. Rather, the current targets could be adjusted to be more appropriate for each indicator. Enormous reductions in malaria morbidity and mortality have been observed over the past decade, during which ITN coverage has not been at target levels and yet this ‘insufficient’ ITN coverage has been credited with two-thirds of the observed reductions in morbidity . Modeling work also indicates that community-level protection can be achieved at lower-than-universal coverage levels of 35–65% population use of ITNs . On this basis, the target levels for each ITN coverage indicator might be adjusted to be more pragmatic—i.e. a 95% target for household ownership of any ITN, which corresponds roughly to an 80% target for population ITN access, 70% population ITN use, and a 55% target for household ownership of at least 1 ITN for 2 people.
Second, if current levels of ITN access are not considered sufficient for malaria control, and targets for ITN use should be 80%, as outlined in the WHO Global Technical Strategy (implying a population ITN access target of 90%) , then it follows that additional ITNs would need to be procured, potentially using a 10% buffer for mass campaigns, and/or by increasing ITN distribution through ongoing school or community based channels. The WHO currently calls for mass campaigns every 3 years using the population/1.8 quantification factor with an optional 10% buffer, which is equivalent to a population/1.6 quantification. The guidelines further recommend additional ITN distribution as needed to maintain target levels , but there is no robust guidance on how many additional ITNs might be needed, nor the most efficient combination of distribution strategies, which inhibits programmes from moving away from triennial mass campaigns. Additional research to provide more specific estimates, including cost-effective options for optimizing ITN coverage over time and space, would likely ease this process for programme planners and donors.
Third, there is some scope for increasing programmatic efficiency in ITN distribution and attempting to use existing quantities of ITNs to achieve higher rates of coverage. This can be done regardless of whether the above two solutions are implemented. First, programmes must acknowledge that large households require more nets, and either avoid setting caps, or set them taking into account regional demographic variations in household sizes. Data on household size are regularly reported in large national surveys such as DHS and MIS, and are summarized here in Additional file 2. Caps currently serve both to limit the negative impact of respondents inflating household size during registration and to ensure that in situations where not enough ITNs are available, all households receive at least a few ITNs. Some regions may indeed have only a small percentage of households that are larger than 8 people; a cap of four ITNs per household might work well. However, in other regions, a cap of four ITNs per household may automatically exclude 15% of households from reaching the target of 1 ITN for 2 people, as in Ghana’s northern regions where the average household size is larger than the rest of the country . Obviously, additional mechanisms to avoid inflation of the numbers of household members during the campaign’s registration phase are and should be put in place. In areas where caps have been used, ‘deflation’ of household size has also been observed—splitting larger households into two or more smaller households to avoid the cap. Second, it has been shown previously that the quality of census and household registration data contribute much more to successful campaigns than other factors . Therefore, investing in household registration and its supervision will help to ensure that all households—whether large, small, or hard to reach—are reached and accurately served. Additional research will be needed to thoroughly assess cost-effective strategies for capping.
There are some minor methodological factors related to achieving universal coverage (based on either indicator) that should be noted. The standard MIS/DHS net roster only lists up to seven ITNs, ignoring any additional nets in the household. In the Mali 2015 MIS, 13% of households owned 7 ITNs, and it is likely that many households own 8 or more nets. These additional nets, however, are not counted and, therefore, these households (if large) may miss reaching the threshold of owning 1 ITN for 2 people solely as a result of this approach. Other countries, including Senegal, have modified the standard net roster to allow for additional ITNs to fit their context. Likewise, the definition of a household—whether for household survey purposes or for mass campaign planning and registration—is certain to be problematic if not done consistently.
Based on the above findings, the authors recommend that national programmes, donors, and implementing partners focus on the proportion of the population with access to an ITN within the household as the key indicator of universal coverage. Use of this population-level indicator as the primary measure of ITN coverage will strengthen national strategies, implementation plans, policy documents, and DHS, MIS, and MICS reports. The household-level indicator of owning at least 1 ITN for 2 people can be retained, but serve as a secondary indicator. Programmes will need to understand its limitations, and set targets accordingly. Under current ITN quantification and distribution strategies, an 80% target for households owning at least 1 ITN for 2 people is not achievable at a national or even subnational level. This disconnect may inadvertently lead to countries being penalized for continued malaria funding that is contingent upon performance.
This indicator is highly sensitive to average household size, and it masks significant individual protection—on average, 60% of the individual protection measured by the population access indicator is ignored when focus is put on the household “universal coverage” indicator. Given individual ITN use is only possible when a person has access to an ITN within their household, measuring actual ITN access in targeted geographical areas is the more programmatically useful indicator. Population access to ITNs, because it is based on persons as the unit of analysis, should be considered as the primary indicator of ITN coverage when assessing the success of ITN distributions.
HK and AK analysed the data and HK drafted the paper in consultation with other co-authors. All authors read and approved the final manuscript.
The authors are grateful for the many productive discussions on this topic held with Roll Back Malaria partners.
The authors declare that they have no competing interests.
Availability of data and materials
The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.
Consent for publication
Ethics approval and consent to participate
This publication is made possible by the generous support of the American people through the United States Agency for International Development (USAID) and the US President’s Malaria Initiative (PMI) under the terms of USAID/JHU Cooperative Agreement No AID-OAA-A-14-00057. The contents do not necessarily reflect the views of PMI or the US Government.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Bhatt S, Weiss DJ, Cameron E, Bisanzio D, Mappin B, Dalrymple U, et al. The effect of malaria control on Plasmodium falciparum in Africa between 2000 and 2015. Nature. 2015;526:207–11.View ArticleGoogle Scholar
- Milliner J. Net mapping project. 2016. http://allianceformalariaprevention.com/working-groups/net-mapping-project/. Accessed 7 May 2018.
- WHO. Recommendations for achieving universal coverage with long-lasting insecticidal nets in malaria control. Geneva: World Health Organization; 2013.Google Scholar
- Kilian A, Koenker H, Paintain L. Estimating population access to insecticide-treated nets from administrative data: correction factor is needed. Malar J. 2013;12:259.View ArticleGoogle Scholar
- Kilian A, Boulay M, Koenker H, Lynch M. How many mosquito nets are needed to achieve universal coverage? Recommendations for the quantification and allocation of long-lasting insecticidal nets for mass campaigns. Malar J. 2010;9:330.PubMedPubMed CentralGoogle Scholar
- Yukich J, Bennett A, Keating J, Yukich RK, Lynch M, Eisele TP, et al. Planning long lasting insecticide treated net campaigns: should households’ existing nets be taken into account? Parasites Vectors. 2013;6:174.View ArticleGoogle Scholar
- MEASURE Evaluation, MEASURE DHS, President’s Malaria Initiative, Roll Back Malaria Partnership, UNICEF, World Health Organization. Household survey indicators for malaria control. 2013.Google Scholar
- Eisele TP, Keating J, Littrell M, Larsen D, Macintyre K. Assessment of insecticide-treated bednet use among children and pregnant women across 15 countries using standardized national surveys. Am J Trop Med Hyg. 2009;80:209–14.View ArticleGoogle Scholar
- Kilian A, Koenker H, Baba E, Onyefunafoa EO, Selby RA, Lokko K, et al. Universal coverage with insecticide-treated nets—applying the revised indicators for ownership and use to the Nigeria 2010 malaria indicator survey data. Malar J. 2013;12:314.View ArticleGoogle Scholar
- Koenker H, Kilian A. Recalculating the net use gap: a multi-country comparison of ITN use versus ITN access. PLoS ONE. 2014;9:e97496.View ArticleGoogle Scholar
- Bhatt S, Weiss DJ, Mappin B, Dalrymple U, Cameron E. Coverage and system efficiencies of insecticide-treated nets in Africa from 2000 to 2017. eLife. 2015;4:e09672.View ArticleGoogle Scholar
- WHO. World malaria report 2017. Geneva: World Health Organization; 2017.Google Scholar
- ITN Access and Use—VectorWorks. 2016. p. 1–107. http://www.vector-works.org/resources/itn-access-and-use/. Accessed 7 May 2018.
- WHO. Achieving and maintaining universal coverage with long-lasting insecticidal nets for malaria control. Geneva: World Health Organization; 2017.Google Scholar
- Killeen GF, Smith TA, Ferguson HM, Mshinda H, Abdulla S, Lengeler C, et al. Preventing childhood malaria in Africa by protecting adults from mosquitoes with insecticide-treated nets. PLoS Med. 2007;4:e229.View ArticleGoogle Scholar
- WHO. Global technical strategy for malaria 2016–2030. Geneva: World Health Organization; 2015.Google Scholar
- Ghana Statistical Service, Ghana Health Service, ICF. Ghana malaria indicator survey 2016. Accra, Ghana and Rockville, Maryland; 2017.Google Scholar
- de Beyl CZ, Koenker H, Acosta A, Onyefunafoa EO, Adegbe E, McCartney-Melstad A, et al. Multi-country comparison of delivery strategies for mass campaigns to achieve universal coverage with insecticide-treated nets: what works best? Malar J. 2016;15:58.View ArticleGoogle Scholar