Skip to main content
Download PDF

Variation of physical durability between LLIN products and net use environments: summary of findings from four African countries

Malaria Journal volume 20, Article number: 26 (2021) Cite this article

Abstract

Background

Physical durability of long-lasting-insecticidal nets (LLIN) is an important aspect of the effectiveness of LLIN as a malaria prevention tool, but there is limited data on performance across locations and products. This secondary analysis of data from the VectorWorks project from 10 sites in four African countries involving six LLIN brands provides such data.

Methods

A total of 4672 campaign nets from 1976 households were recruited into prospective cohort studies 2–6 months after distribution through campaigns and followed for 3 years in Mozambique, Nigeria, DRC and Zanzibar, Tanzania. LLIN products included two 100 denier polyester LLIN (DawaPlus® 2.0, PermaNet® 2.0) distributed in five sites and four 150 denier polyethylene LLIN (Royal Sentry®, MAGNet®, DuraNet©, Olyset™ Net) distributed in five sites. Primary outcome was LLIN survival in serviceable condition and median survival in years. Net use environment and net care variables were collected during four household surveys. Determinants of physical durability were explored by survival analysis and Cox regression models with risk of failure starting with the first hanging of the net.

Results

Definite outcomes for physical durability were obtained for 75% of study nets. After 31 to 37 months survival in serviceable condition varied between sites by 63 percentage-points, from 17 to 80%. Median survival varied by 3.7 years, from 1.6 to 5.3 years. Similar magnitude of variation was seen for polyethylene and polyester LLIN and for the same brand. Cox regression showed increasing net care attitude in combination with exposure to net related messages to be the strongest explanatory variable of survival. However, differences between countries also remained significant. In contrast, no difference was seen for LLIN material types.

Conclusions

Variation in net use environment and net care is the main reason for differences in the physical durability of LLIN products in different locations. While some of these factors have been identified to work across countries, other factors remain poorly defined and further investigation is needed in this area. Grouping LLIN brands by similar textile characteristics, such as material or yarn strength, is insufficient to distinguish LLIN product performance suggesting a more differentiated, composite metric is needed.

Background

Early field testing of long-lasting insecticidal nets (LLIN) had focussed mainly on the insecticidal aspects following the early guidance on phase III assessments of the World Health Organization’s (WHO) Pesticide Evaluation Scheme (WHOPES) [1]. For a LLIN product to receive WHOPES recommendation for public health use it had to demonstrate that after 3 years in the field at least 80% of the LLIN still showed optimal insecticidal effectiveness based on bio-assay tests in the laboratory (cone or tunnel test). Aspects of physical durability were not part of these early assessments even though increasing damage over time of use in mosquito nets had been highlighted as an issue in six studies published between 1982 and 2004 [2,3,4,5,6,7]. The first study to report on the physical integrity of an LLIN was published 2004 when Spencer et al. [8] presented data on PermaNet® 1.0 distributed in a camp for internally displaced people in Bundibugyo district, Uganda. Damage in this study was described in two categories, any holes below or above 40 cm2 in size. The first studies using a single composite metric of damage across each LLIN were presented for Olyset™ Net from the Lao Republic in 2007 using the total surface area of holes per net [9] and for PermaNet® 1.0 and 2.0 in 2008 from Uganda using a simple hole index based on the count of three hole sizes [10]. These early studies did not yet include standardized measurement of loss of nets due to decay (attrition) and were only describing one LLIN brand in each location. In addition to Olyset™ Net and PermaNet® 2.0 the polyester-based Interceptor® LLIN was studied in Uganda [11] and India [12].

The first paper presenting data comparing physical durability of more than one LLIN brand in the same location was published in 2012. Using an early version of a “proportionate hole index” as a composite measure of net damage the 150 denier polyethylene-based Olyset™ Net was compared with two polyester-based 75 denier LLIN, PermaNet® 2.0 and Interceptor® in the settlements of internally displaced people in Chad [13]. After 14 months of use 39% of the polyester-based LLIN were considered no longer serviceable compared to only 8% of the polyethylene-based LLIN with a thicker yarn. However, the study only looked at the surviving nets and did not capture losses due to nets thrown away because of damage (attrition) which may have distorted the results if attrition was higher in the Olyset™ Net group. In 2013 WHO published a new recommended methodology for the monitoring of the physical durability of LLIN that combined attrition due to wear and tear and integrity of LLIN still found in the sampled households into a “functional survival in serviceable condition” [14]. Using this new approach van Roey and colleagues compared the 120 denier polyethylene-based Netprotect® LLIN in the same district in Cambodia to the 100 denier polyester-based PermaNet® 2.0 and found no difference in functional survival after 3 years of follow-up [15]. Other brand comparisons of physical durability that were done in the same locations compared Olyset™ Net against PermaNet® 2.0 and no differences were found between them in Rwanda [16], India [17], Uganda [18] or Zambia [19]. In Nampula province in Mozambique Olyset™ Net had a higher mean number of holes per net after 2 years, but this study did not include attrition [20]. In contrast, after 3 years follow-up of the 100 denier polyester-based DawaPlus® 2.0 LLIN in three different locations in Nigeria a significant variation in median survival of over 1 year was found [21] suggesting that net use environment may be the driving force of differences in physical durability of LLIN.

The first study comparing physical durability of more than two LLIN brands in a three-year prospective cohort using the new methodology and controlling for location by randomly allocating nets to households in ten districts in Tanzania included two polyethylene-based LLINs, Olyset™ Net and Netprotect®, and one polyester-based LLIN, PermaNet® 2.0 [22]. While estimated median survival in serviceable condition was the same for PermaNet® 2.0 and Netprotect® with 2.6 years, there was strong statistical evidence that median survival for Olyset™ Net was lower with 2.0 years (p < 0.001). A study in Benin randomly distributed seven LLIN brands in one sub-district, four polyester-based, one polyester LLIN with enforced border and polyethylene roof (PermaNet 3.0) and two polyethylene-based LLIN and follow-up data up to 12 months did not suggest any differences by brand [23]. Finally, a recent secondary analysis and modelling of data from 3-year durability monitoring from seven countries involving between one and seven LLIN brands per country and using vectorial capacity as the primary outcome found more variability in decline of protection over time by country than by LLIN brand [24].

The VectorWorks project, funded by the U.S. President’s Malaria Initiative (PMI) undertook LLIN durability monitoring between 2014 and 2019 involving four African countries and five LLIN brands (Table 1) [25,26,27,28]. The secondary analysis of this data across locations and LLIN brands not only presents a further opportunity to investigate variations of physical durability for the same or similar (same specifications but different manufacturer) LLIN between different net use environments, but also allows adjustment of comparison between LLIN types for the key elements of net care behaviours as these were comprehensively collected in a standardized fashion across all project sites.

Table 1 Countries, locations, and LLIN brands of durability monitoring
Full size table

Methods

Study sites

Data from 10 sites of durability monitoring activities in four countries involving six LLIN brands were included in the analysis and details of locations and LLIN brands studied are shown in Table 1. There were two distinct country scenarios. In Mozambique and Nigeria the same or similar LLIN brands were tested in what was expected to be different net use environments, while in the Democratic Republic of Congo (DRC) and Zanzibar different LLIN brands were monitored in similar locations. The selection of the scenario was based on the information needs of the country’s malaria programme.

Primary data collections

The study design was the same in all countries and followed a standardized protocol recommended by the PMI [29] and in line with WHO recommendations [14]. Details of the methodology and tools have been presented previously [25,26,27,28]. In short, a representative sample of LLINs distributed through a mass distribution campaign organized by the respective malaria programmes were recruited into a prospective cohort study 1 to 6 months after distribution. Sample size target was 345 cohort nets per site sampled from 15 clusters per site and 10 households per cluster in Nigeria, Zanzibar and DRC. In Mozambique sample size was higher with 782 cohort nets targeted per site from 17 clusters. These differences were due to varying assumptions for precision of estimates. Clusters were selected with probability proportionate to size and households were selected by simple random sampling from lists prepared at the day of the survey. Follow-up surveys were conducted 12, 24 and 36 months after distribution. At each time point presence or loss of the nets were recorded (attrition) and an assessment of the physical integrity of the remaining cohort nets was carried out. During hole count fully repaired holes were only recorded as repair while partial repairs were counted as the remaining hole and a repair. Data collections took place between November 2015 and April 2019. Follow-up in Oyo State, Nigeria only was for 24 months due to a delay in the LLIN mass campaign and the end of the VectorWorks project. All other sites completed the 36 months follow-up survey. Data was collected electronically using tablets and the Open Data Kit (ODK) software. After data cleaning and consistency checks, data were transferred to the Stata statistical package (Stata version 14.2, College Station, Texas, USA) for processing and analysis.

Physical integrity was measured by the proportionate Hole Index (pHI) as recommended by WHO [30] and then categorized based on the pHI value as still serviceable (pHI ≤ 642) or torn (pHI > 642) [31]. Primary outcome of the physical durability assessment was the survival in serviceable condition which incorporates attrition due to discarding of nets (destroyed, thrown away or used for other purposes) and surviving nets no longer serviceable. Nets that were given to others to use or for which outcome was unknown were excluded from the uni- and bivariate analyses and censored in the survival analysis [30].

Median net survival was estimated defined as the time in years until 50% of the originally distributed LLIN were no longer serviceable. It was calculated from at the last two time points provided both were below 85% using the following formula:

$${\text{tm}} = {\text{t}}1 + \frac{{\left( {{\text{t}}2 - {\text{t}}1} \right) *\left( {{\text{p}}1 - 50} \right)}}{{\left( {{\text{p}}1 - {\text{p}}2} \right)}}$$

where tm is the median survival time, t1 and t2 the first and second time points in years and p1 and p2 the proportion surviving to first and second time point respectively in per cent. Confidence intervals for this estimate were calculated by projecting the 95% CI from the survival estimates in the same way as described above.

In addition, information on socio-demographic characteristics, ownership of other mosquito nets, net use environment, net handling, and net care and repair behaviour was collected through household-level questionnaires. Specifically, a household net care attitude variable was developed based on a Likert scale comprising six questions with a four-value response, omitting the neutral option. Based on this variable households were categorized as never, sometimes or always showing very positive net care attitude (score ≥ 1.0 from a range − 2.0 to 2.0) across the up to four surveys each household participated in [26]. Similarly, a variable of household exposure to social and behaviour change (SBC) messages regarding LLIN was created with categories of being exposed “never”, “at least once” or “twice or more” during the course of the study.

Secondary data analysis

For this secondary analysis four types of data sets were used from each country, the household and cohort LLIN master lists and the household and cohort net result file including all observations across all four surveys per site. These data sets were then merged and unique identifiers created for each cohort net and household within each site. Based on the findings of the separate country data analyses on the relationship between SBC message exposure and net care attitude a new variable was created for the secondary analysis that combined the two variables into four groups as follows: (i) never positive net care attitude and never SBC exposed; (ii) never positive net care attitude and one or more SBC exposures; (iii) at least one positive care attitude combined with any number of SBC exposures; (iv) at least twice positive net care attitude and at least twice exposed to SBC messages.

Statistical analysis

Data was set up for survival analysis as a duration format data set where each time interval for a net was a separate observation. Survival analysis was done using a per-protocol approach, i.e. risk of failure was considered to start only on the first observation where the net was found hanging, i.e. excluding any net that was never hung as well as the time period to first hanging. Failure was defined as a net being reported lost to wear and tear or torn based on physical assessment (pHI). The time of failure was directly calculated from the report of time of loss by the respondent or taken as the mid-point between the last two surveys if time of loss was unknown. In addition, at each time point the proportion surviving in serviceable condition was plotted against the hypothetical survival curves with defined median survival as previously described [26].

For continuous variables, arithmetic means were used to describe the central tendency and the t-test for comparison of groups for normally distributed data. Otherwise, median and Kruskal–Wallis test were used. Proportions were compared by contingency tables and the Chi-squared test used to test for differences in proportions. For calculation of confidence intervals around estimates, the intra- and between-cluster correlation was taken into account using the svy command in Stata.

Determinants of survival in serviceable condition after the net was first hung were explored using Cox proportionate hazard models. Factors were tested first in individual models which were then used to construct the final multivariate models. Final model fit was tested using a linktest and Schoenfeld residuals and log–log plots were used to check the proportionate hazard assumption.

Results

The four-country sample included a cohort of 4672 campaign nets from 1976 households. At the end of follow-up, a definite outcome with respect to physical durability could be obtained for 3519 nets or 75%. As shown in Table 2 this proportion varied significantly between sites with the highest rate found in Zamfara (92%), Nigeria, and the lowest in Tete (45%), Mozambique. For 4/10 sites the proportion of cohort nets with definite outcomes was above 85% and for 8/10 over 70%. The most common reasons for loss to follow-up was households moving away or not being available at the time of the surveys and respondents being unable to state what had happened to a cohort net no longer present in the household.

Table 2 LLIN sampled into cohorts, definite outcomes and cohort nets ever found hanging
Full size table

The Oyo site in Nigeria was the only one with a peri-urban characteristic due to its proximity to the city of Ibadan, all others were rural and agricultural communities. House construction was very simple and fuel for cooking was predominantly firewood. Access to latrines was over 80% except in Oyo (32%) and Ebonyi (66%) in Nigeria, and Tete (52%) and Nampula (64%) in Mozambique. Similarly, over 80% of households had access to safe water except in Mongala (18%) and Sud Ubangi (0%) in DRC and Ebonyi (13%), Nigeria where people obtained drinking water from rivers and creeks. The household asset that varied most between sites was mobile phone ownership which was 79–82% in both sites in Zanzibar and Inhambane, Mozambique, 48–69% in Nigeria sites and Nampula, Mozambique and 10-35% in DRC and Tete, Mozambique. In none of the sites was there any evidence of significant changes in socio-economic status of households during the study period.

Most LLINs received from the campaign were not immediately used. Initial hanging and utilization of campaign nets at the baseline survey 2–6 months after distribution was below 50% in 8/10 sites ranging from 13 to 42%. Only in Sud-Ubangi (54%), DRC and Zamfara (77%), Nigeria was it higher. As shown in Table 2, the proportion of nets ever found hanging during the study period varied significantly between sites ranging from 99% in Zamfara, Nigeria to 55% in Mongala, DRC and Oyo, Nigeria. In only slightly more than half of the sites (6/10) did “ever found hanging” exceed 75%. The two main factors that influenced hanging and use of the campaign nets were the number of nets from other sources owned by households at a given time and whether or not the household had been oversupplied during the campaign distribution, i.e. received more than one LLIN for every two members.

Overall, 71% of households participated in all possible household surveys (country range 62 to 84%) and 90% (range 87 to 96%) attended three or more surveys. The combined net care attitude and SBC exposure variable showed clear differences between countries and sites (Fig. 1). Zamfara, Nigeria performed best with 95% of households showing consistently high net care attitude and high SBC exposure. Oyo, Nigeria and the DRC sites also performed well but within DRC Sud Ubangi showed higher attitude and SBC exposure than Mongala (p < 0.001). In Mozambique and Ebonyi, Nigeria there was considerable exposure to SBC, but this did not always translate into a positive net care attitude as between 28 and 62% of households had some level of SBC exposure, but never showed a positive net care attitude. Details of trends in SBC exposure and the mix of SBC channels over time have been presented in detail in the country-specific analyses [25,26,27,28].

Fig. 1
figure 1

Observations over time of households with high positive net care attitude (score > 1.0) and exposure to SBC messages. Never–never = never high net care attitude, never exposed to SBC messages; never–once+ = never high net care attitude and SBC exposure at least once; once–any = high net care attitude at once and any SBC exposure (none or any); twice+-twice+ = high net care attitude twice or more, SBC exposure twice or more

Full size image

The development of LLIN survival in serviceable condition over time is shown in Table 3. At baseline failure was 1% or less, but already at the 12-months follow-up survey survival was lower than the 92% expected under a 3-year median survival assumption in both DRC sites (70 and 89%) as well as for Pemba (86%), Zanzibar. At the end of follow-up after 31–37 months, survival ranged from 17% in Mongala, DRC, to 80% in Zamfara, Nigeria, a difference of 63 percentage points. The median value at the 36–months time-point was 51% with an inter-quartile range of 18 percentage points (37–55%).

Table 3 Survival in serviceable condition at follow-up intervals
Full size table

When plotted against the hypothetical survival curves with defined median survival (Fig. 2) most curves generally followed the s-shaped form of the hypothesized curves with a tendency of slightly higher survival estimates at 12 months compared to 24 and 36-months follow-up. The one exception was the Olyset™ Net in Pemba, Zanzibar (Fig. 2a) which started out near the 2-year median survival line but then gradually improved and ended up closer to the 3-year median survival line at 36 months. The country analysis suggests that this was at least in part due to an improvement of net care behaviour during the course of the study [27]. In Fig. 2 data on survival in serviceable condition is grouped by textile characteristics and shows that the same or very similar LLIN brands had a huge variation in physical durability performance. This is further confirmed by the estimated median survival in serviceable condition and their confidence intervals shown in Table 4. For the DawaPlus® 2.0 LLIN median survival time varied between 1.6 and 5.3 years between sites and for the Royal Sentry LLIN between 2.4 and 3.0 years. If all polyethylene-based, 150 denier LLIN brands were considered between-site variation ranged from 2.2 to 3.0 years. The median of the median survival estimates across the 10 sites was 2.9 years with an inter-quartile range of 0.8 years (2.4 to 3.2).

Fig. 2
figure 2

Variation in survival in serviceable condition by site and LLIN type. A = polyethylene 150 denier LLIN; B = polyester 100 denier LLIN, reference curves refer to hypothetical survival curves with defined median survival

Full size image
Table 4 Estimated median survival in serviceable condition by LLIN brand
Full size table

The variation between sites of the proportion of studied campaign nets used immediately after distribution or ever found hanging (Table 2) can be expected to influence the median survival estimates upwards, but it is noteworthy, that the site with the highest survival (Zamfara, Nigeria) also had the highest proportion of nets ever hung as well as the highest proportion of households with a very high net care attitude score. In order to exclude the impact of delayed use of nets during exploration of determinants of physical durability across countries the per-protocol approach was used in which the risk of failure to survive only started with the first observed hanging of the net. Results for the final cox regression model are shown in Table 5. As was the case in the individual country analyses [25,26,27,28], a strong household net care attitude was the strongest determinant of survival and was enhanced by exposure to SBC messages. Adjusting for other factors, LLIN from households with some SBC exposure but which never recorded a high net care attitude had a 30% better chance of survival (adjusted Hazard Ratio (aHR) 0.70) than LLIN from households which never reported SBC exposure and never recorded a high net care attitude. The survival advantage doubled to 65% (aHR 0.35) if the household was recorded with a high net care attitude at least twice during the study and also had been exposed the SBC messages at least twice. Plotting the adjusted survival curves for each determinant in Table 5 shows that LLINs from households in the twice–twice category gain approximately one full year of median survival compared to the never–never category of net care attitude and SBC exposure (Additional file 1: A). Other determinants of physical durability that improved survival were never cooking in the room where nets were hanging, nets being used by adults rather than only by children, nets from households in the highest wealth group, and nets in female headed households. A negative effect was noted for never folding the net up during the day, i.e. letting it hang loose over the sleeping place. However, none of these factors had as strong of an impact on survival as net care attitude and SBC exposure (see also Additional file 1: D–H).

Table 5 Determinants of physical survival of LLIN in a per-protocol Cox regression model
Full size table

No difference in survival was found between the LLIN types of 150 denier polyethylene-based compared to 100 denier polyester-based LLIN products after adjusting for other determinants even though the polyethylene-based LLIN had a slight advantage (Additional file 1: B). However, the final model still indicated a significant impact of the country variable. Specifically, LLIN survival was better in Nigeria compared to Mozambique, marginally poorer in Zanzibar and significantly poorer in DRC (Additional file 1: C). Variations by site within countries was not tested in this model as it coincided with the brand, but these differences have been described previously in the country analyses [25,26,27,28]. Variables tested but with no impact included educational status of head of household, storage of food in sleeping rooms and type of sleeping place.

Discussion

This secondary analysis of pooled data from standardized LLIN durability monitoring at 10 sites in four African countries allowed a look at the magnitude of variation in physical durability of LLIN beyond each individual country analysis. At the 36-months follow-up, which happened between 31 and 37 months post-distribution, the proportion of any LLIN product surviving in serviceable condition was found to vary by 63 percentage-points from 17 to 80% with an inter-quartile range of 18 percentage-points. Even when results were standardized for time of follow-up by expressing them as median years of survival, i.e. time until 50% of the LLIN had failed to be of service to the user, there was a 3.7 year difference between results from the 10 sites (1.6 to 5.3 years) with an inter-quartile range of 0.8 years.

There are a limited number of studies that used the new standardized methodology and either proportion of LLIN surviving in serviceable condition or a median survival estimate in years for comparison of LLIN in different locations. In Benin, Olyset™ Net was monitored in four districts, two in the North and two in the South of the country and after only 18 months the survival in serviceable condition varied between 49 and 65% (16 percentage-points) equivalent to a median survival of 1.5 to 1.9 years [32]. In a retrospective study design survival in serviceable condition of DawaPlus® 2.0 in three locations in Nigeria varied between 42 and 75% (33 percentage-points) after 3 years corresponding to 3.0 to 4.7 years of median survival [21]. And in a multi-brand, multi-country analysis of durability data from seven countries involving eight LLIN brands survival varied for the same brand between countries from 56 to 98% or by between 10 and 42 percentage-points after 3 years of follow-up [24, Additional file 2, Table S1]. These variations by location are significant and in a similar order of magnitude as observed in this study.

Some of the factors of net use environment and net handling and care that are responsible for the variance in LLIN physical durability and are consistent across the four countries have been identified in this secondary analysis. The one with the strongest explanatory value of these was the household net care attitude in connection with exposure to SBC messages about nets and their use, handling and care. The net care attitude score was based on a Likert scale comprising six questions which was then converted into a grouped variable of the frequency in which a household had presented with a very positive net care attitude in all the survey rounds (maximum four) it participated in. Likert scales have long been used in social sciences to capture respondent’s attitudes [33, 34]. Known limitations of this methodology were minimized by omitting the “neutral” response option to reduce central tendency bias [35] and by reversing some statements to minimize acquiescence bias [36]. While it will most likely be possible to further improve on the capture a positive net care attitude of net users, this is currently the best approach available and has been shown in two independent studies to correlate positively with better physical condition of nets [18, 21]. Household net care attitude was positively related with survival of LLIN in serviceable condition in a dose–response relationship, i.e. the stronger the evidence of a positive net care attitude, the greater was the effect of prolonging net life. This was also linked to the intensity of exposure to SBC messages on nets in a way that suggests that a positive attitude was possible even in the absence of SBC, but conversely exposure to SBC was not always sufficient to trigger a positive attitude. This is consistent with other studies that found SBC programmes to increase awareness and knowledge about net use, handing and care, but did not always found a positive effect on actual net care itself reflecting the complexity of the process of behavioural change [18, 37,38,39].

Some of variables found to be associated with physical durability were actions or behaviours directly related to protecting the LLIN from damage such as folding the net up to keep it out of harm’s way during the day, avoiding open fire or embers in the sleeping room, or better survival of nets used by adults only that can be expected to be more careful in their net handling than younger children. Other explanatory variables were indirect measures of net use environment and/or behaviours such as wealth or female heads of households which can be understood as proxies for more specific factors not yet sufficiently defined or captured in questionnaires. Individual analysis of country data also had shown some factors such as type of sleeping place to be relevant in some countries, but not in others [25,26,27,28] and also not in the pooled data. This strongly suggests that there is a lot of collinearity in the variables currently used to describe net use environment and net handling and care, e.g. a finished bed frame is likely associated with adult net users as well as better off households, so that only the strongest explanatory variables appear consistently as determinants of physical durability while others vary depending on the local constellation. After testing all possible variables in the data set of this study the Cox regression still indicated a significant effect of the country variable which implies that some important aspects were not captured at all. While variables used during the VectorWorks project in a standardized fashion represent some progress, there is definitely room for improvement in development of a comprehensive methodology to capture net use environment and behaviours relevant to physical LLIN durability. This could involve improvement of the questions used for net attitude assessment as well as addition of other behavioural aspects based on further qualitative research.

The data presented in this study suggests that differences in physical durability of LLIN products was driven by the location and not the LLIN brand. This is confirmed by the analysis of a large pooled data set of seven countries and eight LLIN brands followed between 2 and 4 years by Briët et al. [24], that found that for both survival and physical integrity there was significantly more variability of decline of protection over time by country than by LLIN brand. In country by country analysis of the data included in this study DuraNet© was shown to perform significantly better with respect to physical durability than DawaPlus® 2.0 in DRC [28] and PermaNet® 2.0 somewhat better than Olyset™ Net after adjusting for net care attitudes in Zanzibar [27] suggesting that in specific environments differences by textile characteristics of LLIN do exist. This was also found in mainland Tanzania where PermaNet® 2.0 and Netprotect® performed better than Olyset™ Net [22]. However, in Zambia no difference between PermaNet® 2.0 and Olyset™ Net could be found [19] nor was there a difference between PermaNet® 2.0 and Netprotect® in the same use environment in Cambodia [15].

It appears, therefore, that any differences by LLIN product characteristics are more subtle and at times can only be detected after adjustment for remaining differences in net handing and care and where use conditions are particularly difficult such as in DRC. Furthermore, results from the Cox regression in this study show that differences in LLIN product performance cannot be captured by rough categories of textile qualities such as yarn material and mass per length (denier). This suggests that additional elements that may be critical for the development or aggravation of damage have to be considered [40, 41].

Limitations

Some of the durability risk factors, such as net care attitude as well as some of the outcomes, such as reason for net losses were based on the answers of the household members interviewed and therefore, are prone to recall or social desirability biases. With the prospective design there is also the potential for the Hawthorne effect, whereby being asked about net care and handling four times over the course of 3 years may have contributed to changes in behaviour. The standard durability monitoring approach applied in this study tries to minimize this by conducting only four surveys versus every 6 months as had been done in some of the earlier studies. This study is further limited as the selection of LLIN brands was opportunistic, depending on which brands happened to be distributed in the countries where the project supported the LLIN durability activities resulting in not all brands present in all locations.

Conclusions

Variation in net use environment and net handling and care behaviour is the main factor to explain differences in the physical durability of different LLIN products in different locations. This emphasizes the need to always consider net use environment and care in the assessment of physical LLIN durability of LLIN brands. It further suggests that SBC interventions to improve net care should be strengthened. While some of these factors such as net care attitude and folding up nets during the day have been identified to work across countries, other factors remain poorly defined and more work is needed in this area.

Grouping LLIN brands by similar textile characteristics, namely 150 denier polyethylene-based versus 100 denier polyester-based LLIN is insufficient to distinguish LLIN product performance after adjustment for other factors suggesting that a more differentiated, composite metric is needed that would describe an LLIN’s ability to resist the stresses of day-to-day use and would be based on the detailed study of the mechanisms involved in hole formation.

Availability of data and materials

The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.

References

  1. WHO. Guidelines for laboratory and field testing of long-lasting insecticidal mosquito nets. Geneva: World Health Organization; 2005. WHO/CDS/WHOPES/GCDPP/2005.11.

  2. Port GR, Boreham PFL. The effect of bed nets on feeding by Anopheles gambiae Giles (Diptera: Culicidae). Bull Ent Res. 1982;72:483–8.

    Article  Google Scholar 

  3. Miller JE, Lindsay SW, Armstrong Schellenberg JRM, Adiamah J, Jawara M, Curtis CF. Village trial of bednets impregnated with wash-resistant permethrin compared with other pyrethroid formulations. Med Vet Entomol. 1995;9:43–9.

    Article  CAS  PubMed  Google Scholar 

  4. Kachur SP, Phillip-Howard PA, Odhacha AM, Ruebush TK, Oloo AJ, Nahlen BL. Maintenance and sustained use of insecticide-treated bednets and curtains three years after a controlled trial in western Kenya. Trop Med Int Health. 1999;4:728–35.

    Article  CAS  PubMed  Google Scholar 

  5. Clarke SE, Bøgh C, Brown RC, Pinder M, Walraven GEL, Lindsay SW. Do untreated bednets protect against malaria? Trans R Soc Trop Med Hyg. 2001;95:457–62.

    Article  CAS  PubMed  Google Scholar 

  6. Maxwell CA, Msuya E, Sudi M, Njunwa KJ, Carneiro IA, Curtis CF. Effect of community-wide use of insecticide-treated nets for 3–4 years on malaria morbidity in Tanzania. Trop Med Int Health. 2002;7:1003–8.

    Article  CAS  PubMed  Google Scholar 

  7. Erlanger TE, Enayati AA, Hemingway J, Mshinda H, Tami A, Lengeler C. Field issues related to effectiveness of insecticide-treated nets in Tanzania. Med Vet Entomol. 2004;18:153–60.

    Article  CAS  PubMed  Google Scholar 

  8. Spencer S, Grant AD, Piola P, Tukpo K, Okia M, Garcia M, et al. Malaria in camps for internally-displaced persons in Uganda: evaluation of an insecticide-treated bednet distribution programme. Trans R Soc Trop Med Hyg. 2004;98:719–27.

    Article  PubMed  Google Scholar 

  9. Shirayama Y, Phompida S, Kuroiwa C, Miyoshi M, Okumura J, Kobayashi J. Maintenance behavior and long-lasting insecticide-treated nets (LLITNs) previously introduced into Bourpar district, Khammouane province, Lao PDR. Public Health. 2007;121:122–9.

    Article  CAS  PubMed  Google Scholar 

  10. Kilian A, Byamukama W, Pigeon O, Atieli F, Duchon S, Phan C. Long-term field performance of a polyester-based long-lasting insecticidal mosquito net in rural Uganda. Malar J. 2008;7:49.

    Article  PubMed  PubMed Central  Google Scholar 

  11. Kilian A, Byamukama W, Pigeon O, Gimnig J, Atieli F, Koekemoer L, et al. Evidence for a useful life of more than three years for a polyester-based long-lasting insecticidal mosquito net in Western Uganda. Malar J. 2011;10:299.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Bhatt RM, Sharma SN, Uragayala S, Dash AP, Kamaraju R. Effectiveness and durability of Interceptor long-lasting insecticidal nets in a malaria endemic area of central India. Malar J. 2012;11:189.

    Article  PubMed  PubMed Central  Google Scholar 

  13. Allan R, O’Reilly L, Gilbos V, Kilian A. An observational study of material durability of three Wrld Health Organization-recommended long-lasting insecticidal nets in Eastern Chad. Am J Trop Med Hyg. 2012;87:407–11.

    Article  PubMed  PubMed Central  Google Scholar 

  14. WHO. Estimating functional survival of long-lasting insecticidal nets from field data. Vector Control Technical Expert Group Report to MPAC September 2013. http://www.who.int/malaria/mpac/mpac_sep13_vcteg_llin_survival_report.pdf Accessed 26 Aug 2019.

  15. Van Roey K, Sovannaroth S, Sochanta T, Touch MS, Pigeon O, Sluydts V, et al. A phase III trial to evaluate the efficacy, fabric integrity and community acceptance of Netprotect using a recommended insecticidal net as positive control. Malar J. 2014;13:256.

    Article  PubMed  PubMed Central  Google Scholar 

  16. Hakizimana E, Cyubahiro B, Rukundo A, Kabyiza A, Mutabazi A, Beach R, et al. Monitoring long-lasting insecticidal net (LLIN) durability to validate serviceable life assumptions, in Rwanda. Malar J. 2014;13:344.

    Article  PubMed  PubMed Central  Google Scholar 

  17. Dev V, Barman K, Khound K. A cross-sectional study assessing the residual bio-efficacy and durability of field-distributed long-lasting insecticidal nets in malaria endemic ethnic communities of Assam, Northeast India. J Infect Public Health. 2015;9:298–307.

    Article  PubMed  Google Scholar 

  18. Helinski M, Namara G, Koenker H, Kilan A, Hunter G, Acosta A, et al. Impact of a behaviour change communication programme on net durability in eastern Uganda. Malar J. 2015;14:366.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Tan KR, Coleman J, Smith B, Hamainza B, Katebe-Sakala C, Kean C, et al. A longitudinal study of the durability of long-lasting insecticidal nets in Zambia. Malar J. 2016;15:106.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Morgan J, Abílio AP, Pondja MR, Marrenjo D, Luciano J, Fernandes G, et al. Physical durability of two types of long-lasting insecticidal nets (LLINs) three years after mass LLIN distribution campaign in Mozambique, 2008–2011. Am J Trop Med Hyg. 2015;92:286–93.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Kilian A, Koenker H, Obi E, Selby RA, Fotheringham M, Lynch M. Field durability of the same type of long-lasting insecticidal net varies between regions in Nigeria due to differences in household behaviour and living conditions. Malar J. 2015;14:123.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Lorenz L, Bradley J, Yukich J, Massue DJ, Mboma ZM, Pigeon O, et al. Comparative functional survival and equivalent annual cost of three long lasting insecticidal net (LLIN) products in Tanzania. PLoS Med. 2020;17:e1003248.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Ahogni IB, Salako AS, Akinro B, Sovi A, Gnanguenon V, Azondekon R, et al. Physical integrity and survivorship of long-lasting insecticidal nets distributed to households of the same socio-cultural community in Benonm, West Africa. Malar J. 2020;19:58.

    Article  PubMed  PubMed Central  Google Scholar 

  24. Briët O, Koenker H, Norris L, Wiegand R, Vanden Eng J, Thackeray A, et al. Attrition, physical integrity and insecticidal activity of long-lasting insecticidal nets in sub-Saharan Africa and modelling of their impact on vectorial capacity. Malar J. 2020;19:310.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Abílio AP, Obi E, Koenker H, Babalola S, Saifodine A, Zullinger R, et al. Monitoring the durability of the long-lasting insecticidal nets MAGNet and Royal Sentry in three ecological zones of Mozambique. Malar J. 2020;19:209.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Obi E, Okoh F, Blaufuss S, Olapeju B, Akilah J, Okoko OO, et al. Monitoring the physical and insecticidal durability of the long-lasting insecticidal net DawaPlus® 2.0 in three States in Nigeria. Malar J. 2020;19:124.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  27. Haji KA, Khatib BO, Obi E, Dimoso K, Koenker H, Babalola S, et al. Monitoring the durability of the long-lasting insecticidal nets Olyset™ and PermaNet® 2.0 in similar use environments in Zanzibar. Malar J. 2020;19:187.

    Article  PubMed  PubMed Central  Google Scholar 

  28. Mansiangi P, Umesumbu S, Etewa I, Zandibeni J, Bafwa N, Blaufuss S, et al. Comparing the durability of the long-lasting insecticidal nets DawaPlus® 2.0 and DuraNet© in northwest Democratic Republic of Congo. Malar J. 2020;19:189.

    Article  PubMed  PubMed Central  Google Scholar 

  29. President’s Malaria Initiative: LLIN Durability Monitoring. https://www.durabilitymonitoring.org/ Accessed 24 Aug 2020.

  30. WHO. Guidelines for monitoring the durability of long-lasting insecticidal mosquito nets under operational conditions, WHO/HTM/NTD/WHOPES/2011.5. Geneva, World Health Organization, 2011. http://whqlibdoc.who.int/publications/2011/9789241501705_eng.pdf. Accessed 24 Aug 2020.

  31. WHO. WHO guidance note for estimating the longevity of Long-lasting Insecticidal nets in Malaria Control. Geneva, World Health Organization, 2013. https://www.who.int/malaria/publications/atoz/who_guidance_longevity_llins.pdf. Accessed 24 Aug 2020.

  32. Gnanguenon V, Azondekon R, Oke-Agbo F, Beach R, Akogbeto M. Durability assessment results suggest a serviceable life of two, rather than three years for the current long-lasting insecticidal (mosquito) net (LLIN) intervention in Benin. BMC Inf Dis. 2014;14:69.

    Article  Google Scholar 

  33. Likert R. A technique for the measurement of attitudes. Arch Psychol. 1932;22:1–55.

    Google Scholar 

  34. Flynn D, van Schaik P, van Wersch A. A comparison of multi-item likert and visual analogue scales for the assessment of transactionally defined coping functions. Eur J Psychol Assess. 2004;20:49–58.

    Article  Google Scholar 

  35. James LR, Demaree R, Wolf G. Estimating within-group interrater liability with and without response bias. J Appl Psychol. 1984;69:85–98.

    Article  Google Scholar 

  36. Lichtenstein E, Bryan JH. Acquiescence and the mmpi: an item reversal approach. J Abnorm Psychol. 1965;70:290–3.

    Article  CAS  PubMed  Google Scholar 

  37. Koenker H, Kilian A, Hunter G, Acosta A, Scandurra L, Fagbemi B, et al. Impact of a behaviour change intervention on long-lasting insecticidal net care and repair behaviour and net condition in Nasarawa State, Nigeria. Malar J. 2015;14:18.

    Article  PubMed  PubMed Central  Google Scholar 

  38. Panter-Brick C, Clarke SE, Lomas H, Pinder M, Lindsay SW. Culturally compelling strategies for behaviour change: a social ecology model and case study in malaria prevention. Soc Sci Med. 2006;62:2810–25.

    Article  PubMed  Google Scholar 

  39. Santos EM, McClelland DJ, Shelby CE, Hansen L, Jacobs ET, Klimentidis YC, et al. Malaria education interventions addressing bed net care and repair practices: a systematic review. Pathog Glob Health. 2020;114:2–15.

    Article  PubMed  Google Scholar 

  40. Käse SK, Russell SJ. Modes of holes formation in long-lasting insecticidal nets (LLINs) retrieved from South Eastern Ghana. Parasit Vectors. 2014;7:547.

    Article  PubMed  PubMed Central  Google Scholar 

  41. Skovmand O, Bosselmann R. Strength of bed nets as a function of denier, knitting pattern, texturizing and polymer. Malar J. 2011;10:87.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

We would like to thank all the staff that was involved in this study and has supported it at the community level. We would also like to acknowledge the valuable contributions of the CDC and USAID teams of PMI in reviewing the manuscript.

Funding

This work was made possible by the generous support of the American people through the United States Agency for International Development (USAID) and the U.S. President’s Malaria Initiative (PMI) under the terms of USAID/JHU Cooperative Agreement No: AID-OAA-A-14-00057. The contents do not necessarily reflect the views of USAID, PMI or the United States Government. We also would like to thank the Innovation to Impact project (I2I) funded by the Bill and Melinda Gates Foundation for their support in the analysis and manuscript development.

Author information

Authors and Affiliations

  1. PMI VectorWorks Project, Tropical Health LLP, Montagut, Spain

    Albert Kilian

  2. PMI VectorWorks Project, Tropical Health LLP, Abuja, Nigeria

    Emmanuel Obi

  3. Ecole de Santé Publique, Université de Kinshasa, Kinshasa, Democratic Republic of Congo

    Paul Mansiangi

  4. Instituto Nacional de Saúde, Maputo, Mozambique

    Ana Paula Abílio

  5. Zanzibar Malaria Elimination Programme, Stone Town, Zanzibar, Tanzania

    Khamis Ameir Haji

  6. PMI VectorWorks Project, JHU Center for Communication Programs, Baltimore, MD, USA

    Sean Blaufuss, Bolanle Olapeju, Stella Babalola & Hannah Koenker

Authors
  1. Albert Kilian
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Emmanuel Obi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Paul Mansiangi
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ana Paula Abílio
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Khamis Ameir Haji
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Sean Blaufuss
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Bolanle Olapeju
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Stella Babalola
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Hannah Koenker
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

Design of study and tools: AK, HK, SB, BO, EO; implementation and supervision: EO, PM, APA, KAH, SB, AK; analysis and interpretation: AK, HK. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Albert Kilian.

Ethics declarations

Ethics approval and consent to participate

For each country ethical clearance was obtained from the Institutional Review Board of the Johns Hopkins University, Baltimore, USA and the respective national ethics committees or equivalent. All participants provided written informed consent prior to participation.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Additional file 1: Figure S1

. adjusted survival curves for determinants of physical survival from cox regression. Contains survival graph for each variable in the final Cox regression model.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kilian, A., Obi, E., Mansiangi, P. et al. Variation of physical durability between LLIN products and net use environments: summary of findings from four African countries. Malar J 20, 26 (2021). https://doi.org/10.1186/s12936-020-03549-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12936-020-03549-2

Keywords

Malaria Journal

ISSN: 1475-2875

Contact us