Skip to main content
Download PDF

Estimation of bed net coverage indicators in Tanzania using mobile phone surveys: a comparison of sampling approaches

Malaria Journal volume 21, Article number: 379 (2022) Cite this article

Abstract

Background

Threats to maintaining high population access with effective bed nets persist due to errors in quantification, bed net wear and tear, and inefficiencies in distribution activities. Monitoring bed net coverage is therefore critical, but usually occurs every 2–3 years through expensive, large-scale household surveys. Mobile phone-based survey methodologies are emerging as an alternative to household surveys and can provide rapid estimates of coverage, however, little research on varied sampling approaches has been conducted in sub-Saharan Africa.

Methods

A nationally and regionally representative cross-sectional mobile phone survey was conducted in early 2021 in Tanzania with focus on bed net ownership and access. Half the target sample was contacted through a random digit dial methodology (n = 3500) and the remaining half was reached through a voluntary opt-in respondent pool (n = 3500). Both sampling approaches used an interactive voice response survey. Standard RBM-MERG bed net indicators and AAPOR call metrics were calculated. In addition, the results of the two sampling approaches were compared.

Results

Population access (i.e., the percent of the population that could sleep under a bed net, assuming one bed net per two people) varied from a regionally adjusted low of 48.1% (Katavi) to a high of 65.5% (Dodoma). The adjusted percent of households that had a least one bed net ranged from 54.8% (Pemba) to 75.5% (Dodoma); the adjusted percent of households with at least one bed net per 2 de facto household population ranged from 35.9% (Manyara) to 55.7% (Dodoma). The estimates produced by both sampling approaches were generally similar, differing by only a few percentage points. An analysis of differences between estimates generated from the two sampling approaches showed minimal bias when considering variation across the indicator for households with at least one bed net per two de facto household population.

Conclusion

The results generated by this survey show that overall bed net access in the country appears to be lower than target thresholds. The results suggest that bed net distribution is needed in large sections of the country to ensure that coverage levels remain high enough to sustain protection against malaria for the population.

Background

Malaria is a major public health issue and it is estimated that 229 million cases occurred globally in 2019, with Africa experiencing the largest burden [1]. It is endemic throughout most of mainland Tanzania and in Zanzibar [1, 2], and is a major cause of morbidity and mortality among children under five years of age and pregnant women [1]. According to Tanzania Demographic and Health Surveys (DHS), prevalence of malaria in children under five years of age declined by half from 18% in 2007–08 to 9% in 2011–12 [3, 4]. The 2017 Malaria Indicator Survey (MIS) data show a reduction in malaria prevalence from about 14% in 2015–16 to 7.5%; however, malaria parasite prevalence demonstrates a high degree of regional variation ranging from 24.4% to near zero [2, 5].

Due to the high prevalence and burden of malaria in Tanzania, the National Malaria Control Programme (NMCP) and the Zanzibar Malaria Elimination Programme (ZAMEP), in collaboration with their partners, implement several recommended preventive and curative interventions. One of the primary preventive strategies for reducing malaria transmission is the distribution and use of insecticide-treated bed nets (ITNs). Bed nets have been responsible for an estimated 68% reduction in global malaria cases since 2000 [6].

In Tanzania, the continuing efforts of the NMCP, ZAMEP, and their partners have achieved and largely sustained high population access to ITNs over the past several years. Globally, malaria control strategies are moving towards stratification by malaria prevalence to improve targeting of interventions and further reduce transmission and risk. Tanzania is at the forefront of this movement, having stratified its approaches at a council level in the latest National Strategy [7]. This National Strategy calls for a blend of ITN distribution channels depending on a council’s designated stratum with low, moderate, and high transmission settings delivering ITNs through annual school distributions, at reproductive and child health services (first antenatal clinic and immunization visits, respectively), and in mass campaigns when necessary. In very-low transmission strata, only ITN distribution via reproductive and child health services is implemented, and in urban locales ITNs are expected to be available in the commercial sector. The 2020 mass replacement campaign was implemented in 50 districts across 10 regions of mainland Tanzania; 14 regions of the mainland have implemented annual school distributions for the past 5–8 years, supported by the President’s Malaria Initiative, increasing the need for annual monitoring to inform quantifications for the subsequent year to maintain ITN access at high levels. Zanzibar has implemented a combination of mass campaigns, antenatal care distribution, and community-based distribution. However, threats to maintaining high population access with effective bed nets persist. Decreased bed net access resulting, in part, from errors in quantification, bed net wear and tear, and inefficiencies in distribution activities requires monitoring and surveillance to adapt and respond with appropriate interventions [2, 8].

Monitoring and surveillance of bed net distribution and coverage typically rely on household surveys, which are expensive, time consuming, and infrequent [9]. Alternatives such as lot quality assurance sampling surveys have been used in Tanzania and elsewhere, but such approaches are still household based and require significant investments in logistics and transportation [10,11,12,13]. In addition, given the COVID-19 pandemic, it was preferable to collect data using a method that eliminates face-to-face contact such as mobile phone surveys, which can protect both the participant and the interviewer.

Due to improvements in the affordability of mobile technology and ongoing network deployments to increase coverage areas, mobile phone ownership in low- and middle-income countries (LMIC) has rapidly increased [14,15,16,17,18]. This growth has resulted in mobile phone-based survey methodologies emerging as a comparatively inexpensive alternative to large scale population-based household surveys [19,20,21,22,23]. In LMIC settings, the use of random digit dialing (RDD) presents as an increasingly viable mobile phone survey option [24,25,26]; however, little research on varied sampling approaches has been conducted in sub-Saharan Africa.

A previous interactive voice response (IVR) random digit dial (RDD) mobile phone survey was conducted in Tanzania immediately following the 2017 MIS (unpublished data). The study demonstrated that while the degree of regional concordance between the RDD mobile phone survey and the 2017 MIS varied by assessed bed net indicator, generally the minimum, median, and maximum values for each indicator were consistent, suggesting that RDD mobile phone surveys are an acceptable, lower cost option for monitoring bed net coverage in Tanzania. The current study used a mobile phone survey with a dual sampling approach to provide cross-sectional estimates of bed net ownership and access across regions of mainland Tanzania and Zanzibar. This study also provided an opportunity to assess any apparent bias and efficiency gains in sampling from a frame of opt-in survey participants versus the standard RDD approach.

Methods

Viamo, the mobile phone survey operator, conducted the nationally and regionally representative cross-sectional mobile phone survey in Tanzania using an IVR method. The survey ran from January to March of 2021. Half the target was planned to be reached through a standard RDD methodology and the remaining half was planned to be reached by sampling from a voluntary opt-in respondent pool to allow for comparison of the two approaches. For both sampling approaches, Viamo programmed pre-recorded voice instructions in Kiswahili and respondents used the numeric keypad to input responses to a brief set of questions. Briefly, survey questions covered region of residence (for RDD respondents), household member counts, household bed net counts, and durable goods ownership (see Additional File 1 for a complete list survey questions). Questions for durable goods ownership were used in a poststratification weighting process to reduce the sampling error and potential non-response bias. Ineligible respondents were those under the age of 18 years or whose call was ended as the sample quota had been reached.

RDD sampling approach

For the RDD approach, Viamo dialed phone numbers at random to generate a pool of potential participants. Tanzania has a 12-digit mobile number structure with a prefix of 255 (the country code) followed by a three-digit secondary prefix of 51 different possibilities. From among the 51 different trunk number sequences, the final six digits are those that were randomly generated one at a time for each call.

Opt-in respondent pool sampling approach

The mobile network operator, Vodacom, shared with Viamo an ‘opt-in’ database of Tanzania-based phone numbers for respondents who reported that they would be willing to participate in mobile phone surveys related to health and well-being. The ‘opt-in’ database includes information on the region of residence of all individuals thereby reducing the cascade-style questions necessary to obtain such information. In utilizing the opt-in survey approach, the call center randomly sampled from geographic zone-specific blocks of numbers until regional quotas were met. The date that a Vodacom subscriber opted into the survey program is included in the opt-in database and Viamo was able to prioritize phone numbers from participants who had opted into the survey program within the 12 months preceding the survey. In the event there was difficulty reaching targeted sample sizes, the mobile phone survey operator was able to sample from older participant rolls.

Outcomes

In addition to project-specific indicators of interest, the primary outcomes for this monitoring activity include the following Roll Back Malaria Partnership to End Malaria-Monitoring and Evaluation Reference Group (RBM-MERG) indicators [27]:

  1. 1.

    Percent of households with at least one bed net of any type

  2. 2.

    Percent of households with at least one bed net of any type for every two people

  3. 3.

    Percent of de facto household population with access to a bed net of any type within their household.

Two non-RBM-MERG bed net indicators were also calculated:

  1. 1)

    Percent of bed nets self-reported by respondents as purchased

  2. 2)

    Percent of bed nets self-reported by respondents as originally or ever having been treated with insecticide

The non-RBM-MERG indicators were calculated at the bed net level. All bed net indicators were estimated by region and separately for the entirety of mainland Tanzania and Zanzibar.

Definitions

The American Association for Public Opinion Research (AAPOR) asks that mobile phone survey practitioners use AAPOR standard definitions for comparability across studies [28]. As such, standard definitions were used for the contact (CON3), response (RR5 and RR6), cooperation (COOP1 and COOP2), and refusal/break-off (REF3) rates for each sampling strategy. These measures are defined below where I = complete interview, P = partial interview, R = refusal and break-off, NC = non-contact, and O = other. Table 1 below describes the AAPOR call dispositions used to classify respondent calls.

Table 1 Call disposition descriptions
Full size table
$$CON3=\frac{\left(I+P\right)+R+O}{\left(I+P\right)+R+O+NC}$$
$$RR5= \frac{I}{\left(I+P\right)+\left(R+NC+O\right)}$$
$$RR6= \frac{I+P}{\left(I+P\right)+\left(R+NC+O\right)}$$
$$COOP1=\frac{I}{\left(I+P\right)+R+O}$$
$$COOP2=\frac{(I+P)}{\left(I+P\right)+R+O}$$
$$REF3=\frac{R}{\left(I+P\right)+\left(R+NC+O\right)}$$

Based on the call disposition categories described in Table 1, the number of finished interviews is higher than the number of complete/partial interviews, and complete interviews, being more restrictive in their designation, are a subset of partial interviews. All available data points were taken into consideration for calculation of each individual indicator of interest regardless of call disposition status, which resulted in differing sample sizes across indicators for the same regions.

Study size

For the IVR mobile phone survey, it was estimated that the precision of the estimate within each region should be similar to the precision obtained in a DHS or MIS. In a recent Tanzania DHS (2015–2016) and MIS (2017), approximately 400 households were chosen in approximately 20 enumeration areas per region. Assuming an 80% baseline ownership of at least one bed net at the household level a sample of 440 households in a cluster sample with a design effect of 2 has approximately 80% power to detect a difference of seven percentage points. This means that a mobile phone survey with a regional sample size of approximately 250 households should yield a similar precision assuming simple random sampling. The regional sample size target was split between two contact/sampling methods with a goal of 125 finished surveys per region from both the RDD and opt-in methods described above. Given the 28 regions in Tanzania (26 in mainland Tanzania plus Unguja and Pemba as two regions of Zanzibar), the total sample size is 7,000 surveys with 3,500 surveys coming from each sampling approach. For both sampling approaches, potential participants were recruited until regional quotas were met.

Data analysis

A number of quality checks were built into the survey such that participants who provided illogical responses (e.g., reporting more people sleeping in the household than household members, reporting more insecticide-treated bed nets than total bed nets in the household) heard an error message and were prompted to re-enter a valid value. Unweighted/unadjusted estimates were calculated for all indicators of interest. Following the initial analysis, poststratification adjustment was used to weight regional bed net indicator estimates. The marginal proportions of radio, TV, and bicycle ownership as well as region were calculated from the 2017 MIS and corresponding attributes from the combined RDD/opt-in surveys were raked to these MIS marginal proportions. Including region in the raking process ensured poststratification adjustment by the necessary administrative unit. All values in the narrative component of the report present adjusted indicator estimates. Additionally, logistic regression analyses were run for the two household-level RBM-MERG indicators with survey approach (RDD vs opt-in) as the outcome variable and household-level bed net indicator values used as predictor variables. Each regression controlled for region, radio and bicycle ownership, and household size.

Results

A total of 310,151 calls were placed to 246,233 unique phone numbers (Table 2). Of the total calls placed, 163,748 contacts were made (including refusals & breakoffs, partial/complete interviews, other classifications, and ineligible respondents – see Table 1 for a description of call dispositions). Of the 163,748 contacts made, 6,968 participants made it to the end of the survey regardless of whether they answered each question along the way (i.e., they may have skipped certain questions, but still finished the survey). A total of 3,020 interviews were designated as complete, meaning all bed net indicators of interest for these respondents could be calculated and for which poststratification adjustment could be conducted. Interviews designated as ‘complete’ were used to calculate overall response rate. The percent of finished interviews varied by region from 177% of target (Unguja region; n = 443) to 48% of target (Pemba region; n = 121).

Table 2 Call characteristics and AAPOR call disposition by method
Full size table

The response rate was approximately 1.5% across the combined RDD and opt-in survey methodologies. Because the opt-in method was expected to have fewer non-contact calls by virtue of the opt-in nature of the program, the cooperation rate, defined in Table 2, can be assessed to get an alternative indication of successful interviews as non-contacts are removed from the denominator. This metric was calculated at 2.7% for complete interviews. Table 2 also presents call characteristics by survey method (RDD and opt-in). Nearly one-quarter (24.9%) of calls placed to the opt-in group were designated as non-contacts. The cooperation rates between the two methods differed by about 0.8 percentage points in favor of the opt-in method. The average length of surveys with a call disposition of complete or partial was just under ten minutes. Just over three-quarters (77.7%) of respondents with complete/partial call designations finished the survey within 7.5 to 11.5 min.

Because respondents could skip or refuse to answer any question, the desired sample size of 250 respondents per region was not achieved for all assessed indicators despite reaching 99.5% of the overall target of finished interviews (6,968 of 7,000). The indicator for households with at least one bed net of any type had at least 250 valid responses for all regions except for Pemba where the sample size was 213 households or 81.5% of the target. For the other two assessed RBM-MERG indicators (percent of households with at least one bed net of any type for every two people and percent of de facto household population with access to a bed net of any type within their household), the desired sample size of 250 households was not reached for Katavi, Lindi, Mtwara, Rukwa, and Pemba regions. Aside from Pemba, which only reached 48% of the target, each of the aforementioned regions was within approximately 75% of the target. Additional File 2 shows the number of observations available by region to calculate assessed indicators.

The results for the three assessed RBM-MERG indicators are shown in Table 3. Population access to a bed net varied from an adjusted low of 48.1% in Katavi region to an adjusted high of 65.5% in Dodoma region. The adjusted percent of households that had a least one bed net ranged from 54.8% (Pemba) to 75.5% (Dodoma); the adjusted percent of households with at least one bed net per 2 de facto household population ranged from 35.9% (Manyara) to 55.7% (Dodoma); and the de facto household population access to a bed net ranged from an adjusted percent of 48.1% (Katavi) to 65.5% (Dodoma). Unweighted estimates are generally lower than those produced from the poststratification process for households with at least one bed net. The average regional difference between the two estimations is + 2.6 percentage points for this indicator although six regions exceed a difference of + 5 percentage points. Three-quarters of the regional estimates for both households with at least one bed net per two de facto household population and population access to a bed net were within ± 4 percentage points across the two estimates. Overall, adjusted regional estimates for households with at least one bed net per two de facto household population were generally lower than the unweighted estimates whereas the opposite is true of population access to a bed net.

Table 3 Unweighted and adjusted RBM-MERG bed net indicator estimates by region
Full size table

Additional non-RBM MERG indicators were also calculated including the percent of bed nets self-reported by survey respondents as purchased from an adjusted low of 18.9% (Songwe) to an adjusted high of 59.8% (Arusha) (Table 4). The indicator for the percent of bed nets self-reported by survey respondents to have ever been treated with insecticide which ranged from an adjusted low of 24.0% (Ruvuma) to an adjusted high of 56.2% (Mbeya).

Table 4 Non-RBM-MERG bed net indicators by region
Full size table

The difference in the RDD and opt-in method of calling respondents was significant at an alpha level of 0.05 for the indicators of households with at least 1 bed net (of any type) and households with at least 1 bed net (of any type) per 2 de facto household population. Assuming a national RDD base rate prevalence of 50% for households with at least 1 bed net, the corresponding prevalence for the national opt-in method is estimated to be 54.1% given an odds ratio of 1.18. Likewise, the indicator of household ownership of at least 1 bed net (of any type) per 2 de facto household population showed a significant difference between the two survey approaches and was associated with an odds ratio of 1.26. This is roughly consistent with a national RDD estimate of 50% prevalence corresponding to a national opt-in estimate of 55.8% prevalence. No significant differences between the two survey approaches were noted when assessing these same two indicators restricted to only ITN availability.

Discussion

The NMCP and ZAMEP have an established threshold of ≥ 80% de facto household population bed net access which constitutes an acceptable level of coverage. Bed net access levels below this threshold are likely to trigger additional ITN distribution response mechanisms. The results of the current study showed that no region met or exceeded the 80% threshold and in some regions the coverage estimates were rather low (~ 50% in eight regions) indicating an urgent need to ensure that additional ITNs are available. Indeed, the de facto household population access to a bed net ranged from an adjusted percent of 48.1% (Katavi) to 65.5% (Dodoma). Mobile phone survey estimates for the adjusted percent of households with at least one bed net per 2 de facto household population were also relatively low with 46.4% (16 of 28) of regions below 50%. However, nearly one-third (10 of 28; 35.7%) of regions were estimated to have at least 70% coverage of households with at least one bed net. The challenges of achieving and maintaining net access above 80% are significant, given the rates at which bed nets are lost to wear and tear and the challenges of reaching all households with sufficient bed nets when they need them [29, 30].

The mobile phone survey used for this study employed two different methods to sample respondents. First, a standard RDD approach in which truly random numbers were dialed and secondly, an opt-in-based approach in which a set of pre-identified, opt-in participant phone numbers were sampled for dialing. The estimates produced by both approaches were generally similar. However, the opt-in approach achieved the sample size targets more rapidly and in a wider range of regions of the country including among smaller and more sparsely populated regions. The dual sampling strategy allowed for an assessment of the relative bias of the RDD versus the opt-in approach with respect to household-level bed net coverage indicators. This assessment showed that, while significant, differences between the two survey methodologies were small and would likely not have a programmatically meaningful impact (see caption of Fig. 1). Nationally, the two household-level bed net indicators were estimated to be within 5 percentage points by either sampling strategy. The magnitude of this difference is not likely to greatly alter the decision-making process.

Fig. 1
figure 1

Comparison of mobile phone survey approaches. Using results from the regression output shown in Table 5, it is possible to estimate the difference in indicator values between the two survey approaches (RDD vs. opt-in method) for any base rate prevalence value. Given a strict decision rule to implement a mass distribution campaign once bed net access levels fall below a 50% threshold, a standalone opt-in survey methodology would erroneously trigger a campaign, assuming an RDD gold standard methodology, between prevalence values of 0.51 and 0.55 for households with at least one bed net per 2 de facto household population

Full size image
Table 5 Presents the results of the secondary objective of the study: the comparison of a true RDD approach to that of an opt-in approach
Full size table

One explanation for the particularly low bed net coverage estimates noted for several regions may be attributable to the 2020 mass replacement campaign (MRC) conducted for mainland Tanzania. In 10 of the regions selected for the MRC, only certain districts received bed nets. As such, coverage estimates for these 10 regions may be lower than anticipated as this survey includes districts which did not receive replacement bed nets in 2020. For example, only two of Kilimanjaro’s seven districts were targeted for the 2020 MRC, while survey respondents may have resided anywhere within the region, potentially underestimating the overall coverage of Kilimanjaro. Similarly, two of six councils in Njombe and two out of seven councils in Manyara were targeted for the 2020 MRC, the latter of which experienced ongoing distribution at the time of the survey.

Response rates for RDD IVR surveys are typically low, and it is common for breakoffs to occur quickly after successful contacts are made. A previous RDD mobile phone survey was conducted in Tanzania immediately following the 2017 MIS (unpublished data) which achieved a response rate (RR5) of 5.8% compared to the overall RR5 of 1.5% for the current survey. As an additional point of reference, a 2017 RDD IVR study conducted in Ghana reported achieving a response rate of 21% [31]. The low response rates noted for the current study (RR5 of 1.1% and 1.8% for the RDD and opt-in methods, respectively) may be due to an increase in RDD IVR surveys in Tanzania as a precaution against exposing survey enumerators to COVID-19. The overall increase in such mobile phone surveys may lead to respondent fatigue. In addition, in the context of COVID-19, respondents may be preoccupied with other concerns and therefore less likely to respond. Opt-in respondents were collectively expected to demonstrate a higher response rate than participants from the RDD sampling pool, but, surprisingly, their RR5 metric was only slightly higher. The potential benefits from the opt-in approach are shorter call times for those individuals completing the survey due to truncated cascade-style questions on location of residence as well as more willing participants (i.e., a higher response rate) compared to the true RDD approach. Indeed, the opt-in sampling strategy made 31,223 fewer calls than the RDD method but yielded about 100 additional completed surveys.

It is possible that survey participants contacted through the opt-in sampling strategy no longer lived in the region assigned to their record in the opt-in database. In order to simplify the phone interview and to ensure efficient sampling, the already recorded region of residence for these participants was assumed to be accurate and was not asked of them again. While misclassification of region of residence would lead to smoothing of coverage estimates across regions and limit the accuracy of these estimates, the use of more recent opt-in participants should reduce this effect. Note that the mobile phone survey operator managing the opt-in database verifies participant region of residence on at least an annual basis through active solicitation.

In general, non-coverage and non-response biases are potential issues when conducting mobile phone surveys in LMIC. As mobile phone penetration continues to increase across certain LMIC, however, non-coverage bias is gradually reduced [32, 33]. Nevertheless, evidence from recent studies show that MPS tend to oversample male, urban, younger, and better educated respondents – all of whom are generally more likely to own mobile phones in LMIC settings suggesting that non-coverage bias remains an issue [17, 31, 34, 35]. Mobile phone surveys also tend to underrepresent women in Africa, although it remains unclear the extent to which this underrepresentation reflects non-coverage bias or non-response bias [31, 36]. The potential bias in participant type may lead to differential responses to questions concerning the general health and well-being of family members including report on protective measures such as availability and use of bed nets.

The mobile phone survey questionnaire used for this research asked questions related to bed net use for pregnant women and children under five, but the sample size calculation was structured on household ownership of at least one net and did not factor in whether that household would have had members from these higher-risk groups. As such, few data points for these populations were available and calculation of net use indicators was not conducted. Sample size requirements for these target groups are likely to be too large to pragmatically conduct the mobile phone survey given general budget and time considerations.

Conclusion

Mobile phone surveys can provide rapid estimates of bed net coverage in Tanzania and may serve as a suitable source of information between large-scale household surveys. The veracity of estimates obtained from mobile phone surveys can be validated against household survey estimates, particularly if they are conducted contemporaneously. Based on the results generated by this survey, overall bed net access in the country appears to be lower than target thresholds, with some regions being especially low. The results suggest that bed net distribution is needed in large sections of the country to ensure that access levels remain high enough (above 80%) to permit high levels of bed net use and sustain protection of the population. Lastly, mobile phone survey sampling methodologies based on pre-existing, opt-in respondent lists may be a more efficient and simpler way to collect bed net coverage data compared to RDD methods.

Availability of data and materials

The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.

Abbreviations

DHS:

Demographic and Health Surveys

MIS:

Malaria Indicator Survey

NMCP:

National Malaria Control Programme

ZAMEP:

Zanzibar Malaria Elimination Programme

ITN:

Insecticide-treated bed net

LMIC:

Low- and middle-income countries

IVR:

Interactive voice response

RDD:

Random digit dial

RBM-MERG:

Roll Back Malaria Partnership to End Malaria-Monitoring and Evaluation Reference Group

AAPOR:

American Association for Public Opinion Research

MRC:

Mass replacement campaign

References

  1. WHO. World malaria report. 20 years of global progress and challenges. Geneva: World Health Organization; 2020. p. 2020.

    Google Scholar 

  2. Ministry of Health Community Development, Gender, Elders and Children; Ministry of Health [Zanzibar], Tanzania National Bureau of Statistics, Office of the Chief Government Statistician (OCGS), ICF International. Tanzania Malaria Indicator Survey 2017. Dar es Salaam, Tanzania, and Rockville, USA; 2017.

  3. Tanzania Commission for AIDS, National Bureau of Statistics, Office of the Chief Government Statistician (OCGS), and Macro International Inc. Tanzania HIV/AIDS and Malaria Indicator Survey 2007–2008. Dar es Salaam, Tanzania, 2008.

  4. Tanzania Commission for AIDS, National Bureau of Statistics (NBS), Office of the Chief Government Statistician (OCGS), and ICF International. Tanzania HIV/AIDS and Malaria Indicator Survey 2011–12. Dar es Salaam, Tanzania:, and Rockville, USA; 2013.

  5. Ministry of Health Community Development, Gender, Elders and Children, Ministry of Health [Zanzibar], National Bureau of Statistics, Office of the Chief Government Statistician, and ICF International. Tanzania Demographic and Health Survey and Malaria Indicator Survey (TDHS-MIS) 2015–16. Dar es Salaam, Tanzania, and Rockville, USA; 2016.

  6. Bhatt S, Weiss DJ, Cameron E, Bisanzio D, Mappin B, Dalrymple U, et al. The effect of malaria control on Plasmodium falciparum in Africa between 2000 and 2015. Nature. 2015;526:207–11.

    Article  CAS  Google Scholar 

  7. The United Republic of Tanzania. Tanzania National Strategy for Vector Control, 2019–2024. Ministry of Health, Community Development, Gender, Elderly and Children. Tanzania National Strategy for Vector Control, 2019–2024. 2019.

  8. Kilian A, Obi E, Mansiangi P, Abílio AP, Haji KA, Blaufuss S, et al. Variation of physical durability between LLIN products and net use environments: summary of findings from four African countries. Malar J. 2021;20:26.

    Article  CAS  Google Scholar 

  9. Aday LA, Cornelious LJ. Designing and conducting health surveys: a comprehensive guide. 3rd ed. San Francisco: Jossey-Bass; 2006.

    Google Scholar 

  10. Hoshaw-Woodard S. Description and comparison of the methods of cluster sampling and lot quality assurance sampling to assess immunization coverage. Geneva: World Health Organization; 2001.

    Google Scholar 

  11. MEASURE Evaluation. Report of a Technical Meeting on the Use of Lot Quality Assurance Sampling (LQAS) in Polio Eradication Programs. Chapel Hill, NC: Carolina Population Center, University of North Carolina; 1998.

  12. Singh J, Jain DC, Sharma RS, Verghese T. Evaluation of immunization coverage by lot quality assurance sampling compared with 30-cluster sampling in a primary health centre in India. Bull World Health Organ. 1996;74:269–74.

    CAS  Google Scholar 

  13. Vanamail P, Subramanian S, Srividya A, Ravi R, Krishnamoorthy K, Das PK. Operational feasibility of lot quality assurance sampling (LQAS) as a tool in routine process monitoring of filariasis control programmes. Trop Med Int Health. 2006;11:1256–63.

    Article  CAS  Google Scholar 

  14. Ame AM, Jacob S. Relationship between network coverage and teledensity growth - case of giant telecommunication companies of Tanzania. Int J Manag IT Eng. 2013;3(5):459–73.

    Google Scholar 

  15. World Bank. Information and communications for development : maximizing mobile. Washington, DC: World Bank; 2012.

    Google Scholar 

  16. Castells M, Qui JL, Fernandez-Ardevol M, Sey A. Mobile communication and society: a global perspective. Cambridge, MA: MIT Press; 2009.

    Google Scholar 

  17. GMSA Intelligence. The Mobile Economy - Sub-Saharan Africa 2014. 2014.

  18. Minges M. Mobile cellular communications in the Southern African region. Telecomm Policy. 1999;23:585–93.

    Article  Google Scholar 

  19. Ballivian A, Azevedo JP, Durbin W. Using mobile phones for high-frequency data collection. In: Toninelli D, Pinter R, de Pedraza P, editors. Mobile research methods opportunities and challenges of mobile research methodologies. London: Ubiquity Press; 2015.

    Google Scholar 

  20. Croke K, Dabalen A, Demombynes G, Giugale M, Hoogeveen J. Collecting high frequency panel data in Africa using mobile phone interviews. In: The World Bank Policy Research Working Papers, Africa Region. 2012.

  21. Gibson DG, Pereira A, Farrenkopf BA, Labrique AB, Pariyo GW, Hyder AA. Mobile phone surveys for collecting population-level estimates in low- and middle-income countries: a literature review. J Med Internet Res. 2017;19: e139.

    Article  Google Scholar 

  22. Hyder AA, Wosu AC, Gibson DG, Labrique AB, Ali J, Pariyo GW. Noncommunicable disease risk factors and mobile phones: a proposed research agenda. J Med Internet Res. 2017;9(5): e7246.

    Google Scholar 

  23. Mahfoud Z, Ghandour L, Ghandour B, Mokdad AH, Sibai AM. Cell phone and face-to-face interview responses in population-based surveys. Field Methods. 2014;27:39–54.

    Article  Google Scholar 

  24. Hu SS, Balluz L, Battaglia MP, Frankel MR. The impact of cell phones on public health surveillance. Bull World Health Organ. 2010;88:799.

    Article  Google Scholar 

  25. Labrique A, Blynn E, Ahmed S, Gibson D, Pariyo G, Hyder AA. Health surveys using mobile phones in developing countries: automated active strata monitoring and other statistical considerations for improving precision and reducing biases. J Med Internet Res. 2017;19: e121.

    Article  Google Scholar 

  26. World Bank. World Development Report 2016: Digital Divides. Washington, DC: World Bank; 2016.

    Book  Google Scholar 

  27. MEASURE Evaluation, The Demographic and Health Surveys, The President's Malaria Initiative, Roll Back Malaria Partnership, United Nations Children's Fund, World Health Organization. Household Survey Indicators for Malaria Control. 2018.

  28. The American Association for Public Opinion Research. Standard definitions: final dispositions of case codes and outcome rates for surveys. 2016.

  29. Bertozzi-Villa A, Bever CA, Koenker H, Weiss DJ, Vargas-Ruiz C, Nandi AK, et al. Maps and metrics of insecticide-treated net access, use, and nets-per-capita in Africa from 2000–2020. Nature Commun. 2021;12:3589.

    Article  CAS  Google Scholar 

  30. Koenker H, Arnold F, Ba F, Cisse M, Diouf L, Eckert E, et al. Assessing whether universal coverage with insecticide-treated nets has been achieved: is the right indicator being used? Malar J. 2018;17:355.

    Article  Google Scholar 

  31. L’Engle K, Sefa E, Adimazoya EA, Yartey E, Lenzi R, Tarpo C, et al. Survey research with a random digit dial national mobile phone sample in Ghana: methods and sample quality. PLoS ONE. 2018;13: e0190902.

    Article  Google Scholar 

  32. Leo B, Morello R, Mellon J, Pieixoto T, Davenport S. Do mobile phone surveys work in poor countries? Washington DC: Center for Global Development; 2015.

    Google Scholar 

  33. Tran MC, Labrique AB, Mehra S, Ali H, Shaikh S, Mitra M, et al. Analyzing the mobile “digital divide”: changing determinants of household phone ownership over time in rural Bangladesh. JMIR Mhealth Uhealth. 2015;3: e24.

    Article  Google Scholar 

  34. Pew Research Center. Internet connectivity seen as having positive impact on life in sub-Saharan Africa. 2018.

  35. Rheault M, McCarthy J. Disparities in cellphone ownership pose challenges in Africa: Gallop World Poll; 2015. https://news.gallup.com/poll/189269/disparities-cellphone-ownership-pose-challenges-africa.aspx. Accessed Dec 7 2021.

  36. Lau CQ, Lombaard A, Baker M, Eyerman J, Thalji L. How representative are SMS surveys in Africa? Experimental evidence from four Countries. Int J Public Opinion Res. 2019;31:309–30.

    Article  Google Scholar 

  37. World Medical Association. Ethics Unit. Declaration of Helsinki 2007 https://www.wma.net/policies-post/wma-declaration-of-helsinki-ethical-principles-for-medical-research-involving-human-subjects/. Accessed Apr 6 2022.

Download references

Funding

This work is made possible by the generous support of the American people through the United States Agency for International Development (USAID) and the President’s Malaria Initiative (PMI) under the terms of USAID/JHU Contract number 72062120C00001. The contents do not necessarily reflect the views of PMI or the United States Government.

Author information

Authors and Affiliations

  1. USAID Tanzania Vector Control Activity, Tropical Health, New Orleans, LA, USA

    Matt Worges & Joshua Yukich

  2. USAID Tanzania Vector Control Activity, Johns Hopkins University School of Public Health Center for Communication Programs, Dar Es Salaam, Tanzania

    Benjamin Kamala, Deodatus Mwingizi & David Dadi

  3. Tanzania National Malaria Control Program, Dodoma, Tanzania

    Frank Chacky, Samwel Lazaro, Charles Dismas, Sijenun Aroun & Mponeja P. Gitanya

  4. Zanzibar Malaria Elimination Programme, Zanzibar, Tanzania

    Raya Ibrahim & Mwinyi Khamis

  5. Viamo, Dar Es Salaam, Tanzania

    Hannah Metcalfe, Willhard Bantanuka & Sena Deku

  6. U.S. President’s Malaria Initiative, Dar Es Salaam, Tanzania

    Naomi Serbantez

  7. USAID Tanzania Vector Control Activity, Johns Hopkins University School of Public Health Center for Communication Programs, Baltimore, MD, USA

    Dana Loll

  8. USAID Tanzania Vector Control Activity, Tropical Health, Baltimore, MD, USA

    Hannah Koenker

Authors
  1. Matt Worges
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Benjamin Kamala
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Joshua Yukich
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Frank Chacky
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Samwel Lazaro
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Charles Dismas
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Sijenun Aroun
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Raya Ibrahim
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Mwinyi Khamis
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Mponeja P. Gitanya
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. Deodatus Mwingizi
    View author publications

    You can also search for this author in PubMed Google Scholar

  12. Hannah Metcalfe
    View author publications

    You can also search for this author in PubMed Google Scholar

  13. Willhard Bantanuka
    View author publications

    You can also search for this author in PubMed Google Scholar

  14. Sena Deku
    View author publications

    You can also search for this author in PubMed Google Scholar

  15. David Dadi
    View author publications

    You can also search for this author in PubMed Google Scholar

  16. Naomi Serbantez
    View author publications

    You can also search for this author in PubMed Google Scholar

  17. Dana Loll
    View author publications

    You can also search for this author in PubMed Google Scholar

  18. Hannah Koenker
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

MW, BK, JY, FC, SL, CD, SA, RI, MK, MG, DM, HM, WB, SD, DD, NS, DL, and HK assisted in the design of the study, MW conducted the analysis and drafted the manuscript. MW, BK, JY, FC, SL, CD, SA, RI, MK, MG, DM, HM, WB, SD, DD, NS, DL, and HK reviewed and approved the final manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Matt Worges.

Ethics declarations

Ethics approval and consent to participate

All research activities conformed to the Declaration of Helsinki [37]. Ethical approval to conduct the study was received from the Tanzania National Institute for Medical Research (Ref. NIMR/HQ/R.8a/Vol. IX/3473). Participant consent was obtained from an affirmative response to a pre-recorded message that read out a short consent script at the beginning of the mobile phone survey.

Consent for publication

The permission to publish the findings was obtained from NIMR with approval number NIMR/HQ/P.12 VOL XXXIII/132.

Competing interests

The authors declare they have no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1:

Mobile Phone Survey Questionnaire.

Additional file 2:

Count of survey responses by indicator and region.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Worges, M., Kamala, B., Yukich, J. et al. Estimation of bed net coverage indicators in Tanzania using mobile phone surveys: a comparison of sampling approaches. Malar J 21, 379 (2022). https://doi.org/10.1186/s12936-022-04408-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12936-022-04408-y

Keywords

  • ITN
  • Mobile phone survey
  • Random digit dial
  • Coverage indicators
  • Tanzania

Malaria Journal

ISSN: 1475-2875

Contact us