- Case study
- Open Access
A description of malaria sentinel surveillance: a case study in Oromia Regional State, Ethiopia
© Yukich et al.; licensee BioMed Central Ltd. 2014
Received: 31 October 2013
Accepted: 2 March 2014
Published: 11 March 2014
In the context of the massive scale up of malaria interventions, there is increasing recognition that the current capacity of routine malaria surveillance conducted in most African countries through integrated health management information systems is inadequate. The timeliness of reporting to higher levels of the health system through health management information systems is often too slow for rapid action on focal infectious diseases such as malaria. The purpose of this paper is to: 1) describe the implementation of a malaria sentinel surveillance system in Ethiopia to help fill this gap; 2) describe data use for epidemic detection and response as well as programmatic decision making; and 3) discuss lessons learned in the context of creating and running this system.
As part of a comprehensive strategy to monitor malaria trends in Oromia Regional State, Ethiopia, a system of ten malaria sentinel sites was established to collect data on key malaria morbidity and mortality indicators. To ensure the sentinel surveillance system provides timely, actionable data, the sentinel facilities send aggregate data weekly through short message service (SMS) to a central database server. Bland-Altman plots and Poisson regression models were used to investigate concordance of malaria indicator reports and malaria trends over time, respectively.
This paper describes three implementation challenges that impacted system performance in terms of: 1) ensuring a timely and accurate data reporting process; 2) capturing complete and accurate patient-level data; and 3) expanding the usefulness and generalizability of the system’s data to monitor progress towards the national malaria control goals of reducing malaria deaths and eventual elimination of transmission.
The use of SMS for reporting surveillance data was identified as a promising practice for accurately tracking malaria trends in Oromia. The rapid spread of this technology across Africa offers promising opportunities to collect and disseminate surveillance data in a timely way. High quality malaria surveillance in Ethiopia remains a resource intensive activity and extending the generalizability of sentinel surveillance findings to other contexts remains a major limitation of these strategies.
Disease surveillance is one of the fundamental functions of public health systems , and recording and reporting of malaria cases is practiced in nearly all countries where transmission persists. Malaria remains a reportable disease even in countries, such as the United States of America, where sustained autochthonous transmission has long been essentially absent . To realistically embark on the road towards malaria elimination, timely provision of accurate malaria surveillance data is necessary . In the context of the massive scale up of malaria interventions, there is increasing recognition that the current capacity of routine malaria surveillance, conducted in most African countries through integrated health management information systems (HMIS), is inadequate: indicators are poorly defined; data reporting and completeness are often of unknown quality; and timeliness can be extremely variable. Further, there is often limited capacity for data analysis, data interpretation, and action. Additionally, in many locations confirmatory malaria diagnosis is of variable quality or absent [4, 5].
In most sub-Saharan African (SSA) countries, routine malaria surveillance involves collecting and reporting aggregate data from public health facilities through the national HMIS. Data are collected about patients presenting at public facilities with symptoms of disease, and malaria cases are reported based on the diagnostic services available at the facility, or sometimes reported on clinical signs and symptoms only when diagnostic tools are absent. Where laboratory services are available, microscopy has generally been the most common form of confirmatory diagnosis. Although microscopy is generally considered the gold standard for malaria laboratory diagnosis, rapid diagnostic tests (RDT) have recently been rolled out in many SSA settings, particularly at the community level where microscopy is generally not available. This expansion may help to rationalize treatment practices and to improve the quality of surveillance data in many locations [6, 7]. Data about malaria illnesses, with or without laboratory diagnostic confirmation, tend to be compiled weekly or monthly at each health facility and then reported up a vertical chain, with further aggregation at each level in the health system until reaching the most central level, such as the HMIS surveillance headquarters. These aggregated data are then ideally used by National Malaria Control Programmes (NMCP) and Ministries of Health (MoH) to make decisions related to the timing and frequency of prevention, treatment, and control interventions.
In general, routine surveillance systems tend to miss many malaria cases because they are either treated outside the formal public health system, not treated at all; underreporting and failure to capture testing and treatment data within the system can also lead to missed malaria cases. Concurrently, routine surveillance data may vastly overestimate the burden of malaria within the public health system due to under-utilization or lack of diagnostics, and a consequent reliance on clinical diagnosis. Additional challenges, such as poor data recording practices and lack of supervision, have an unknown effect on routine system data quality. In some settings, failure of facilities to completely report upwards in the reporting chain also results in aggregation of incomplete datasets and generalized under-reporting of malaria burden. Additionally, the timeliness of reporting to higher levels of the health system is often too slow for rapid action on focal infectious diseases, such as malaria. Validation of such data is nearly impossible in the absence of gold standard data sources to assess the system’s sensitivity and diagnostic quality control, which is often logistically difficult for microscopy and currently unavailable for RDTs. Furthermore, support and supervision for surveillance activities is often lacking within the HMIS. Small-scale sentinel surveillance with enhanced supervision and rapid reporting mechanisms are a viable alternative to relying solely on data collected through the country’s routine HMIS and may provide the best available gold standard for malaria surveillance and epidemic detection.
Ethiopia’s national malaria control strategic plan includes goals to eliminate malaria in low-transmission areas and achieve near zero deaths due to malaria by 2015. To monitor progress towards these goals, a system for capturing both local and regional transmission is essential. Particularly, there is a need for an effective surveillance system that can target focal areas of infection, increase capacity to identify transmission hot spots, and monitor near real-time malaria data to rapidly identify changes in malaria transmission, morbidity and mortality. The purpose of this paper is to: 1) describe the design and implementation of a malaria sentinel surveillance system in Oromia, Ethiopia; 2) describe data use for epidemic detection and response, as well as programmatic decision making; and 3) discuss lessons learned related to creating and running this system to provide practical examples and suggestions for improvement and use in other systems or settings.
As part of a comprehensive strategy to monitor malaria trends in Oromia Regional State, Ethiopia, a system of ten malaria sentinel sites was initially established in early 2010 to collect data on key malaria morbidity and mortality indicators. This work was supported by the U.S. President’s Malaria Initiative (PMI) and implemented by Tulane University and Addis Continental Institute of Public Health in close collaboration with a range of stakeholders, including the Federal Ministry of Public Health (FMOH), Oromia Regional Health Bureau (ORHB), and the Ethiopian Health Nutrition and Research Institute (EHNRI). This work was approved by the Biomedical Institutional Review Board of Tulane University and the Ethical Review Committee of the Addis Continental Institute of Public Health.
The strengths and weaknesses of the system were assessed by a combination of methods over three years of implementation using various tools including: needs assessments, stakeholder interviews, supervision reports, data quality audits, laboratory and system quality control assessments, and analysis of surveillance data. These data formed the framework for assessing the lessons learned and best practices presented below. Methods for data quality audits and the general framework for assessment were based on frameworks outlined in U.S. Centres for Disease Control (CDC) guidelines [8, 9].
Malaria situation in Ethiopia
In Ethiopia, altitude and climate are the most important determinants of malaria transmission, which is highly seasonal and predominantly unstable . The peak malaria transmission season occurs between September–December, while a minor transmission season occurs in April–May. There are four major eco-epidemiological malaria transmission strata in Ethiopia: 1) malaria-free highland areas above 2,500-meter altitude; 2) highland fringe areas between 1,500 and 2,500 meters (affected by frequent epidemics); 3) lowland areas below 1,500 metres (seasonal pattern of transmission); and 4) stable malaria areas (year-round transmission; limited to the western lowlands and river basins). Plasmodium falciparum and Plasmodium vivax are the dominant malaria parasites in Ethiopia, with their relative contribution thought to be approximately 60% and 40% of all malaria cases, respectively. Plasmodium malariae accounts for less than 1% of cases and Plasmodium ovale is very rare [12–14]. The primary malaria vector in Ethiopia is Anopheles arabiensis; secondary vectors include Anopheles pharoensis, Anopheles funestus and Anopheles nili[11, 15–18]. Since little malaria transmission is apparent at altitudes above 2,000 metres, most malaria interventions, including insecticide-treated nets, are targeted to areas below 2,000 metres .
Selection of sentinel surveillance sites
Ten primary health care units (PHCU) in Oromia were initially selected as sentinel sites for malaria surveillance activities. PHCU serve a catchment area of ~25,000 people and consist of district (woreda)-level health centres and satellite community (kebele)-level health posts. Health centres are primarily concentrated in urban areas, and are usually staffed by at least one health officer, laboratory technicians, pharmacists or druggists, and midwives. Most health centres have inpatient capabilities, albeit limited, and as such they are the first referral point for severe malaria cases identified at health posts. Health posts are usually in rural areas and focus on preventive services, providing only limited curative services, mainly for malaria. Health posts are staffed by two health extension workers (HEWs), who are fully-salaried FMOH staff. These HEWs are primarily women with a high school diploma and typically originate in the communities they serve. HEWs provide service delivery on 16 selected health packages for which they receive specific training, including malaria. They are expected to confirm all suspected malaria cases (fever cases) with a multi-species RDT and provide appropriate treatment based on RDT results.
Data collection and reporting
Patient data were collected at two main service delivery points: health centres and health posts. At health centres, an outpatient department (OPD) register and a laboratory register captured patient demographic and malaria data. The OPD registers were designed to capture information on patient age, location of residence, fever history, laboratory tests requested, laboratory results for malaria and relapsing fever through microscopic examination of Giemsa or Field stained blood slides or multi-species RDT (CareStart®, AccessBio, NJ), species-specific final diagnosis (i.e., uncomplicated malaria, severe [complicated] malaria, other), drugs prescribed, inpatient admittance, death and referral to higher level facilities. At health posts, data were collected from the routine fever and malaria patient register. Because HEWs at health posts can currently only provide treatment for one acute illness (malaria infection), one patient register covers all diagnostic testing and treatment services.
Surveillance field support staff initially visited each health centre every two weeks (after one year this was changed to monthly) to work with health centre staff to extract relevant malaria data from the registries and share findings from previous months and from other facilities in the surveillance network. Data in the field were collected using paper forms; after each visit the field support staff entered all data into a pre-populated data base IV format (dbfIV) file using EpiInfo 7.0 (U.S. Centers for Disease Control and Prevention). Additional points of communication and data collection at health facilities included the medical stores and dispensaries, where stocks of malaria-related commodities are tracked. Health posts were visited monthly to extract relevant malaria data from paper registers. In addition to register abstraction, all health posts and health centres sent data electronically in aggregate on a weekly basis via short message systems (SMS). Data from the SMS system are maintained in a separate database, as paper registry and laboratory records were considered gold standard data. These data were compared using methods discussed below to ensure accuracy of rapid reporting data.
The web-based interface allows users to view the data in near real-time for assessment of expected and actual malaria cases occurring within the defined area. A second mechanism of epidemic notification occurs in the form of both an email and SMS text sent to the users when a specific threshold is reached. For example, when a data report is submitted, the system automatically checks the values of P. falciparum and P. vivax test positivity rates (TPR) as well as numbers of laboratory-confirmed cases against predefined threshold values for that health facility. If any of the indicators meet or exceed the threshold value for that facility in a given week, the system automatically sends an e-mail and text to the health centre or post, or to other designated users where the epidemic notification had been triggered. The message includes the indicator that triggered the alert, the current data value, the threshold value, and the catchment area to which the facility is associated.
The system interacts with the standard surveillance system for malaria in Ethiopia at multiple points. These include notification of relevant officials at all levels, including woreda malaria focal persons, of unusual malaria morbidity or mortality reports, in-person and telephone follow-up at the woreda and facility level for routine supervision and the communication of results of surveillance activities to the higher levels of the Ethiopian health system including the Federal Ministry of Health.
Data quality assurance
To reduce the potential for SMS system error, several automatic basic data logic checks are employed on reports. These include checks to ensure that confirmed cases do not exceed malaria tests conducted and other similar logical checks. If an SMS data report fails to meet these checks, the surveillance system sends a message to the sender indicating a resubmission is necessary. The system overwrites the original report once a resubmission has been submitted, and a message confirming receipt of the new report is automatically sent to the sender. To ensure data quality on paper forms, every month members of the field support team visit each health centre to check registers against physician and patient records. All data from OPD and laboratory registers are recorded in triplicate during the patient encounter. During field support visits, members of the team conducting supervision extract one copy of the register pages; using a copy of the source data instead of transcribing the source data removes one level of possible error. Where register data are incomplete, reconciliation is attempted using the routine physician patient records (i.e., OPD cards). Records are also cross-checked with the routine laboratory and dispensary registers to confirm tests were performed and drugs dispensed, as indicated.
Malaria at sentinel sites
Data on outpatient testing and laboratory confirmation of malaria cases has been collected in the sentinel sites over a period of 43 months. To examine trends in cases over time, multilevel time series Poisson random effects regression models were fit to data across all sites and over the entire time series with fixed effect covariates for month and year (either as a factor variable or as a linear time trend). Outcome variables were either all confirmed malaria cases or species-specific confirmed malaria cases (P. falciparum or P. vivax) with the exposure of total outpatients attending the facility during the month. Random intercepts were included for both the facility and PHCUs (i.e. health centres/satellite health posts).
Regression modeled estimates of trends in malaria cases at all sentinel sites
N (facility-month observations)
Incidence rate ratio
All cases linear trend
Year (Linear trend)
All cases year factor
P. falciparum cases linear trend
P. falciparum cases year factor
P. vivax cases linear trend
Year (Linear trend)
P. vivax cases year factor
This sentinel surveillance system captures data related to malaria morbidity, mortality, diagnosis, and treatment. The discussion of this paper focuses on three key implementation challenges affecting data interpretation, as well as possible solutions. The three challenges include: the data recording and reporting process, use of diagnostics, and data use for decision-making.
Generating timely and accurate data
Although the paper-based data reporting process at sentinel sites has been successful in delivering quality data from health centres and health posts to stakeholders on a monthly basis, the reliance on periodic field-based support visits for data collection slowed the process and was resource-intensive. Additionally, rapid reporting became even more challenging when health post (community level) data were included. The integration of weekly SMS reporting greatly improved the timeliness of the surveillance system with relatively little loss of fidelity, especially after a “burn-in” period. Use of SMS and overall maturation of the system allowed the scaling back of supervision from twice monthly to once monthly, thus improving the overall efficiency of the surveillance system. Over time, supervision could potentially be reduced to once every two or three months, assuming staff turnover at health facilities is kept to a minimum.
Capturing complete and accurate patient level data
The sentinel surveillance system protocol requires that clinicians and laboratory staff enter data in their respective registers at the time of the patient encounter (or accurately capture such data from patient cards at a later date). Laboratory registers in Ethiopia have remained consistent, reliably filled and comprehensive. However, OPD registers have at times been incomplete, particularly for identifying suspect malaria cases; a problem which will not be remedied by the use of SMS reporting systems. The OPD registers’ incompleteness is further compounded by the use of multiple data forms, including an HMIS register that does not capture the necessary data for malaria surveillance (e.g. HMIS indicators currently capture neither testing rates nor consistently differentiate between laboratory confirmed and clinical malaria diagnoses). Failure to fully complete OPD registers used by the surveillance sites may be complicated by a high reporting burden at the facility level for both malaria and non-malaria illnesses. This burden may include in some locations newly expanded HMIS clinic registers, integrated disease surveillance and response (IDSR) reports and other HMIS and surveillance reports. Incomplete OPD registers may influence measures of appropriate testing of suspect malaria cases; records of a patient’s fever history or clinical suspicion of malaria are required to calculate testing rates, a key performance indicator for facilities scaling up universal diagnosis for suspect cases. Improved patient cards which integrate data collection needs of the HMIS with malaria surveillance data needs could possibly be used to remedy this problem. Furthermore, the role of the district health office (or equivalent) in the system should be reinforced by establishing a focal point at the district office to serve as the liaison between surveillance systems and the health facilities.
Challenges related to incomplete data at health facilities highlight the importance of collaboration and coordinating data collection across multiple branches of the health system. If the HMIS captured all of the key indicators needed to inform malaria control, parallel data collection systems for malaria surveillance might not be necessary. Clearly, an extra layer of enhanced malaria indicator data collection and reporting does potentially create a reporting burden: staff may be resistant to the additional reporting, and may resist participation in the data collection and reporting process, which in turn may contribute to reduced data quality and potentially make measurement of certain trends unreliable. Towards the end of the global malaria eradication efforts in Ethiopia, diagnosis and treatment for malaria was re-integrated into the overall health system and multiple reporting mechanisms existed for disease surveillance. Over time these came to include the HMIS, IDSR, public health emergency management (PHEM) and sentinel surveillance systems. Failure to harmonize data collection and indicators across systems leads to increased reporting burdens, and conflicting estimates of indicators .
In most locations, government-provided public health care is only one of the many possible options that patients use to seek care for febrile illness, and malaria transmission and treatment-seeking patterns may fluctuate over time [22–24]. Given these issues, surveillance systems must be able to account for changes in patient treatment-seeking behaviour and provider practices, and should expand the points of data collection from one type of public health facility to an assortment of providers, including multiple health system levels in the same geographic areas, as well as the potential incorporation of private providers if monitoring trends in morbidity and mortality are a focus of the system.
The malaria diagnostic protocol for the sentinel surveillance system requires laboratory confirmation of all suspect cases by either RDT or microscopy. Adherence to the diagnostic protocol was measured by calculating test uptake from the OPD and laboratory registers: the number of patients tested (from laboratory register) divided by the number of patients with suspect malaria (from the OPD register). The number of cases tested in some facility-month reports were far greater than the number of suspect cases registered through the OPD, resulting in reported test uptake over 100%, and suggesting the possibility that some patients are receiving laboratory services for malaria without first registering, seeing a clinician, and being recorded in the reviewed OPD registers as a suspect case. Alternative explanations for this discrepancy include: incomplete registration of patients in OPD registers, referrals to the laboratory from service departments at health centres other than the OPD, and the potential for clinicians who use the malaria diagnostic test to rule out infection to refer patients for testing who they do not consider as having suspected malaria. Unfortunately, matching data from OPD registers to laboratory registers has been challenging due to the frequent duplication of patient OPD card numbers. The challenges associated with calculating test uptake using two separate and discrepant data sources makes this indicator of little use to the system. This indicator can be calculated only using OPD records, but the implications in terms of bias of doing so are currently not known.
Making data useful and generalizable
One primary purpose of this sentinel surveillance system was to detect malaria outbreaks through regular analysis and reporting of data to inform appropriate public health responses. By June 2013, the sentinel surveillance system had identified three major malaria epidemics: a P. falciparum epidemic at Bulbula Health Centre in June 2010, a P. vivax epidemic at Tulu Bollo Health Centre in October 2010, and a mixed but largely P. falciparum epidemic at Guangua Health Centre which lasted through the majority of 2011. Standard responses to these epidemics were to notify local health authorities and malaria control partners, and to ensure that health centres and health posts were adequately supplied for testing and treatment; local partners and authorities also increased targeted communication interventions in the area, and in some cases targeted indoor residual spraying of households with insecticide was also used (in the Guangua epidemic).
There are inherent challenges in applying standard epidemic detection methods depending upon the country context. In the absence of high quality historical data on malaria incidence, application of methods such as the WHO monthly methods or standard process control techniques is challenging or inappropriate. For this reason the project has moved toward the use of spatio-temporal regression methods for detection of increased local incidence of malaria. Collecting information on place of residence may aid in the identification of spatial clustering of cases; however, the challenges in reconciling local place names when literacy levels in the population are low, standardized maps and place names do not exist, and discordant place names appear in multiple registers for the same patient should not be underestimated.
Reliance on historical data or malaria microscopy may also be a poor indicator of malaria clinical incidence. At the health post level, multi-species malaria RDTs are utilized exclusively, and it currently appears that at least half of all malaria cases in Ethiopia are diagnosed based upon RDT results. Ethiopia has low malaria transmission levels as evidenced by the 1.3% microscopy slide prevalence found in the Malaria Indicator Survey performed in 2011 [13, 21]. When there is very low malaria transmission, false negativity due to low sensitivity of both RDTs and microscopy at low parasite densities may prove problematic [25–27]. Conversely, false positives may lead to overuse of anti-malarial drugs and a failure to properly delineate areas of the country absent of malaria risk. Malaria prevention and control programmes must ensure quality of laboratory confirmation especially in low transmission areas.
Data from the sentinel surveillance system are also used for informing routine program decision making, such as monitoring commodity stocks and forecasting demand, estimating and forecasting the burden of malaria expected at health posts, health centres and hospitals. During support visits, staff review data and notify the district office and the health centre director of any substantial increase in malaria cases. Monthly summary reports from all ten sentinel districts are also shared with senior ORHB officials, senior PHEM officials and with the FMOH for their information and action. On several occasions reports of malaria case buildups from districts nearby the sentinel sites prompted queries from the FMOH as to whether similar trends could be confirmed at nearby sentinel sites. Additionally, these officials were able to check case summaries in real-time by health facility and health post as soon as they were posted online by weekly SMS malaria morbidity reports.
While sentinel surveillance systems often lack the ability to produce generalizable data beyond catchment areas, they can provide precise, accurate and real-time data from discrete areas that can assist in interpreting events that are in nearby districts and aggregated data from other districts. Such systems could be testing grounds for operational strategies to identify foci of increased malaria transmission or to pilot enhanced control and elimination efforts, and provide an example of how to achieve high quality surveillance data in a resource limited setting. Ethiopia’s sentinel sites are currently serving as grounds for testing strategies to explicitly incorporate geo-spatial information on cases and travel histories into routinely collected facility-based data, as well as piloting the use of spatio-temporal regression analyses to identify locations with increased malaria risk to enhance the sensitivity and specificity of routine automated epidemic detection.
Conclusions and recommendations
This paper describes three implementation challenges that impacted a malaria surveillance system’s performance: 1) ensuring a timely and accurate data reporting process; 2) capturing complete and accurate patient-level data; and 3) expanding the usefulness and generalizability of the system’s data to monitor progress towards the national malaria control goals of reducing malaria deaths and eventual elimination of transmission.
Transmission of data more rapidly and accurately, and expanded dissemination of malaria surveillance data can be achieved using mobile phone technology. Such data can accurately represent registry data in the aggregate, at least in Oromia, and allows for tracking of trends in malaria in surveillance districts. The increased use of this technology across Africa offers promising opportunities to collect and disseminate surveillance data in a timely way. High quality malaria surveillance in Ethiopia remains a resource intensive activity and extending the generalizability of sentinel surveillance findings to other contexts remains a major limitation of these strategies. Future sentinel surveillance activities should continue to focus on expanding and ensuring quality control for and widespread use of diagnostics, delivering rapid data transmission with mobile technology, and enhancing generalizability and representativeness through wide ranging and appropriate site selection and inclusion of community level testing and treatment in sentinel sites.
- Teutsch SM, Churchill RE: Principles and practice of public health surveillance. 2000, Oxford; New York: Oxford University Press, 406-2Google Scholar
- US Centers for Disease Control and Prevention: National Notifiable Disease Surveillance System (NNDSS). 2013, Available from: http://wwwn.cdc.gov/nndss/script/DataCollection.aspxGoogle Scholar
- Moonen B, Cohen JM, Snow RW, Slutsker L, Drakeley C, Smith DL, Abeyasinghe RR, Rodriguez MH, Maharaj R, Tanner M, Targett G: Operational strategies to achieve and maintain malaria elimination. Lancet. 2010, 376: 1592-1603. 10.1016/S0140-6736(10)61269-X.PubMed CentralView ArticlePubMedGoogle Scholar
- Gething PW, Noor AM, Gikandi PW, Ogara EAA, Hay SI, Nixon MS, Snow RW, Atkinson PM: Improving imperfect data from health management information systems in Africa using space-time geostatistics. PLoS Med. 2006, 3: e271-10.1371/journal.pmed.0030271.PubMed CentralView ArticlePubMedGoogle Scholar
- Health Metrics Network: Country Health Information Systems Assessments: overview and lessons learned. Health Merics Network Network, Editor. 2012, Geneva: World Health OrganizationGoogle Scholar
- Thiam S, Thior M, Faye B, Ndiop M, Diouf ML, Diouf MB, Diallo I, Fall FB, Ndiaye JL, Albertini A, Lee E, Jorgensen P, Gaye O, Bell D: Major reduction in anti-malarial drug consumption in Senegal after nation-wide introduction of malaria rapid diagnostic tests. PLoS One. 2011, 6: e18419-10.1371/journal.pone.0018419.PubMed CentralView ArticlePubMedGoogle Scholar
- Yukich JO, Bennett A, Albertini A, Incardona S, Moonga H, Chisha Z, Hamainza B, Miller JM, Keating J, Eisele TP, Bell D: Reductions in artemisinin-based combination therapy consumption after the nationwide scale up of routine malaria rapid diagnostic testing in Zambia. Am J Trop Med Hyg. 2012, 87: 437-446. 10.4269/ajtmh.2012.12-0127.PubMed CentralView ArticlePubMedGoogle Scholar
- Guidelines Working Group: Updated guidelines for evaluating public health surveillance systems: recommendations from the Guidelines Working Group. MMWR Recomm Rep. 2001, 50: 1-35.Google Scholar
- MEASURE Evaluation: Routine Data Quality Assessment Tool (RDQA): Guidelines for implementation (DRAFT). 2008, Chapel Hill, NC: MEASURE EvaluationGoogle Scholar
- Covell G: Malaria in Ethiopia. J Trop Med Hyg. 1957, 60: 7-16.PubMedGoogle Scholar
- Federal Ministry of Health: National five-year strategic plan for malaria prevention and control in Ethiopia 2006 – 2010. 2006, Addis Ababa, Ethiopia: Federal Ministry of HealthGoogle Scholar
- Shargie EB, Gebre T, Ngondi J, Graves PM, Mosher AW, Emerson PM, Ejigsemahu Y, Endeshaw T, Olana D, WeldeMeskel A, Teferra A, Tadesse Z, Tilahun A, Yohannes G, Richards FO: Malaria prevalence and mosquito net coverage in Oromia and SNNPR regions of Ethiopia. BMC Public Health. 2008, 8: 321-10.1186/1471-2458-8-321.PubMed CentralView ArticlePubMedGoogle Scholar
- Jima D, Getachew A, Bilak H, Steketee RW, Emerson PM, Graves PM, Gebre T, Reithinger R, Hwang J, Ethiopia Malaria Indicator Survey Working Group: Malaria indicator survey 2007, Ethiopia: coverage and use of major malaria prevention and control interventions. Malar J. 2010, 9: 58-10.1186/1475-2875-9-58.PubMed CentralView ArticlePubMedGoogle Scholar
- Jima D, Wondabeku M, Alemu A, Teferra A, Awel N, Deressa W, Adissie A, Tadesse Z, Gebre T, Mosher AW, Richards FO, Graves PM: Analysis of malaria surveillance data in Ethiopia: what can be learned from the Integrated Disease Surveillance and Response System?. Malar J. 2012, 11: 330-10.1186/1475-2875-11-330.PubMed CentralView ArticlePubMedGoogle Scholar
- Zahar AR: Review of the ecology of malaria vectors in the WHO Eastern Mediterranean Region. Bull World Health Organ. 1974, 50: 427-440.PubMed CentralPubMedGoogle Scholar
- Coetzee M, Craig M, Le Sueur D: Distribution of African malaria mosquitoes belonging to the Anopheles gambiae complex. Parasitol Today. 2000, 16: 74-77. 10.1016/S0169-4758(99)01563-X.View ArticlePubMedGoogle Scholar
- Kiszewski A, Mellinger A, Spielman A, Malaney P, Sachs SE, Sachs J: A global index representing the stability of malaria transmission. Am J Trop Med Hyg. 2004, 70: 486-498.PubMedGoogle Scholar
- Maguin S, Carnevale P, Mouchet J, Coosemans M, Julvez J, Richard-Lenoble D, Sircoulon J: Biodiversity of Malaria in the World. 2008, UK: Lohn Libbey Eurotext Limited, SurreyGoogle Scholar
- Altman DG, Bland JM: Measurement in Medicine - the Analysis of Method Comparison Studies. Statistician. 1983, 32: 307-317. 10.2307/2987937.View ArticleGoogle Scholar
- Bland JM, Altman DG: Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986, 1: 307-310.View ArticlePubMedGoogle Scholar
- Ethiopia Health and Nutrition Research Institute and Partners: Ethiopia National Malaria Indicator Survey. 2012, Addis Ababa, Ethiopia: Ethiopian Health and Nutrition Research InstituteGoogle Scholar
- Bejon P, Williams TN, Liljander A, Noor AM, Wambua J, Ogada E, Olotu A, Osier FHA, Hay SI, Färnert A, Marsh K: Stable and unstable malaria hotspots in longitudinal cohort studies in Kenya. PLoS Med. 2010, 7: e1000304-10.1371/journal.pmed.1000304.PubMed CentralView ArticlePubMedGoogle Scholar
- Deressa W: Treatment-seeking behaviour for febrile illness in an area of seasonal malaria transmission in rural Ethiopia. Malar J. 2007, 6: 49-10.1186/1475-2875-6-49.PubMed CentralView ArticlePubMedGoogle Scholar
- Deressa W, Ali A, Berhane Y: Maternal responses to childhood febrile illnesses in an area of seasonal malaria transmission in rural Ethiopia. Acta Trop. 2007, 102: 1-9. 10.1016/j.actatropica.2007.02.009.View ArticlePubMedGoogle Scholar
- Okell LC, Bousema T, Griffin JT, Ouédraogo AL, Ghani AC, Drakeley CJ: Factors determining the occurrence of submicroscopic malaria infections and their relevance for control. Nat Commun. 2012, 3: 1237-PubMed CentralView ArticlePubMedGoogle Scholar
- Okell LC, Ghani AC, Lyons E, Drakeley CJ: Submicroscopic infection in Plasmodium falciparum-endemic populations: a systematic review and meta-analysis. J Infect Dis. 2009, 200: 1509-1517. 10.1086/644781.View ArticlePubMedGoogle Scholar
- Ashton RA, Kefyalew T, Tesfaye G, Counihan H, Yadeta D, Cundill B, Reithinger R, Kolaczinski JH: Performance of three multi-species rapid diagnostic tests for diagnosis of Plasmodium falciparum and Plasmodium vivax malaria in Oromia Regional State, Ethiopia. Malar J. 2010, 9: 297-10.1186/1475-2875-9-297.PubMed CentralView ArticlePubMedGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.