Development of an agent-based model to assess the impact of substandard and falsified anti-malarials: Uganda case study
Malaria Journal volume 18, Article number: 5 (2019)
Global efforts to address the burden of malaria have stagnated in recent years with malaria cases beginning to rise. Substandard and falsified anti-malarial treatments contribute to this stagnation. Poor quality anti-malarials directly affect health outcomes by increasing malaria morbidity and mortality, as well as threaten the effectiveness of treatment by contributing to artemisinin resistance. Research to assess the scope and impact of poor quality anti-malarials is essential to raise awareness and allocate resources to improve the quality of treatment. A probabilistic agent-based model was developed to provide country-specific estimates of the health and economic impact of poor quality anti-malarials on paediatric malaria. This paper presents the methodology and case study of the Substandard and Falsified Antimalarial Research Impact (SAFARI) model developed and applied to Uganda.
The total annual economic impact of malaria in Ugandan children under age five was estimated at US$614 million. Among children who sought medical care, the total economic impact was estimated at $403 million, including $57.7 million in direct costs. Substandard and falsified anti-malarials were a significant contributor to this annual burden, accounting for $31 million (8% of care-seeking children) in total economic impact involving $5.2 million in direct costs. Further, 9% of malaria deaths relating to cases seeking treatment were attributable to poor quality anti-malarials. In the event of widespread artemisinin resistance in Uganda, we simulated a 12% yearly increase in costs associated with paediatric malaria cases that sought care, inflicting $48.5 million in additional economic impact annually.
Improving the quality of treatment is essential to combat the burden of malaria and prevent the development of drug resistance. The SAFARI model provides country-specific estimates of the health and economic impact of substandard and falsified anti-malarials to inform governments, policy makers, donors and the malaria community about the threat posed by poor quality medicines. The model findings are useful to illustrate the significance of the issue and inform policy and interventions to improve medicinal quality.
Malaria is a preventable and treatable disease transmitted by infected mosquitoes. Since the millennium development goals listed combatting malaria as an important global development goal , significant progress has been made to combat malaria morbidity and mortality [2, 3]. Between 2006 and 2015, large-scale vector control campaigns, increased prophylactic treatments for pregnant women, as well as improved medical access, testing, and treatment methods reduced the global burden of malaria by an estimated 33 million cases and 435,000 deaths [2,3,4]. Unfortunately, this progress has stagnated and even regressed in recent years with malaria cases beginning to rise [2, 5].
This stagnation and regression in the battle against malaria represents a significant global health threat, especially in sub-Saharan Africa, where approximately 90% of the global malaria burden exists [2, 3, 5]. Plasmodium falciparum is a deadly species and disproportionally affects children under five, with the majority of malaria-related deaths occurring in this age group [6, 7]. In 2016, P. falciparum infections killed 285,000 children in Africa before they reached their fifth birthday [2, 7]. Malaria also poses a significant economic impact as a disease of poverty, and a cause of poverty [2, 8,9,10,11]. Malaria costs an estimated US$12 billion in direct costs to patients and their families annually, as well as hundreds of billions of dollars in indirect productivity losses . These costs disproportionally affect low-and middle-income countries, instigating and reinforcing poverty rates and stunting national economic development [9,10,11].
One of the reasons for stalled progress in the fight against malaria can be traced to substandard and falsified (SF) anti-malarial treatments [12,13,14,15]. A recent meta-analysis estimates that approximately 19.1% of all anti-malarials in low- and middle-income countries are SF . Substandard anti-malarials are defined as those that fail to meet the quality standards and/or specifications, while falsified anti-malarials deliberately and fraudulently misrepresent their identity, composition or source . Anti-malarials as a medication class are the most likely to be falsified, and regional rates as high as 35% have been reported in Africa [13, 18]. Poor quality medicines directly affect health outcomes by increasing malaria morbidity and mortality, as well as threaten their effectiveness by contributing to artemisinin resistance [13,14,15,19, 20, 21]. SF anti-malarials also contribute to the economic burden of malaria through additional care-seeking and productivity losses from increased morbidity and mortality [19, 22].
Children under age five are at the greatest risk of malaria and also at the greatest risk to suffer from the consequences of SF anti-malarials [7, 13, 23]. The World Health Organization (WHO) estimates that SF anti-malarials in sub-Saharan Africa are responsible for 31,000–116,000 additional deaths, the majority of whom are children under five, resulting in US$10.4–38.5 million in avertable costs due to additional care-seeking . While these estimates indicate the magnitude of the effect of poor quality medicines, robust, country-specific estimates are not available to combat the issue effectively and inform policy decisions . This study developed the SAFARI (Substandard and Falsified Antimalarial Research Impact) model, an agent-based model simulation, to provide country-specific estimates of the health and economic impact of SF anti-malarials on paediatric malaria. This paper describes and presents model findings for Uganda, a country with particularly high under-five mortality due to malaria.
The SAFARI model simulates population characteristics, malaria infection, patient care-seeking, disease progression, treatment outcomes, and associated costs, in order to estimate the health and economic impact of SF anti-malarial medicines among children below 5 years of age . The model was developed using NetLogo software (Version 6.0.2). An agent-based model was utilized as it is adept at modelling complex adaptive systems . The main model inputs and distributions are shown in Table 1 with additional inputs and coefficients included in Additional file 1. All model inputs were extracted from available literature and epidemiological outputs were compared to previously reported data. The primary outputs of the model are estimates of the health impact, direct costs, and productivity losses, based on the increased morbidity and mortality due to SF medicines. The model was presented to experts who helped validate the structure, inputs and assumptions.
Demographic characteristics, malaria infection and care-seeking rates
Utilizing agent-based modelling allows us to assign each child below age 5, or “agent-child” in the model, with individual demographic characteristics. Six demographic characteristics were applied to each agent-child: age, sex, geographic region, rural/urban, wealth quintile, and level of maternal education. These characteristics were chosen as important predictors that affect incidence, care-seeking, disease progression and treatment outcomes, and also to facilitate analysis by demographic groups. These characteristics were applied according to rates derived from the latest nationally representative Malaria Indicator Survey (MIS) using population sampling weights. For example, statistical analysis of the Uganda MIS dataset indicated significant associations between region, rural/urban, wealth quintile, and level of maternal education characteristics. To account for this association, the agent-child is sequentially assigned: (1) a region, (2) a rural/urban delineation according the regional proportions, (3) a wealth quintile according to the rural/urban proportions, and then (4) a maternal education level according to the proportions for the agent-child’s wealth quintile. Age in months (0–59) and sex were assigned randomly to each agent-child in the model. To ensure that the model population is comparable to a nationally representative sample , the proportions of each demographic characteristic in the model was calibrated to be within two percent of the MIS proportions.
In this model, each agent-child possesses individual incidence and care-seeking rates based on the demographic characteristics. Analysis of the Uganda MIS data showed significant associations between malaria prevalence and age, region, rural/urban, wealth quintile, and maternal education . Further, significant associations were found between care-seeking and care sector seeking rates, and four of these characteristics besides age. The model accounts for these associations by deriving the prevalence and care-seeking coefficients for each demographic characteristic by dividing the categorical rate by the national rate. These coefficients are then multiplied by the incidence , care-seeking, and care sector seeking rates for each agent-child according to demographic characteristics. This allows the model to account for heterogeneity by giving each agent-child a unique individual incidence and care sector seeking rate. No significant association was observed between sex and malaria prevalence or between sex or age and care-seeking in Uganda. Beyond this Uganda example, associations between the six demographic characteristics can be analysed to determine which coefficients should be applied to the incidence and care/sector seeking rates in future SAFARI outputs.
The disease model, shown in Fig. 1, is derived from the malaria disease progression established by the WHO, going from infection to asymptomatic parasitaemia, to uncomplicated illness, to severe malaria, and then to death . The definitions for clinical outcomes and other components of the model are presented in Table 2 [29, 30]. The model simulates 1000 agent-children who are assigned individual characteristics, incidence, and care-seeking rates. A simulation was run over a 1-year period broken down into 5-day increments. The length of a period was set at 5 days to account for different rates of care-seeking and reported average duration of symptoms for a case of uncomplicated malaria receiving treatment . There are four potential health states in the model: healthy, infected and asymptomatic, infected and symptomatic, and dead. Infected and symptomatic agent-children can develop neurological sequelae.
For each period, the 5-day incidence rate determines whether the agent-child will become infected and enter the disease model, or remain healthy. If the agent-child becomes infected, the agent-child can either stay asymptomatic, or become symptomatic and enter the care-seeking portion of the model. Symptomatic agent-children from the previous period that did not experience an adequate clinical and parasitogical response remain infected and symptomatic or become asymptomatic. Agent-children that are asymptomatic from the previous period will either become symptomatic or remain asymptomatic. Due to the longevity of Plasmodium falciparum infections, it is assumed that spontaneous recovery from malaria is not possible .
All symptomatic agent-children undergo simulated care-seeking and will either seek care or not, based on individual care-seeking rates. For agent-children seeking care, individual rates also determine the specific care location in which they will seek care. Analysis of MIS data determined the care locations incorporated in the model. For example, the Uganda model contains six care locations: public health facilities, private health facilities, pharmacies, drug stores, community health workers, and self-treatment/neighbours. The type of treatment the agent-child receives in each care location is determined by each location’s MIS-derived ratio of utilization of three anti-malarial treatments: artemisinin-based combination therapies (ACTs), oral quinine, and other treatments. Each care location also has a probability of stocking out of anti-malarial treatments based on ACTwatch data . In the event that agent-children visit a care location during a stock out, they will receive no treatment and non-severe cases will remain symptomatic in the next period.
Anti-malarial treatment outcomes
The treatment outcome for each agent-child was determined based on treatment adherence rates, treatment efficacy by medication, medicine quality measured by the active pharmaceutical ingredient (API) concentration of the specific drug the agent-child received, and treatment duration. Treatment adherence rates were derived from a study reporting the proportion of total malaria treatment taken, categorized by the numbers of doses taken: 0–1, 2, 3, 4, and 5–6 . Treatment efficacy was modelled based on the doses taken, where lower adherence reduced the likelihood of successful treatment. If an agent-child pursued self-treatment or received medication from neighbours, the likelihood of treatment success was reduced by 20% due to lower adherence. Malaria treatment adherence was assumed to be similar throughout sub-Saharan Africa due to the lack of country-specific data available.
Treatment efficacy [35,36,37,38,39,40,41,42,43,44,45,46,47,48,49] and prevalence of SF medicines [50,51,52,53,54,55,56,57] for each anti-malarial type was calculated via the WWARN (Worldwide Antimalarial Resistance Network) database  and a systematic literature search specific to Uganda. The input for treatment efficacy was medication-specific likelihood of adequate clinical and parasitological response at 28 days based on polymerase chain reaction, controlling for recrudescence and reinfection. Treatment efficacy was estimated across studies by taking the weighted average of the success rate based on the number of people in the studies. The 95% confidence interval for treatment efficacy was derived based on the standard deviations of included studies. While SF medicines have API concentrations outside of the therapeutic range, model inputs acknowledge that not all are ineffective. Medication effectiveness was assumed to decrease proportionally by API concentration [19, 23], categorized according to API percentages between 75 and 85%, 50 and 75%, and < 50%, as interpolated from two studies [50, 54]. The prevalence of SF medicines was estimated by counting SF samples identified over all samples tested across studies. These SF medicines were then categorized based on the likelihood of having percentage API levels. Each modelled anti-malarial medication was assigned an API percentage category and corresponding treatment efficacy with lower APIs reducing the likelihood of successful treatment. The proportion of SF medicines for each anti-malarial category was assumed to be equivalent across care sectors, as no other data were available to segment medication quality by treatment location.
This model differentiates between symptomatic recovery and complete recovery, resulting in three outcomes for non-severe malaria in the model: recovery, complete treatment failure, and parasite clearance failure. Agent-children who experience treatment failure due to anti-malarials with an API < 50% or not adhering to treatment (taking only 0–1 doses) experience complete treatment failure and remain symptomatic. All other agent-children that experience treatment failure are considered to experience parasite clearance failure and remain infected but asymptomatic .
The probability of untreated symptomatic malaria progressing to severe malaria increases over time . This is accounted for by using a severity rate that captures the country-specific rate of progression of an untreated uncomplicated case to a severe case, as reported in a Delphi study based on the country’s endemicity . This severity rate is adjusted for each agent-child seeking care according to the amount of time from onset of symptoms until treatment. To determine these rates, MIS data were used to assign each agent-child with the number of days after onset of symptoms that care was sought, effectively capturing treatment duration. The severity rate for agent-children that seek care was adjusted to increase proportional to the number of days since onset . The severity rate was not adjusted for agent-children that do not seek care.
In this model, agent-children that seek care with severe malaria become hospitalized and receive inpatient care, while those that do not initially seek care have a chance to seek care again in the next cycle. Inpatient hospital treatments were assumed to be of acceptable quality and patients admitted to hospitals were assumed to adhere to treatment.
There are four possible severe malaria outcomes in the model: death, neurological sequelae, remaining infected, and treatment success. Patients who receive inpatient care can be successfully treated, die, or experience neurological sequelae based on proportions reported by the AQUAMAT study in Africa . Patients who do not receive care with severe malaria can remain infected, suffer from neurological sequelae, or die. A Delphi study estimated the mortality rate for severe cases that do not receive treatment .
The model tabulates the number of cases, neurological sequelae, and deaths due to malaria. Disability-adjusted life years (DALYs) due to malaria was also estimated as a measure of overall disease burden expressed as the number of years lost due to ill-health, disability or early death. Non-age weighted and non-discounted DALYs using disability weights from the Global Burden of Disease study are presented .
Economic outcomes in the model were categorized as either direct costs or indirect costs. Direct costs included costs for transportation, testing, drugs, consultation, and hospital costs [64,65,66,67]. Direct costs were further separated into those that were paid out-of-pocket versus those incurred by public facilities [68, 69]. Indirect costs included productivity losses incurred by care-takers, as well as productivity losses due to disability and death due to malaria. Productivity losses were estimated using the human capital approach, based on gross domestic product (GDP) per capita and duration of lost productivity . Caregiver productivity losses were estimated for 5 days of lost earnings for a case of uncomplicated severe malaria. Lifetime productivity losses were estimated based on lost economic productivity between age 15 and life expectancy, discounted at 3%. Disability productivity losses were calculated by applying the disability weights for neurological sequelae to discounted lifetime productivity losses . All costs are rounded to the nearest thousands and expressed in 2017 US dollars.
Three scenarios are presented for this analysis: the baseline scenario, a second scenario with no SF anti-malarials, and a third scenario with emergence of antimicrobial resistance. For the scenario with no SF medicines, all medications were assumed to have an API > 85%. For the antimicrobial resistance scenario, treatment efficacies for ACT and quinine were assumed to be the same as those for other treatments. The health and economic impact of SF anti-malarials and artemisinin resistance were calculated by examining the difference between the baseline scenario and the other two scenarios. To assess if there was a significant difference between the baseline and scenario outputs, a two-sample t-test was used for epidemiological outputs, and a Wilcoxon ranked-sum test was used for cost outputs. All data analysis was conducted using Stata 14.2.
To account for the natural variation in epidemiological and cost inputs, each input was simulated to vary probabilistically, where inputs were randomly generated within a specific distribution. Epidemiological inputs were normally distributed and cost inputs came from a gamma distribution. The overall results demonstrate the best estimate and standard deviation based on variations across all inputs.
This case study presents the SAFARI model results for Uganda. At current incidence rates and population levels, the model estimates that there are around 3.5 million annual cases of malaria in Ugandan children under age five. Among the total population, we estimated nearly 11,000 cases of neurological sequelae and around 29,000 deaths, which contributed to approximately 2 million DALYs lost. For cases that pursued some medical treatment (94%), an average of 177,000 (5%) were hospitalized in a year, with nearly 13,000 (0.4%) resulting in death and 5700 (0.2%) suffering from neurological sequelae. These cases of malaria, neurological sequelae, and death resulted in almost 1.1 million DALYs lost annually, including 953,000 years of life lost to early death from malaria. These health outcomes contributed to a total estimated economic impact of $614 million. Those that sought medical treatment made up $403 million of the total impact, with approximately 66% of the total. Direct costs associated with care seeking was estimated at $57.7 million (14%) and caregiver productivity losses were projected at $141 million (35%). Simulated outcomes for total malaria burden and cases who sought care are presented in Table 3.
SF anti-malarials contribute significantly to these estimates. Comparing the baseline among cases seeking treatment to a scenario with no SF drugs, poor quality anti-malarials were responsible for nearly 14,000 (8%) additional hospitalizations, approximately 300 (5%) more cases of neurological sequelae, and around 1100 (9%) additional deaths. SF anti-malarials contributed to about 71,000 (7%) years of potential life lost to children under five and almost 79,000 (7%) additional DALYs lost annually. In addition to the significant health impact, the economic impact of poor quality anti-malarials taken by Ugandan children was estimated at $31 million (8%). The additional morbidity and mortality caused by SF anti-malarials resulted in $5.2 million in direct costs annually, including $2.9 million incurred by the government and $2.3 million paid by patients as out-of-pocket costs. Productivity losses as a result of poor quality anti-malarials amounted to $25.9 million a year, including $8.1 million in caregiver productivity losses, $2 million due to disability, and $15.8 million due to early death.
In the event of widespread artemisinin resistance in Uganda, significant increases in severe malaria cases and hospitalizations would be expected. If treatment efficacies of ACT medicines and quinine were to fall to the level of other treatment efficacies, the model simulated a 6% increase in hospitalizations and 7% increase in malaria deaths, which would result in nearly 57,000 years of life lost due to early death and 63,000 DALYs lost. The resulting increase in economic impact was estimated at $48.5 million, a 12% increase in costs associated with paediatric malaria annually. This included an additional $8 million in government facility costs (25% increase) and an additional $7.5 million paid out-of-pocket by patients (30% increase).
The SAFARI model can be used to develop country-specific estimates of the health and economic impact of SF anti-malarials. Using agent-based modelling, we developed a dynamic model to simulate a cohort of children with demographic characteristics, malaria infection rates, care-seeking patterns, disease progression, treatment outcomes, and associated costs. Model results reinforce the magnitude of the burden of malaria at a national level, as well as highlight the health and economic benefits of reducing this burden through access to better quality medications. The SAFARI model should be used across malaria endemic countries to not only estimate the impact of SF anti-malarials, but to also assess the impact of national policies and interventions to counter this threat.
Through a case study in Uganda, this study demonstrated that SF anti-malarials contribute significantly to both the health and economic burden of malaria in children under five. The results of this model are useful as they provide the first country-specific estimate of the contribution of SF anti-malarials to the malaria burden for Uganda. It also demonstrates the burden of avertable costs on patients and the government. The results demonstrate that addressing drug quality, even with no changes in incidence rates, will significantly contribute to reducing the malaria burden. As such, these estimates are crucial to not only illustrate the scope of the issue to pertinent actors in the fight against malaria, but to also encourage and inform future research, policies, and interventions to combat poor quality anti-malarials.
The SAFARI model builds on and improves upon previous efforts to model the impact of malaria in sub-Saharan Africa [19, 23, 71,72,73]. For example, the disease model and clinical inputs utilized in the SAFARI model are comparable to previous efforts to model the burden of malaria in sub-Saharan Africa [19, 23, 71, 73]. Specifically, similar data inputs were utilized as Renshler et al.  estimating the number of under five deaths due to poor quality anti-malarials, Lubell et al.  modelling the impact of artemisinin resistance, and Bath et al.  assessing the economic impact of poor quality anti-malarials across sub-Saharan Africa. The SAFARI model builds upon the analysis by Bath et al. by focusing on a country, reducing the number of assumptions and better accounting for regional variation and heterogeneity within the model population. The SAFARI model is a country-level model and utilizes agent-based modelling rather than decision tree modelling, which can account for national, regional, and patient-specific variation, thereby generating more rigorous estimates. The SAFARI model also incorporates the financing source for direct costs and report epidemiological and cost outputs for each individual child in the model. The model can subsequently be used to assess various interventions to address the burden of malaria as well as assess the distribution of the malaria burden and impact of poor quality anti-malarials across demographic characteristics of a population.
The number of cases and deaths reported by the SAFARI model are comparable to those reported by the World Malaria Report . While the World Malaria Report estimates the malaria burden across all ages, the WHO estimates that 45% of malaria cases occur in children under five . This model reported approximately 3.5 million malaria cases, which is comparable to 45% of the estimated malaria cases in Uganda (2.0–5.6 million) reported by the 2017 World Malaria Report . Children under five also account for the majority of malaria deaths; the nearly 29,000 total number of deaths resulting from the model is within the UNICEF estimates of 23,023–32,371 deaths due to malaria in 2016, calculated from the under-five mortality rate of 43.6–61.3 per 1000 live births with 6.7% of deaths due to malaria [74, 75]. Of children who sought care, the nearly 13,000 deaths reported by the model are in range of the 10,280–13,850 malaria treatment deaths reported in Uganda by the 2017 World Malaria Report . Further, this study’s finding that 8.7% of under five deaths are due to SF anti-malarials is comparable to the estimated 3.8–8.9% of all-age malaria deaths due to poor quality medicines in sub-Saharan Africa reported by the WHO .
There are a number of key limitations to note. First, models are inherently limited by the quality of the data used to derive model parameters [76, 77]. To address this, an extensive literature search and MIS dataset analyses were conducted to ensure that model parameters were derived from the most recent and best quality published data. While the quality of data inputs inherently limit model outputs, the SAFARI model improves upon previous estimates by appropriately controlling for these limitations through rigorous analyses. Secondly, population, regional, and individual level heterogeneity limits models to capture population-wide variances [76, 77]. To control for heterogeneity, a probabilistic agent-based model was used and each agent-child was assigned with demographic characteristics including age, sex, geographic region, rural/urban, wealth quintile, and level of maternal education. Using these demographic characteristics, the SAFARI model is able to account for natural individual and regional heterogeneity based on the variance around each input variable and assign individual rates specific to each agent-child’s characteristic and location. Third, a large amount of uncertainty in the case fatality rate of untreated malaria cases was found, with estimates ranging from 0.45 to 60% in the literature [19, 23, 50, 60]. Due to this uncertainty, we calibrated the model using various literature source estimates for this rate. Further, the model does not account for malaria treatments taken by children that do not have malaria and unessential inpatient care for non-severe cases due to lack of data. Despite these limitations, the SAFARI model is a unique and valuable tool to assess and counter the impact of SF anti-malarials at the country level.
After years of progress in addressing the burden of malaria, recent indicators suggest that malaria is making a resurgence. To ensure that progress continues, it is essential to address the factors affecting this resurgence, such as the rise in poor quality anti-malarials. The SAFARI model is presented to assess and illustrate the magnitude of the health and economic impact of SF anti-malarials at the country level through a model case study in Uganda. The SAFARI model should inform country malaria stakeholders, international donors, and national malaria control programmes to recognize the burden of SF anti-malarials and identify interventions to improve medicinal quality. As the world seeks to achieve the Sustainable Development Goals and meet the Global Health Security Agenda, reducing the prevalence of poor quality medicines will be essential to combat the global burden of malaria.
artemisinin-based combination therapy
active pharmaceutical ingredient
African Quinine Artesunate Malaria Treatment Trial
disability-adjusted life years
gross domestic product
Malaria Indicator Survey
Substandard and Falsified Antimalarial Research Impact model
United Nations International Children’s Emergency Fund
World Health Organization
Worldwide Antimalarial Resistance Network
United Nations. The millennium development goals report 2008. New York: United Nations Publications; 2008.
WHO. World malaria report 2017. Geneva: World Health Organization; 2017.
WHO Africa. Malaria [http://www.afro.who.int/health-topics/malaria]. Accessed 1 Dec 2018.
WHO. World malaria report 2008. Geneva: World Health Organization; 2008.
WHO. Malaria factsheet [http://www.who.int/mediacentre/factsheets/fs094/en/]. Accessed 1 Dec 2018.
Maitland K. Severe malaria in African children—the need for continuing investment. N Engl J Med. 2016;375:2416–7.
WHO. Malaria in children under five. Geneva: World Health Organization, 2018. [http://www.who.int/malaria/areas/high_risk_groups/children/en/]. Accessed 1 Dec 2018.
CDC. Impact of malaria [https://www.cdc.gov/malaria/malaria_worldwide/impact.html]. Accessed 1 Dec 2018.
Fosu AK, Mwabu GM. Malaria and poverty in Africa. Nairobi: University of Nairobi Press; 2007.
Gallup JL, Sachs JD. The economic burden of malaria. Am J Trop Med Hyg. 2001;64:85–96.
Teklehaimanot A, Mejia P. Malaria and poverty. Ann NY Acad Sci. 2008;1136:32–7.
Chaccour C, Kaur H, Pozo JLd. Falsified antimalarials: a minireview. Expert Rev Ant Infect Ther. 2015;13:505–9.
Nayyar GM, Breman JG, Newton PN, Herrington J. Poor-quality antimalarial drugs in southeast Asia and sub-Saharan Africa. Lancet Infect Dis. 2012;12:488–96.
Newton PN, McGready R, Fernandez F, Green MD, Sunjio M, Bruneton C, et al. Manslaughter by fake artesunate in Asia—will Africa be next? PLoS Med. 2006;3:e197.
Newton PN, Green MD, Mildenhall DC, Plançon A, Nettey H, Nyadong L, et al. Poor quality vital anti-malarials in Africa-an urgent neglected public health priority. Malar J. 2011;10:352.
Ozawa S, Evans D, Bessias S, Haynie D, Yemeke T, Laing S, et al. Prevalence and estimated economic burden of substandard and falsified medicines in low- and middle-income countries: A systematic review and meta-analysis. JAMA Net Open. 2018;1:e181662
WHO. Seventieth World Health Assembly update, 29 May. Geneva: World Health Organization; 2017.
Almuzaini T, Choonara I, Sammons H. A systematic review of counterfeit and substandard medicines. Arch Dis Childhood. 2012;97:A1–2.
WHO. A study on the public health and socioeconomic impact of substandard and falsified medical products. Geneva: World Health Organization; 2017.
Amin AA, Kokwaro GO. Antimalarial drug quality in Africa. J Clin Pharm Ther. 2007;32:429–40.
Newton PN, Green MD, Fernández FM. Impact of poor-quality medicines in the ‘developing’world. Trends Pharmacol Sci. 2010;31:99–101.
Wilson J, Fenoff R. The health and economic effects of counterfeit pharmaceuticals in Africa. In A-CAPPP Backgrounder, vol. March. East Lansing, MI, Michigan State University, 2011.
Renschler JP, Walters KM, Newton PN, Laxminarayan R. Estimated under-five deaths associated with poor-quality antimalarials in sub-Saharan Africa. Am J Trop Med Hyg. 2015;92:119–26.
Conte R, Paolucci M. On agent-based modeling and computational social science. Front Psychol. 2014;5:668.
United Nations Department of Economic & Social Affairs—Uganda. https://www.un.org/development/desa/dpad/tag/uganda/. Accessed 1 Dec 2018.
The Malaria Atlas Project. [https://map.ox.ac.uk/]
Uganda Bureau of Statistics (UBOS) and ICF. Uganda Malaria Indicator Survey 2014–2015. Kampala, Uganda, and Rockville, Maryland, USA, UBOS and ICF International, 2015.
WHO. Severe malaria. Trop Med Int Health. 2014;19:7–131.
WHO. Malaria terminology. Geneva: World Health Organization; 2016.
Bloland PB, Ringwald P, Snow RW. Assessment and monitoring of antimalarial drug efficacy for the treatment of uncomplicated falciparium malaria. Geneva: World Health Organization; 2003.
Farrar J, Hotez PJ, Junghanss T, Kang G, Lalloo D, White NJ. Manson’s tropical diseases. Amsterdam: Elsevier Health Sciences; 2013.
Ashley EA, White NJ. The duration of Plasmodium falciparum infections. Malar J. 2014;13:500.
ACTwatch Group and PACE. ACTwatch study reference document. Republic of Uganda outlet survey. Washington DC: PSI; 2015.
Bruxvoort K, Festo C, Cairns M, Kalolella A, Mayaya F, Kachur SP, et al. Measuring patient adherence to malaria treatment: a comparison of results from self-report and a customised electronic monitoring device. PLoS ONE. 2015;10:e0134275.
Achan J, Tibenderana JK, Kyabayinze D, Mangen FW, Kamya MR, Dorsey G, et al. Effectiveness of quinine versus artemether-lumefantrine for treating uncomplicated falciparum malaria in Ugandan children: randomised trial. BMJ. 2009;339:b2763.
Arinaitwe E, Sandison TG, Wanzira H, Kakuru A, Homsy J, Kalamya J, et al. Artemether-lumefantrine versus dihydroartemisinin-piperaquine for falciparum malaria: a longitudinal, randomized trial in young Ugandan children. Clin Infect Dis. 2009;49:1629–37.
Bakyaita N, Dorsey G, Yeka A, Banek K, Staedke SG, Kamya MR, et al. Sulfadoxine-pyrimethamine plus chloroquine or amodiaquine for uncomplicated falciparum malaria: a randomized, multisite trial to guide national policy in Uganda. Am J Trop Med Hyg. 2005;72:573–80.
Bassat Q, Mulenga M, Tinto H, Piola P, Borrmann S, Menéndez C, et al. Dihydroartemisinin-piperaquine and artemether-lumefantrine for treating uncomplicated malaria in African children: a randomised, non-inferiority trial. PLoS ONE. 2009;4:e7871.
Bukirwa H, Yeka A, Kamya MR, Talisuna A, Banek K, Bakyaita N, et al. Artemisinin combination therapies for treatment of uncomplicated malaria in Uganda. PLoS Clin Trials. 2006;1:e7.
Checchi F, Piola P, Kosack C, Ardizzoni E, Klarkowski D, Kwezi E, et al. Antimalarial efficacy of sulfadoxine–pyrimethamine, amodiaquine and a combination of chloroquine plus sulfadoxine–pyrimethamine in Bundi Bugyo, western Uganda. Trop Med Int Health. 2004;9:445–50.
Clark TD, Njama-Meya D, Nzarubara B, Maiteki-Sebuguzi C, Greenhouse B, Staedke SG, et al. Incidence of malaria and efficacy of combination antimalarial therapies over 4 years in an urban cohort of Ugandan children. PLoS ONE. 2010;5:e11759.
Four Artemisinin-Based Combinations (4ABC) Study Group. A head-to-head comparison of four artemisinin-based combinations for treating uncomplicated malaria in African children: a randomized trial. PLoS Med. 2011;8:e1001119.
Piola P, Fogg C, Bajunirwe F, Biraro S, Grandesso F, Ruzagira E, et al. Supervised versus unsupervised intake of six-dose artemether-lumefantrine for treatment of acute, uncomplicated Plasmodium falciparum malaria in Mbarara, Uganda: a randomised trial. Lancet. 2005;365:1467–73.
Piola P, Nabasumba C, Turyakira E, Dhorda M, Lindegardh N, Nyehangane D, et al. Efficacy and safety of artemether–lumefantrine compared with quinine in pregnant women with uncomplicated Plasmodium falciparum malaria: an open-label, randomised, non-inferiority trial. Lancet Infect Dis. 2010;10:762–9.
Staedke SG, Mpimbaza A, Kamya MR, Nzarubara BK, Dorsey G, Rosenthal PJ. Combination treatments for uncomplicated falciparum malaria in Kampala, Uganda: randomised clinical trial. Lancet. 2004;364:1950–7.
Verret WJ, Arinaitwe E, Wanzira H, Bigira V, Kakuru A, Kamya M, et al. Effect of nutritional status on response to treatment with artemisinin-based combination therapy in young Ugandan children with malaria. Antimicrob Agents Chemother. 2011;55:2629–35.
Yeka A, Banek K, Bakyaita N, Staedke SG, Kamya MR, Talisuna A, et al. Artemisinin versus nonartemisinin combination therapy for uncomplicated malaria: randomized clinical trials from four sites in Uganda. PLoS Med. 2005;2:e190.
Yeka A, Dorsey G, Kamya MR, Talisuna A, Lugemwa M, Rwakimari JB, et al. Artemether-lumefantrine versus dihydroartemisinin-piperaquine for treating uncomplicated malaria: a randomized trial to guide policy in Uganda. PLoS ONE. 2008;3:e2390.
Yeka A, Tibenderana J, Achan J, D’Alessandro U, Talisuna AO. Efficacy of quinine, artemether-lumefantrine and dihydroartemisinin-piperaquine as rescue treatment for uncomplicated malaria in Ugandan children. PLoS ONE. 2013;8:e53772.
ACT Consortium Drug Quality Project Team and the IMPACT2 Study Team. Quality of artemisinin-containing antimalarials in Tanzania’s private sector–results from a nationally representative outlet survey. Am J Trop Med Hyg. 2015;92:75–86.
Bate R, Coticelli P, Tren R, Attaran A. Antimalarial drug quality in the most severely malarious parts of Africa—a six country study. PLoS ONE. 2008;3:e2132.
Bate R, Mooney L, Hess K. Medicine registration and medicine quality: a preliminary analysis of key cities in emerging markets. Res Rep Trop Med. 2010;1:89–93.
Bjorkman Nyqvist M, Svensson J, Yanagizawa-Drott D. Can good products drive out bad? Evidence from local markets for (Fake?) Antimalarial Medicine in Uganda. C.E.P.R. Discussion Papers, CEPR Discussion Papers: 9114, 2012.
Kaur H, Allan EL, Mamadu I, Hall Z, Ibe O, El Sherbiny M, et al. Quality of artemisinin-based combination formulations for malaria treatment: prevalence and risk factors for poor quality medicines in public facilities and private sector drug outlets in Enugu, Nigeria. PLoS ONE. 2015;10:e0125577.
Ogwal-Okeng JW, Owino E, Obua C. Chloroquine in the Ugandan market fails quality test: a pharmacovigilance study. Afr Health Sci. 2003;3:2–6.
Kitutu F. Screening drug quality project report. Kampala: Uganda Medicines Transparency Alliance (MeTa); 2015.
WHO. Survey of the quality of selected antimalarial medicines circulating in Madagascar, Senegal, and Uganda. Geneva: World Health Organization; 2009.
WWARN Antimalarial Quality Surveyor [http://www.wwarn.org/aq-surveyor]. Accessed 1 Dec 2018
Roh ME, Oyet C, Orikiriza P, Wade M, Kiwanuka GN, Mwanga-Amumpaire J, et al. Asymptomatic Plasmodium infections in children in low malaria transmission setting, southwestern Uganda. Emerg Infect Dis. 2016;22:1494.
Lubell Y, Staedke SG, Greenwood BM, Kamya MR, Molyneux M, Newton PN, et al. Likely health outcomes for untreated acute febrile illness in the tropics in decision and economic models; a Delphi survey. PLoS ONE. 2011;6:e17439.
Das D, Tripura R, Phyo AP, Lwin KM, Tarning J, Lee SJ, et al. Effect of high-dose or split-dose artesunate on parasite clearance in artemisinin-resistant falciparum malaria. Clin Infect Dis. 2013;56:e48–58.
Dondorp AM, Fanello CI, Hendriksen IC, Gomes E, Seni A, Chhaganlal KD, et al. Artesunate versus quinine in the treatment of severe falciparum malaria in African children (AQUAMAT): an open-label, randomised trial. Lancet. 2010;376:1647–57.
Vos T, Allen C, Arora M, Barber RM, Bhutta ZA, Brown A, et al. Global, regional, and national incidence, prevalence, and years lived with disability for 310 diseases and injuries, 1990–2015: a systematic analysis for the Global Burden of Disease Study 2015. Lancet. 2016;388:1545–602.
Batwala V, Magnussen P, Hansen KS, Nuwaha F. Cost-effectiveness of malaria microscopy and rapid diagnostic tests versus presumptive diagnosis: implications for malaria control in Uganda. Malar J. 2011;10:372.
Orem JN, Kirigia JM, Azairwe R, Kasirye I, Walker O. Impact of malaria morbidity on gross domestic product in Uganda. Int Arch Med. 2012;5:12.
Hansen KS, Ndyomugyenyi R, Magnussen P, Lal S, Clarke SE. Cost-effectiveness analysis of malaria rapid diagnostic tests for appropriate treatment of malaria at the community level in Uganda. Health Policy Plan. 2017;32:676–89.
Uganda Bureau of Statistics (UBOS) and ICF. Uganda Malaria Indicator Survey 2008–2009. Kampala, Uganda, and Rockville, Maryland, USA, UBOS and ICF International, 2009.
MSH International Medical Products Price Guide [http://mshpriceguide.org/en/home/]. Accessed 1 Dec 2018.
Lubell Y, Riewpaiboon A, Dondorp AM, von Seidlein L, Mokuolu OA, Nansumba M, et al. Cost-effectiveness of parenteral artesunate for treating children with severe malaria in sub-Saharan Africa. Bull World Health Organ. 2011;89:504–12.
The World Bank—Uganda https://data.worldbank.org/country/uganda?view=chart. Accessed 1 Dec 2018
Lubell Y, Dondorp A, Guérin PJ, Drake T, Meek S, Ashley E, et al. Artemisinin resistance–modelling the potential human and economic costs. Malar J. 2014;13:452.
Camponovo F, Bever CA, Galactionova K, Smith T, Penny MA. Incidence and admission rates for severe malaria and their impact on mortality in Africa. Malar J. 2017;16:1.
Tediosi F, Maire N, Smith T, Hutton G, Utzinger J, Ross A, et al. An approach to model the costs and effects of case management of Plasmodium falciparum malaria in sub-Saharan Africa. Am J Trop Med Hyg. 2006;75:90–103.
UNICEF. Monitoring the situation of children and women; under-five mortality. New York: United Nations Children’s Fund; 2018.
UNICEF. Child mortality estimates: country-specific under-five mortality rate. New York: UNICEF Data and Analytics Section, Division of Data, Research and Policy; 2018.
Gomez-Ramirez J, Sanz R. On the limitations of standard statistical modeling in biological systems: a full Bayesian approach for biology. Progr Biophys Mol Biol. 2013;113:80–91.
Xie Y. Values and limitations of statistical models. Res Soc Stratif Mobil. 2011;29:343–9.
SO conceptualized and planned the study. DE and SO designed the model. DE, CH and SL gathered data inputs and developed the model with feedback from SO. All authors conducted data analysis, interpreted the data, drafted and revised the manuscript. All authors read and approved the final manuscript.
We would like to thank Dr. Steve Taylor for his inputs in the disease model. We also thank the Global Health Economics for Pharmacy team (Tatenda Yemeke and Hui-Han Chen) for their suggestions and recommendations.
The authors declare that they have no competing interests.
Availability of data and materials
The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.
Consent for publication
Ethics approval and consent to participate
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Ozawa, S., Evans, D.R., Higgins, C.R. et al. Development of an agent-based model to assess the impact of substandard and falsified anti-malarials: Uganda case study. Malar J 18, 5 (2019). https://doi.org/10.1186/s12936-018-2628-3
- Agent-based model