- Research
- Open Access
- Published:

# Testing a multi-malaria-model ensemble against 30 years of data in the Kenyan highlands

*Malaria Journal*
**volume 13**, Article number: 206 (2014)

## Abstract

### Background

Multi-model ensembles could overcome challenges resulting from uncertainties in models’ initial conditions, parameterization and structural imperfections. They could also quantify in a probabilistic way uncertainties in future climatic conditions and their impacts.

### Methods

A four-malaria-model ensemble was implemented to assess the impact of long-term changes in climatic conditions on *Plasmodium falciparum* malaria morbidity observed in Kericho, in the highlands of Western Kenya, over the period 1979–2009. Input data included quality controlled temperature and rainfall records gathered at a nearby weather station over the historical periods 1979–2009 and 1980–2009, respectively. Simulations included models’ sensitivities to changes in sets of parameters and analysis of non-linear changes in the mean duration of host’s infectivity to vectors due to increased resistance to anti-malarial drugs.

### Results

The ensemble explained from 32 to 38% of the variance of the observed *P. falciparum* malaria incidence. Obtained R^{2}-values were above the results achieved with individual model simulation outputs. Up to 18.6% of the variance of malaria incidence could be attributed to the +0.19 to +0.25°C per decade significant long-term linear trend in near-surface air temperatures. On top of this 18.6%, at least 6% of the variance of malaria incidence could be related to the increased resistance to anti-malarial drugs. Ensemble simulations also suggest that climatic conditions have likely been less favourable to malaria transmission in Kericho in recent years.

### Conclusions

Long-term changes in climatic conditions and non-linear changes in the mean duration of host’s infectivity are synergistically driving the increasing incidence of *P. falciparum* malaria in the Kenyan highlands. User-friendly, online-downloadable, open source mathematical tools, such as the one presented here, could improve decision-making processes of local and regional health authorities.

## Background

Process-based models have played a significant role in understanding the complexity of malaria transmission dynamics since the discovery of the malaria transmission pathway at the turn of the 19th century [1]. Sir Ronald Ross, while working at the Indian Medical Service in the 1890′s, demonstrated the life cycle of malaria parasites in *Anopheles* mosquitoes, and was one among the first to publish a series of papers using mathematical functions to study malaria transmission. He developed a simple model which explained the relationship between the number of mosquitoes and malaria incidence in human populations, and used it to arrive at important practical conclusions such as that, “…to counteract malaria anywhere we need not banish *Anopheles* there entirely…we need only to reduce their numbers below a certain figure.” [2] Sir Ronald Ross was also able to conclude from his modeling efforts that control programmes that integrated vector reduction (larvicides), drug treatment (quinine), and personal protection (bed nets) were much more likely to succeed than efforts that relied on just one intervention measure [2]. From a malaria policy perspective, the value of a model-based analysis of malaria transmission dependent outcomes is in the opportunity to systematically examine drivers surrounding these outcomes and their relevance to the ultimate decision being addressed.

While malaria transmission models of varying complexity have been developed over the years in response to specific needs, the basic principle of parsimony is key to model development. This principle states that among competing hypotheses, the one with the fewest assumptions should be selected. Other, more complicated solutions may ultimately prove correct, but—in the absence of certainty—the fewer assumptions that are made, the better. However, recent advances in the theory of mosquito-borne pathogen transmission seeks to better understand uncertainty in the traditional malaria modelling framework by realistically acknowledging spatial heterogeneity of transmission in complex epidemiological landscapes [3]. Another important approach to reducing uncertainty in model results is improvements in the quality and quantity of appropriate data used to both drive and test the model outputs. Access to quality controlled high spatial and temporal meteorological station data has been a particular challenge in Africa where observing stations are less than an 1/8 of the number recommended by the World Meteorological Office [4]. After identifying the most appropriate model(s) with least assumptions and using the best available data, two other sources of uncertainty must be taken into account. These are the starting conditions used to initialize the model and the specific parameterization of the model itself. For example, the seasonal evolution of malaria cases as described by a time dependant process-based model is dependent on the initial state of the gametocyte carrier rate at time t = 0. Since a perfect assessment of the gametocyte carrier rate in the population is not possible then an estimation of the most likely rate is needed to initialize the model. Choices made in model structure are also significant sources of model uncertainty.

The climate forecasting community has used multi-model ensembles to overcome challenges resulting from initial conditions and parameter and structural uncertainties in model design [5]. Ensemble approaches have been used to quantify uncertainty in future (e.g. seasonal) climate and its impacts (e.g. on malaria incidence) in a probabilistic way [6]. In this analysis disease model outputs represent a probability distribution of disease risk. In years and regions where the probability distribution is broad there will be little predictability in the system. However, where there is a sharp probability distribution, predictability will be stronger and information may be used by decision-makers for taking precautionary action. The main advantage of using a probabilistic system is that users should not be misled by overconfident erroneous forecasts in situations where predictability is small [7]. Building on the experiences of the climate forecasters, this paper describes recent advances in the effort to implement a multi-malaria-model ensemble framework and to test the validity of this approach using retrospective malaria and climate data obtained from Kericho, in the western highlands of Kenya.

Kenya’s western highlands have long been at the centre of debate over whether or not global climate change has played a significant role in the post 1980′s re-emergence and increasing incidence of *Plasmodium falciparum* malaria [8–18]. Attention has been given to reported outbreaks in, for instance, the Kisii District of Nyanza Province and the adjacent tea plantations in Kericho. Inpatient and outpatient data from these sites suggest that malaria patterns over the period 1980–2000 were characterized by increased incidence, expanded geographic areas and higher case-fatality rates [10]. Malaria-positive cases in Kericho have, however, recently declined and returned to moderate levels since 2005 [17], and such marked decline has been observed across many localities in East Africa [19]. As widely discussed in the scientific literature, changes in local climatic conditions are not the only external factor driving the observed changes in malaria epidemics [9]. Anti-malarial drug resistance [20–23], economy-driven, two-way mobility from/to endemic-prone lowlands [24], changes in mosquito populations [25], and to a lesser extent, depletion of regional health services [26], have also played a critical role in long-term changes in malaria morbidity. All these environmental, socio-economic and behavioural factors need to be considered together [27–30] in order to understand the general epidemiology of the disease and the timing and severity of *P. falciparum* malaria epidemics.

Here a multi-malaria-model ensemble framework, which comprises four well-known process-based malaria models, is implemented to assess temporal changes in malaria morbidity profiles in Kericho, in the highlands of Western Kenya. Simulations are focused on the role that long-term changes in climatic conditions (temperature and rainfall) play in driving malaria incidence, but can be expanded to the analysis of changes in non-climatic factors once related information becomes available. The potential advantages of a multi-model approach in helping decision-makers to better understand the impact of exogenous drivers of malaria risk are therefore described.

## Methods

### Study site

Analyses are focused on Tea Plantation 1 in Kericho district (1,200-3,000 m above sea level), a region of economic and political importance given its agricultural activities [23]. Kericho provides a good scenario for modelling the timing and severity of *P. falciparum* malaria outbreaks and the potential impact of changes in climatic conditions on malaria morbidity profiles. Two tea plantations in Kericho, each consisting of 18 estates, employ in average 18,000-18,500 workers whose families comprise three to four dependents each [24]. Assuming that the number of individuals has been stable over the past decades [31], the total population at risk in Plantation 1 can be assumed to reach about 27,000 individuals. Simulations presented here complement previous experiments for the Kisii District Hospital of Kisii municipality [29].

### Data

Data included weather station records and *P. falciparum* malaria positive cases. Quality controlled daily records of maximum temperatures, minimum temperatures and rainfall totals, gathered at Kericho meteorological station [18], located at 33°21′E and 0°21.6′S in the Kenyan highlands, were processed. Temperature records are available for the period spanning 1 January, 1979 to 31 December, 2009. Rainfall time series are available for the period spanning 1 January, 1980 to 31 December, 2009. Monthly malaria-positive cases from inpatient admission registers in Tea Plantation 1 in Kericho, spanning the period January, 1970 to October, 2004, were obtained from Figures four and six in [23], see Figure 1(A).

### Process-based models

In the multi-malaria-model ensemble proposed for this set of simulations only four mathematical tools were considered: the models proposed by Ross-Macdonald [32, 33], Anderson and May [34], Worrall *et al.*[35], and Alonso *et al.*[36]. These four process-based models exemplify the ample spectrum of malaria modelling approaches: from a tool with a single dynamical, discrete equation to a process-based model with a system of 11 coupled ordinary differential equations. The Ross-Macdonald’s model (MAC model) is based upon a system of two coupled ordinary differential equations, whose dynamical variables represent the proportion of people affected and the (implicit) counterpart in the vector population. These proportions do not distinguish between infected and infectious stages. Anderson and May extended the Ross-Macdonald’s model by considering the proportions of exposed individuals and exposed mosquitoes, and by including the latency of infection in human hosts and mosquito vectors. The herein-called AM model is thus based on a system of four coupled ordinary differential equations with time lags. Worral *et al.* developed, in turn, a single discrete-equation, temperature- and rainfall-driven process-based model (WCT) to predict malaria epidemics in areas where brief seasonal transmission and occasional epidemics do not enable acquired immunity, and to examine the impact of indoor residual spraying on malaria transmission intensity. The WCT tool is composed of six submodels, which calculate the number of adult female mosquitoes feeding on human hosts, the length of the gonotrophic and sporogonic cycles, the vector survivorship in sprayed and unsprayed populations, the sporozoite rate, and the total number of new infections, superinfections and recoveries within the human population. Lastly, Alonso *et al.* developed a coupled mosquito-human model, herein called the ABP model, based upon a system of 11 coupled ordinary differential equations. In the human host component, level variables represent the susceptible non-infected human hosts, the infected but non-infectious individuals, the infected individuals who acquire asymptomatic infection but are nevertheless infectious and can transmit malaria parasites to mosquito vectors, the recovered individuals or those human hosts who have cleared parasitaemia, and the infected individuals who present symptoms and therefore receive some sort of clinical treatment. In the mosquito population, level variables depict the number of larvae, the larvae carrying capacity, and the total number of susceptible non-infected mosquitoes, infected non-infectious mosquitoes, and infectious mosquitoes. A full description of all these process-based models is presented in the Additional file 1. Their community-based, *Plasmodium* parasites, human host, *Anopheles* mosquito population and environmental parameters and exogenous variables (see Tables 1 and 2) were initially gathered from published literature.

The following three endogenous variables of the MAC model were modified to include climate covariates: *a*, represented as a function of *T*_{
e
} following the regression between the inverse of the average gonotrophic cycle and the daily ambient temperature [36]; the anopheline density in relation to man (*m*), represented as a linear function of *μ* and the monthly rainfall [35]; and *p*, represented as a function of *U*, which in turn is dependent on the daily ambient temperature. Besides the three endogenous variables modified in the MAC model, the following two variables were changed in the AM model: *n*, represented as a function of the daily ambient temperature; and *WN*, represented as a function of time. The following four endogenous variables of the WCT model include climate covariates: the number of mosquitoes emerging each month (*q*), represented as a linear function of *μ* and the monthly rainfall; *p*, as a function of *U*; *n*, represented as a function of the daily ambient temperature; and *a*, represented as a function of the human blood index (*h*) and *U*. Lastly, the following five endogenous variables of the ABP model include climate covariates: *a*, represented as a function of *T*_{
e
}; the larval mortality rate (*δ*_{
L
}), as a function of the temperature-dependent larval mortality (*δ*_{
L
}*(T)*) and the rainfall-dependent increase in mortality due to heavy rain (*δ*_{
L
}*(P)*); the larval development rate (*d*_{
L
}), as a function of the daily ambient temperature; the average lifetime of mosquitoes, (〈*λ*〉), represented as a function of the daily ambient temperature; and the *per-capita* rate at which new infectious mosquitoes arise (*γ*_{
P
}), dependent on the daily ambient temperature.

### Set of simulations

Simulations proposed here included six series of experiments, which were run using the user-friendly, online-downloadable, open source computer software Scilab® 5.3. Codes developed for the analyses are available upon request. Experiments were designed to: 1) compare Scilab® 5.3 simulation outputs with analytical solutions; 2) perform simulation runs for changes in initial conditions and for seasonal variations in climatic variables; 3) simulate actual climatic conditions and assess the role of climate long-term trends, inter-annual dependency and seasonality in malaria incidence; 4) assess models’ sensitivities to changes in sets of parameters; 5) incorporate uncertainty in the predictability of malaria outbreaks; and 6) analyse the potential impact of anti-malarial drug resistance on morbidity profiles. A brief description of each of these experiments is presented below.

The first set of experiments included comparisons of simulation outputs with the results of the analytical study of equilibrium points, time to reach equilibria and time steps of the MAC and WCT models. Parameters of these two models were fixed to representative values and full certainty in their values was initially assumed.

The second set of simulations included models’ sensitivities to changes in initial conditions and simulation outputs for constant climatic conditions. As in the analysis of stability conditions, parameters of the four-malaria-model ensemble were fixed to fully certain representative values. Changes in equilibrium points and time to reach equilibria were assessed for at least five different initial proportions of infected or infectious individuals. Constant mean annual temperatures and total annual rainfall amounts, as well as historical annual cycles of mean temperature and rainfall were used to characterize local epidemiological conditions. Simulated annual cycles of malaria prevalence (once models reach their equilibria) were then compared to the historical annual cycle of *P. falciparum* malaria incidence.

The third set of experiments comprised simulations of actual climatic conditions over the retrospective period spanning January, 1979 to October, 2004, when the malaria data end. Some parameters of the four-malaria-model ensemble, which were initially set to fully certain values, were then modified to several values within a sensible range reported in the literature. In the MAC model, *HD*, *WN* and *m* were fitted using the full retrospective period January, 1979 to October, 2004. In the AM model, the following parameter values were fitted: *t*_{
h
}, *WN*, *m*, and *t*_{
m
}. In the WCT model, the following parameter values were modified within their reported range and later fitted: *r* and *m*. Lastly, in the ABP model the following parameters were included in this analysis: *1/g*, *b*_{
e
}, *s*_{
0
}, *x*, *h*, *r*_{
0
}, *n*, *F*, *d*_{
0
}, *d*_{
R
}, *k*_{
A
}, and *k*_{
E
}.

Simulation outputs were compared through several statistical parameters such as the correlation coefficient (R-value) between simulated malaria cases and actual positive cases, the percentage of the variance of the actual malaria morbidity that is explained by simulation outputs (R^{2}-value), the slope of the regression of simulated cases on actual cases, and the mean square and mean absolute errors. Comparisons also included a function of likelihood that is based on the probability of observing *I*_{
o
} cases given the deterministic prediction *I*, as discussed in [36]. Best set of parameters were those yielding ‘comparable predictions of actual malaria positive cases’ [36]. The ‘most likely’ models were then implemented to assess the impacts of changes in climatic conditions on *P. falciparum* malaria transmission dynamics in the highlands under study. The ensemble was run with and without long-term climatic trends, inter-annual dependency and historical seasonality, in order to address how much of a change in the size of epidemics could be attributed to changes in climatic conditions.

The third set of experiments also included multi-model simulations to the end of the Kericho temperature and rainfall data (i e, retrospective period spanning January, 1979 to December, 2009), in order to understand whether or not climatic conditions have been less favourable to malaria transmission in recent years. A full certainty in the ‘most likely’ set of parameters was also assumed in these simulation runs.

The fourth set of simulations included models’ sensitivities to changes in sets of parameters. In order to assess the impacts of changes in exogenous variables on simulation outputs of the proposed process-based models, the following discrete gradient was used to measure the models’ response to slight variations in the values of their best set of parameters, *x* = ( *x*_{1}, *x*_{2}, ⋯, *x*_{
i
}, *x*_{i + 1}, ⋯, *x*_{
n
}):

where *F* ( *x*_{1}, *x*_{2}, ⋯, *x*_{
i
}, *x*_{i + 1}, ⋯, *x*_{
n
}) denotes the simulation outputs function for all the parameters. Also, the Sobol Index was used to assess the sensitivity of a given model to slight changes in its set of parameters. For the WCT model, for instance, *m*, the proportion of mosquitoes feeding on humans (*h*), *l*, *a*, *k*, *v*, *u*, *r*, *f*_{
u
}, *g*_{
u
}, *f*_{
N
}, *g*_{
N
}, and the proportion of humans that are infectious (*x*) were all included in the analysis of WCT sensitivity.

The fifth set of simulations explored the role of uncertainty in the predictability of malaria outbreaks. Numerical simulations generated distributions of monthly cases or *P. falciparum* malaria prevalence by taking into account uncertainty in parameter values (i e, introducing parameter ranges in simulation runs). Twenty-five, 50 and 95% percentiles of the distributions of simulated primary cases or malaria prevalence were plotted for each month and compared to actual positive cases or *P. falciparum* malaria incidence. Simulations also included time lags of zero, one and two months.

The sixth and last set of simulations focused on the analysis of non-linear changes in the mean duration of host’s infectivity to vectors, from the first to the final present of infective gametocytes, due to increased resistance to anti-malarial drugs [20, 37] and the influence of higher transmission on its spread [38]. Although chloroquine resistance was first reported in Kenya in the late 1970s [39], only by 1996 were clear signs of increased resistance reported in Kericho [20]. The recovery rate was thus set to reflect high sensitivity of malaria parasites to chloroquine in the mid-1980s, and low to moderate sensitivity by the mid- to late-1990s. The proposed non-linear fashion allows representing that approximately half of clinical infections did not clear thoroughly by the end of the available historical period [20]. A single simulation run was compared with the 25, 50 and 95% percentiles of the distributions of monthly *P. falciparum* malaria prevalence suggested by the multi-malaria-model ensemble for time lags with the highest R^{2}-values.

### Analysis of climate data

Annual cycles of observed rainfall and minimum and maximum temperatures were calculated and compared with the annual cycle of *P. falciparum* malaria incidence. Annual values of several climatic variables were then computed. Climate variables included the diurnal temperature range, which has been suggested to be important in the analysis of malaria transmission dynamics [14]. Total December-January-February, March-April-May, June-July-August, and September-October-November rainfall amounts, dry days and maximum dry spells were also processed to support the analyses. A total number of 24 climatic variables were analysed: 12 for rainfall, four for minimum temperature, four for maximum temperature, and four for the diurnal temperature range.

Long-term linear trends in observed and simulated annual time series were identified using simple regression analysis, and trend magnitudes were calculated by the method of least squares. Upper and lower confidence limits were also computed for the simple linear regression models. Confirmatory analyses were implemented to assess the statistical significance of the observed trends. Four hypothesis tests: the Student’s t-test, the Hotelling-Pabst test, the non-parametric Mann-Kendall test [40], and the aligned rank Sen’s t-test [41], were all used to assess the null hypothesis of statistically significant (at a α = 0.05) linear trends in annual time series. Serially independent yearly time series were assumed when implementing the non-parametric Mann-Kendall test. A historical time series was considered to have a statistically significant trend at a α = 0.05 significance level when at least three of the implemented hypothesis tests accepted the null hypothesis of a trend in the mean.

Wavelet analysis [42, 43] was conducted to assess the dominant periodic signals in observed monthly time series of minimum temperature, maximum temperature and total rainfall. Monthly one-dimensional series were decomposed into two-dimensional time-frequency space using wavelet plots. Seasonality, interannual variability associated with the El Niño-Southern Oscillation (ENSO), and longer interdecadal fluctuations were studied in global wavelet plots. Long-term linear trends and dominant periodic signals were then removed from historical time series to compare, in anomalies plots, actual malaria morbidity profiles with simulated malaria incidence.

## Results

### Climate and malaria

Rainfall amounts observed in Kericho over the period 1979–2009 exhibit a seasonal cycle that fits the long rains and short rains climatology expected for Western Kenya, see Figure 1(B). The highest peak commonly occurs during the months of April and May, whose monthly values reach about 250–260 mm. A dry season usually takes place during the quarter December-January-February with rainfall amounts ranging from 90 to 115 mm/month. Minimum temperatures exhibit a bimodal annual cycle with peaks of 11.6°C and 11.1°C occurring during the months of April and November, respectively, and historical low values of about 10.6°C usually taking place in September, see Figure 1(C). Maximum temperatures show an annual cycle with a peak in February of about 26.2°C and a minimum value of 22°C in July, see Figure 1(C). Mean temperatures exhibit, in turn, a seasonal distribution with a peak in the months of February and March of about 18.5°C and a minimum value in July of 16.7°C. The dominant periodic signals in the historical monthly time series of rainfall are six months, 12 months and 32 to 64 months; the remaining signals are beyond the cone of influence in the global wavelet power spectra. The dominant signals in the historical monthly time series of minimum and maximum temperatures are six months, 12 months, 40 to 48 months, and 64 to 96 months; the latter, however, is also beyond the cone of influence. The dominant interannual variability could therefore be represented by a 3.4-year period sinusoid.

*Plasmodium falciparum* malaria incidence observed in Tea Plantation 1 exhibits, in turn, a bimodal annual cycle with peaks in the months of February and June-July of about 3.8 and 5.3-5.0 positive cases per 1,000 inhabitants, see Figure 1(B). Minimum malaria incidence is commonly observed during the months of October-November-December with values reaching 2.0 positive cases per 1,000 inhabitants. The June-July peak in malaria incidence follows the maximum monthly rainfall with a two-month time delay. It also shows to follow the peak in mean temperatures with a four-month timelag.

Additional file 2 presents the historical values of the set of observed climatic variables under study and the long-term trends in their annual time series. The historical annual rainfall (R1) reaches 1,986 mm/year with a 95% confidence interval of ±94.2 mm. Only the total number of dry days per year (R2) exhibited a statistically significant (at α = 0.05) long-term linear trend of about +7.4 days per decade. Historical annual average minimum (ATmin) and maximum (ATmax) temperatures reach 11.0 ± 0.1°C (95%) and 24.1 ± 0.1°C (95%), respectively. Minimum temperatures on the warmest days (MTmin), annual minimum temperatures (ATmin) and day-to-day standard deviation of minimum temperatures (SDTmin) showed increasing trends of +0.4, +0.2 and +0.1°C per decade, respectively. Maximum temperatures on the warmest days (MTmax), annual maximum temperatures (ATmax) and maximum temperatures on the coldest days (mTmax2) exhibited increasing trends of +0.2, +0.3 and +0.2°C per decade, respectively. The rest of the annual historical time series did not show statistically significant trends at a = 0.05. Mean annual temperatures thus likely increased at a rate of +0.25°C per decade over the period 1979–2009. This rate of change is consistent with trends reported by previous studies [18].

### Simulation outputs

Additional file 3 depicts the MAC, AM, WCT, and ABP simulation outputs for the historical annual cycles of mean temperature and rainfall. For the set of parameters defined in the analysis of base scenarios, models overestimate the historical *P. falciparum* malaria incidence in 0.7 to 4.0 positive cases per 1,000 inhabitants. They also exhibit, on average, a unimodal annual cycle with a peak in the months of May and June, compared to the observed bimodal seasonal distribution of malaria incidence. Moreover, process-based models show different abilities to fit the baseline seasonality that are likely to come from the way they describe different aspects of the *P. falciparum* malaria transmission cycle. The MAC, AM and WCT models are driven by the combined effects of mean temperature and rainfall, whereas the ABP model is influenced by the dynamics of the force of infection and its two main components (the local transmission and the external force of infection), as well as by the fluctuations of the larvae carrying capacity, which in turn are controlled by rainfall. Additional file 3 also displays the WCT results for various mean durations of infectivity. Changes in the infectivity from 40 to 95 days (equivalent to changes in the human host recovery probability from 0.7500 to 0.3158 month^{−1}) increase simulated *P. falciparum* malaria prevalence from 2.3 to 5.2 positive cases per 1,000 inhabitants in the months of September and October, and from 5.7 to 13.3 positive cases in March; i e, changes in the mean duration of infectivity have a strong impact on malaria prevalence particularly after the February and March peak of mean temperatures.

For full certainty in its best set of parameters and for the actual climatic conditions observed over the full retrospective period 1979–2009, the four-malaria-model ensemble explains approximately 33% of the variance of monthly *P. falciparum* malaria incidence in Kericho, with a mean square error of about 1E-05. Individual simulation outputs explain from 20 to 30% of the variance, and thus are below the R^{2}-value obtained by the four-malaria-model ensemble. For +0.15, +0.25 and +0.35°C per decade detrended time series, the total variance explained decreases from 33 to 24.3%, 14.4 and 4.0%, respectively. The mean square error remains constant. When the +0.25°C/decade long-term trend and the 3.4-year cycle are removed from the climatic time series, individual MAC, AM, WCT, and ABP simulation outputs show different results. R^{2}-values of the MAC and AM models suggest that almost all the correlation between simulated malaria prevalence and actual malaria incidence is explained by the long-term trend and the interannual dependency. ABP and WCT simulation outputs indicate that the seasonal cycle explains most of the variance of the observed *P. falciparum* malaria incidence. Lastly, for the actual climatic conditions observed over the period 2005–2009, ensemble simulation outputs suggest that *P. falciparum* malaria prevalence reduced from 13.8 positive cases per 1,000 inhabitants to almost 5.1 primary cases over the last five years of the retrospective period. Simulation runs thus suggest that climatic conditions have likely been less favourable to malaria transmission in the area under study in recent years.

Additional file 4 shows the 25, 50 and 95% percentiles of the distributions of monthly *P. falciparum* malaria prevalence simulated by the MAC, AM, WCT, and ABP models, for actual climatic conditions, and for one-, one-, two-, and zero-month time lags, respectively. These lags exhibited the highest correlation coefficients between observed malaria incidence and simulated prevalence. Simulation outputs for uncertainty in parameter values included, respectively, 90, 142, 131, and 131 runs of these models (a grand total of 494 set of parameters were simulated). R^{2}-values of the 50% percentiles reached 30.9, 31.6, 20.7, and 22.2%, respectively, as presented in the scatter plots in Figure 2. The highest R^{2}-values of the MAC and AM 50% percentiles (35.7 and 32.7%, respectively) were obtained in the quarter December-January-February (DJF), suggesting that these models can capture the February peak in the historical bimodal annual cycle of *P. falciparum* malaria. The highest R^{2}-values of the WCT and ABP models (26.9 and 46.3%, respectively) were obtained in the trimesters March-April-May (MAM) and September-October-November, indicating that these models most likely represent the periods of minimum malaria incidence.

Lastly, Figure 3 shows the 25, 50 and 95% percentiles of the distributions of monthly *P. falciparum* malaria prevalence simulated by the four-malaria-model ensemble. 31.8% of the variance of *P. falciparum* malaria incidence is explained by the ensemble median. However, if individual simulation outputs are merged at a monthly timescale, the ensemble median explains 36.7% of the variance of the observed *P. falciparum* malaria. Also, ensemble simulation runs showed their highest R^{2}-values of 32.5 and 31.2% in the quarters DJF and MAM, respectively. Figure 3 also depicts the monthly *P. falciparum* malaria prevalence suggested by the ensemble for non-linear changes in the mean duration of host’s infectivity to vectors. In this case, 37.7% of the variance of malaria incidence is explained by simulation outputs. Moreover, Figure 3 shows the spread of individual model outputs for two specific malaria outbreaks. Frequency histograms and continuous probability distributions show different predictability levels in individual simulation outputs.

## Discussion

This paper described the results of the implementation of a multi-malaria-model ensemble framework to assess temporal changes in malaria morbidity profiles in Kericho, in the highlands of Western Kenya. Since the ensemble framework merges process-based models that are highly sensitive to changes in the duration of the sporogonic cycle, the gonotrophic cycle, and the survival probability of the mosquito vector, which are strongly affected by ambient temperatures, the tool mostly allows the assessment of the impacts of changes in climatic conditions on malaria morbidity profiles. In the foreseeable future the multi-model ensemble can be, however, easily expanded to assess the role of changes in non-climatic factors.

Malaria, as many vector-borne diseases, is highly sensitive to even small variations in ambient temperatures. Previous studies [10, 12, 18, 30, 44–47] suggest that changes in climatic conditions cannot be ruled out as potential drivers of the observed increases in *P. falciparum* malaria in the highlands of Western Kenya. Ensemble simulation runs presented here suggest that from 8.7 to 18.6% of the variance of *P. falciparum* malaria incidence observed in the site under study over the period 1979–2004 could be attributed to the +0.19 to +0.25°C per decade statistically significant long-term linear trend in near-surface air temperatures that took place over the period 1950–2009. Ensemble simulation outputs also suggest that climatic conditions have likely been less favourable to malaria transmission in Kericho in recent years.

Even though the four-malaria-model ensemble overestimates the historical *P. falciparum* malaria incidence when the annual cycles of mean temperature and rainfall are assumed in base scenario experiments, simulation outputs for actual climatic conditions (assuming certainty and uncertainty in parameter values) observed over the selected retrospective period do not fully capture the magnitude of the peaks in malaria incidence. Simulation runs indicate that on top of the aforementioned 8.7 to 18.6% increase in the variance of *P. falciparum* malaria incidence that could be attributed to the long-term trend in ambient temperatures, at least 6% of such variability or over ten positive cases per 1,000 inhabitants during recent peaks in the incidence could be related to the increased resistance to anti-malarial drugs. Hence, long-term changes in climatic conditions and non-linear changes in the mean duration of host’s infectivity could be synergistically driving the increasing incidence of *P. falciparum* malaria in the highlands of Western Kenya.

Which models should be considered in the multi-malaria-model ensemble? Intuitively, those models that better represent the most relevant aspects of the *P. falciparum* malaria transmission cycle, and that exhibit high accuracy and predictive power should be picked. From an operational point of view, it should be preferred to include those models that show a high skill level using a short list of parameters and exogenous variables, which can be easily measured in the field or under controlled laboratory conditions. In addition, models that are consistent with other related tools, that are not complicated, and that in the general sense are useful for routine activities of health services should be chosen. How should the results of the best malaria transmission models be combined? Simulation runs in this set of experiments were combined using equally weighted models. In theory, models with higher reliability and consistency should weigh more than those with lower skill level [48]. Future work will therefore address the need to consider R^{2}-values between simulated malaria cases and actual positive cases, mean square errors, a function of likelihood, or the ‘bias’ and ‘convergence’ criteria [49] for deriving differential model weighting.

There are various limitations in the use of a malaria process-based multi-model ensemble. Models usually describe different aspects of the transmission cycle of *P. falciparum* malaria. As a consequence, some process-based models are driven by ambient temperature while others are strongly influenced by rainfall. Hence, there is a need to initially judge, subjectively and based on pure expertise, which model is suitable for a specific application. Also, simulation experiments cannot span the full range of possible combinations of parameter values and initial conditions due to time and computational capacity constraints. That is why the fine-tuning process of model parameters involves purely subjective judgment, making it hard to guarantee the proper identification of the ‘optimum location’ in the parameter space [48].

## Conclusions

Malaria control specialists need simple, open source tools such as the ones discussed here to make better decisions regarding malaria control investments, particularly now that the impact of current and future climate is increasingly considered important in the development of malaria control and evaluation strategies. Instead of using individual process-based models in isolation, however, authorities may gain more useful insights by developing ‘ensembles’ of different models, where biases in one tool may be compensated by biases in other models. The approach presented here is to use different sets of parameter values for each model and for all the proposed process-based models, and present combined simulation outputs as probability distributions. These experiments are robust in the sense that each process-based model has been subjected to several control simulations, including base scenarios and stability conditions, as well as multiple sets of runs for different choices of parameter values. As mentioned above, results suggest that the mean and the median of the malaria-model ensemble outputs outperformed individual model simulation runs. Results also incorporated the level of uncertainty associated with modelling outputs.

## References

- 1.
Cox FG: History of the discovery of the malaria parasites and their vectors. Parasit Vectors. 2010, 3: 5-

- 2.
McKenzie FE, Samba EM: The role of mathematical modeling in evidence-based malaria control. Am J Trop Med Hyg. 2004, 71: 94-96.

- 3.
Smith DL, Perkins TA, Reiner RC, Barker CM, Niu T, Chaves LF, Ellis AM, George DB, Le Menach A, Pulliam JRC, Bisanzio D, Buckee C, Chiyaka C, Cummings DAT, Garcia AJ, Gatton ML, Gething PW, Hartley DM, Johnston G, Klein EY, Michael E, Lloyd AL, Pigott DM, Reisen WK, Ruktanonchai N, Singh BK, Stoller J, Tatem AJ, Kitron U, Godfray HCJ: Recasting the theory of mosquito-borne pathogen transmission dynamics and control. Trans R Soc Trop Med Hyg. 2014, 108: 185-197.

- 4.
Dinku T, Hilemariam K, Grimes D, Kidane A, Connor S: Improving availability, access and use of climate information. WMO Bull. 2011, 60: 2-

- 5.
Palmer TN, Doblas-Reyes FJ, Hagedorn R, Alessandri A, Gualdi S, Andersen U, Feddersen H, Cantelaube P, Terres J-M, Davey M, Graham R, Délécluse P, Lazar A, Déqué M, Guérémy J-F, Díez E, Orfila B, Hoshen M, Morse AP, Keenlyside N, Latif M, Maisonnave E, Rogel P, Marletto V, Thomson MC: Development of a European ensemble system for seasonal to inter-annual prediction. Bull Am Meteorol Soc. 2004, 85: 853-872.

- 6.
Thomson MC, Doblas-Reyes FJ, Mason SJ, Hagedorn R, Connor SJ, Phindela T, Morse AP, Palmer TN: Malaria early warnings based on seasonal climate forecasts from multi-model ensembles. Nature. 2006, 439: 576-579.

- 7.
Thomson MC, Palmer T, Morse AP, Cresswell M, Connor SJ: Forecasting disease risk with seasonal climate predictions. Lancet. 2000, 355: 1559-1560.

- 8.
Hay SI, Cox J, Rogers DJ, Randolph SE, Stern DI, Shanks GD, Myers MF, Snow RW: Climate change and the resurgence of malaria in the East African highlands. Nature. 2002, 415: 905-909.

- 9.
Shanks GD, Hay SI, Stern DI, Biomndo K, Snow RW: Meteorologic influences on

*Plasmodium falciparum*malaria in the highland tea estates of Kericho, western Kenya. Emerg Infect Dis. 2002, 8: 1404-1408. - 10.
Zhou G, Minakawa N, Githeko A, Yan G: Association between climate variability and malaria epidemics in the East African highlands. Proc Natl Acad Sci USA. 2004, 101: 2375-2380.

- 11.
Hay SI, Shanks GD, Stern DI, Snow RW, Randolph SE, Rogers DJ: Climate variability and malaria epidemics in the highlands of East Africa. Trends Parasitol. 2005, 21: 52-53.

- 12.
Pascual M, Ahumada JA, Chaves LF, Rodó X, Bouma M: Malaria resurgence in the East African highlands: temperature trends revisited. Proc Natl Acad Sci USA. 2006, 103: 5829-5834.

- 13.
Pascual M, Cazelles B, Bouma MJ, Chaves LF, Koelle K: Shifting patterns: malaria dynamics and rainfall variability in an African highland. Proc R Soc B. 2008, 275: 123-132.

- 14.
Paaijmans KP, Read AF, Thomas MB: Understanding the link between malaria risk and climate. Proc Natl Acad Sci USA. 2009, 106: 13844-13849.

- 15.
Chaves LF, Koenraadt CJM: Climate change and highland malaria: fresh air for a hot debate. Q Rev Biol. 2010, 85: 27-55.

- 16.
Omumbo JA, Lyon B, Waweru SM, Connor SJ, Thomson MC: Raised temperatures over the Kericho tea estates: revisiting the climate in the East African highlands malaria debate. Malar J. 2011, 10: 12-

- 17.
Stern DI, Gething PW, Kabaria CW, Temperley WH, Noor AM, Okiro EA, Shanks GD, Snow RW, Hay SI: Temperature and malaria trends in highland East Africa. PLoS ONE. 2011, 6: e24524-doi:10.1371/journal.pone.0024524

- 18.
Waweru SM, Omumbo JA, Lyon B, Thomson MC, Connor SJ: Revisiting the East African malaria debate. WMO Bull. 2011, 60: 1-

- 19.
Okiro EA, Al-Taiar A, Reyburn H, Idro R, Berkley JA, Snow RW: Age patterns of severe paediatric malaria and their relationship to

*Plasmodium falciparum*transmission intensity. Malar J. 2009, 8: 4- - 20.
Rapuoda BA, Ouma JH, Njiagi K, Khan B, Omar S: Status of antimalarial drugs sensitivity in Kenya. Malaria and Infectious Diseases in Africa. 1996, 8: 25-43.

- 21.
Hay SI, Rogers DJ, Randolph SE, Stern DI, Cox J, Shanks GD, Snow RW: Hot topic or hot air? Climate change and malaria resurgence in East African highlands. Trends Parasitol. 2002, 18: 530-534.

- 22.
Sutherland CJ, Alloueche A, Curtis J, Drakeley CJ, Ord R, Duraisingh M, Greenwood BM, Pinder M, Warhurst D, Targett GA: Gambian children successfully treated with chloroquine can harbor and transmit

*Plasmodium falciparum*gametocytes carrying resistance genes. Am J Trop Med Hyg. 2002, 67: 578-585. - 23.
Shanks GD, Hay SI, Omumbo JA, Snow RW: Malaria in Kenya’s western highlands. Emerg Infect Dis. 2005, 11: 1425-1432.

- 24.
Shanks GD, Biomndo K, Guyatt HL, Snow RW: Travel as a risk factor for uncomplicated

*Plasmodium falciparum*malaria in the highlands of western Kenya. Trans R Soc Trop Med Hyg. 2005, 99: 71-74. - 25.
Hay SI, Were EC, Renshaw M, Noor AM, Ochola SA, Olusanmi I, Alipui N, Snow RW: Forecasting, warning, and detection of malaria epidemics: a case study. Lancet. 2003, 361: 1705-1706.

- 26.
Hay SI, Simba M, Busolo M, Noor AM, Guyatt HL, Ochola SA, Snow RW: Defining and detecting malaria epidemics in the highlands of western Kenya. Emerg Infect Dis. 2002, 8: 555-562.

- 27.
Lindsay SW, Martens WJ: Malaria in the African highlands: past, present and future. Bull World Health Organ. 1998, 76: 33-45.

- 28.
Reiter P: Global warming and malaria: knowing the horse before hitching the cart. Malar J. 2008, 7 (Suppl 1): S3-

- 29.
Ruiz D, Connor S, Thomson MC: A multimodel framework in support of malaria surveillance and control. Seasonal Forecasts, Climatic Change, and Human Health – Health and Climate / Advances in Global Change Research. Edited by: Thomson MC, García-Herrera R, Beniston M. 2008, The Netherlands: Springer Science + Business Media, Dordrecht, Springer Netherlands, 101-125. 30

- 30.
Protopopoff N, Van Bortel W, Speybroeck N, Van Geertruyden JP, Baza D, D’Alessandro U, Coosemans M: Ranking malaria risk factors to guide malaria control efforts in African highlands. PLoS ONE. 2009, 4: e8022-

- 31.
Hay SI, Noor AM, Simba M, Busolo M, Guyatt HL, Ochola SA, Snow RW: Clinical epidemiology of malaria in the highlands of western Kenya. Emerg Infect Dis. 2002, 8: 543-548.

- 32.
Ross R: The prevention of malaria. 1911, Murry: London, UK

- 33.
Macdonald G: The epidemiology and control of malaria. 1957, Oxford, UK: Oxford University Press

- 34.
Anderson RM, May RM: Infectious diseases of humans: dynamics and control. 1991, London, UK: Oxford University Press

- 35.
Worrall E, Connor SJ, Thomson MC: A model to simulate the impact of timing, coverage and transmission intensity on the effectiveness of indoor residual spraying (IRS) for malaria control. Trop Med Int Health. 2007, 1: 75-88.

- 36.
Alonso D, Bouma MJ, Pascual M: Epidemic malaria and warmer temperatures in recent decades in an East African highland. Proc Biol Sci. 2011, 278: 1661-1669.

- 37.
Shanks GD, Biomndo K, Hay SI, Snow RW: Changing patterns of clinical malaria since 1965 among a tea estate population located in the Kenyan highlands. Trans R Soc Trop Med Hyg. 2000, 94: 253-255.

- 38.
Artzy-Randrup Y, Alonso D, Pascual M: Transmission intensity and drug resistance in malaria population dynamics: implications for climate change. PLoS ONE. 2010, 5: e13588-

- 39.
Masaba S, Anyona D, Chepkwoni D: In vitro response of

*Plasmodium falciparum*to chloroquine in the Nandi district, Kenya. Bull World Health Organ. 1985, 63: 593-595. - 40.
Kendall MG: Rank Correlation Methods. 1975, Charles Griffin: London, UK

- 41.
Sen PK: On a class of aligned rank order tests in two-way layouts. Ann Math Stat. 1968, 39: 1115-1124.

- 42.
Lau K-M, Weng H-Y: Climate signal detection using wavelet transform: how to make a time series sing. Bull Am Meteorol Soc. 1995, 76: 2391-2402.

- 43.
Torrence C, Compo GP: A practical guide to Wavelet Analysis. Bull Am Meteorol Soc. 1998, 79: 61-78.

- 44.
Rogers DJ, Randolph SE: The global spread of malaria in a future, warmer world. Science. 2000, 289: 1763-1766.

- 45.
Patz JA, Hulme M, Rosenzweig C, Mitchell TD, Goldberg RA, Githeko AK, Lele S, McMichael AJ, Le Sueur D: Climate change: regional warming and malaria resurgence. Nature. 2002, 420: 627-628.

- 46.
Tanser FC, Sharp B, Le Sueur D: Potential effect of climate change on malaria transmission in Africa. Lancet. 2003, 362: 1792-1798.

- 47.
Martens WJ, Niessen LW, Rotmans J, Jetten TH, McMichael AJ: Potential impact of global climate change on malaria risk. Environ Health Perspect. 1995, 103: 458-464.

- 48.
Tebaldi C, Knutti R: The use of the multi-model ensemble in probabilistic climate projections. Phil Trans R Soc A. 2007, 365: 2053-2075.

- 49.
Giorgi F, Mearns L: Calculation of average, uncertainty range and reliability of regional climate changes from AOGCM simulations via the ‘reliability ensemble averaging’ (REA) method. J Clim. 2002, 15: 1141-1158.

- 50.
Charlwood JD, Birley MH, Dagoro H, Paru R, Holmes PR: Assessing survivial rates of

*Anopheles farauti*(Diptera: Culicieae) from Papua New Guinea. J Appl Ecol. 1985, 54: 1003-1016. - 51.
Collins WE, Jeffery GM: A retrospective examination of the patterns of recrudescence in patients infected with

*Plasmodium falciparum*. Am J Trop Med Hyg. 1999, 61: 44-48. - 52.
Detinova TS: Age-grouping methods in Diptera of medical importance with special reference to some vectors of malaria. WHO Monograph Series. 1962, 47:

- 53.
Eichner M, Diebner HH, Molineaux L, Collins WE, Jeffery GM, Dietz K: Genesis, sequestration and survival of

*Plasmodium falciparum*gametocytes: parameter estimates from fitting a model to malariatherapy data. Trans R Soc Trop Med Hyg. 2011, 95: 497-501. - 54.
Ermert V, Fink AH, Jones AE, Morse AP: Development of a new version of the Liverpool Malaria Model I. Refining the parameter settings and mathematical formulation of basic processes based on a literature review. Malar J. 2011, 10: 35-

- 55.
Graves PM, Burkot TR, Saul AJ, Hayes RJ, Carter R: Estimation of Anopheline survival rates, vectorial capacity and mosquito infection probability from malaria vector infection rates in villages near Madang, Papua New Guinea. J Appl Ecol. 1990, 27: 134-147.

- 56.
Hii JL, Birley MH, Sang VY: Estimation of survival rate and oviposition interval of

*Anopheles balabacensis*mosquitoes from mark-recaputre experiments in Sahah, Malaysia. Med Vet Entomol. 1990, 4: 135-140. - 57.
Jepson WF, Moutia A, Courtois C: The malaria problem in Mauritius: the binomics of Mauritian anophelines. Bull Entomol Res. 1947, 38: 177-208.

- 58.
Kiszewski A, Mellinger A, Spielman A, Malaney P, Sachs SE, Sachs J: A global index representing the stability of malaria transmission. Am J Trop Med Hyg. 2004, 70: 486-498.

- 59.
Macdonald G, Göckel GW: The malaria parasite rate and interruption of transmission. Bull World Health Org. 1964, 31: 365-377.

- 60.
Magesa SM, Wilkes TJ, Mnzava AE, Njunwa KJ, Myamba J, Kivuyo MD, Hill N, Lines JD, Curtis CF: Trial of pyrethroide impregnated bednets in an area of Tanzania holoendemic for malaria. Part 2. Effects on the malaria vector population. Acta Trop. 1991, 49: 97-108.

- 61.
Murphy JR, Baqar S, Davis JR, Herrington DA, Clyde DF: Evidence for a 6.5-day minimum exoerythrocytic cycle for

*Plasmodium falciparum*in humans and confirmation that immunization with a synthetic peptide representative of a region of the circumsporozoite protein retards infection. J Clin Microbiol. 1989, 27: 1434-1437. - 62.
Mutero CM, Birley MH: Estimation of the survival rate and oviposition cycle of field populations of malaria vectors in Kenya. J Appl Ecol. 1987, 24: 853-863.

- 63.
Nikolaev BP: On the influence of temperature on the development of malaria plasmodia in the mosquito. Leningrad Pasteur Inst Epidemiol Bacteriol. 1935, 2: 108-109.

- 64.
Schneider P, Wolters L, Schoone G, Schallig H, Sillekens P, Hermsen R, Sauerwein R: Real-time nucleic acid sequence-based amplification is more convenient than real-time PCR for quantification of

*Plasmodium falciparum*. J Clin Microbiol. 2005, 43: 402-405. - 65.
Shute PG, Maryon M: A study of gametocytes in a West African strain of

*Plasmodium falciparum*. Trans R Soc Trop Med Hyg. 1951, 44: 421-438. - 66.
Sinden R: Sexual development of malarial parasites. Adv Parasitol. 1983, 22: 153-216.

## Acknowledgements

We thank Samuel M Waweru from the Kenya Meteorological Department for providing quality controlled daily records of maximum temperatures, minimum temperatures and rainfall totals gathered at Kericho meteorological station. DR was partially supported by the Department of Earth and Environmental Sciences at Columbia University in the City of New York; the International Research Institute for Climate and Society, Lamont-Doherty Earth Observatory; and the Escuela de Ingeniería de Antioquia-Colombia.

## Author information

### Affiliations

### Corresponding author

## Additional information

### Competing interests

The authors declare that they have no competing interests.

### Authors’ contributions

DR processed, analysed and interpreted weather station data, implemented the hypothesis tests for the analysis of homogeneity, coded the malaria process-based models, proposed and performed the set of simulations, carried out the comparisons between simulated malaria cases and actual positive cases, and drafted the manuscript. CB coded the malaria process-based models, helped to perform the simulations and carried out the comparisons. JAO and BL participated in the design of the study and processed, analysed and interpreted weather station data. SJC and MCT conceived and designed research activities, revised the manuscript and gave final approval of its final version. All authors read and approved the final manuscript.

## Electronic supplementary material

## Authors’ original submitted files for images

Below are the links to the authors’ original submitted files for images.

## Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

## About this article

### Cite this article

Ruiz, D., Brun, C., Connor, S.J. *et al.* Testing a multi-malaria-model ensemble against 30 years of data in the Kenyan highlands.
*Malar J* **13, **206 (2014). https://doi.org/10.1186/1475-2875-13-206

Received:

Accepted:

Published:

DOI: https://doi.org/10.1186/1475-2875-13-206

### Keywords

- Malaria model ensemble
*Plasmodium falciparum*malaria- Climate change
- Kenyan highlands