Comparison of statistical models to estimate parasite growth rate in the induced blood stage malaria model
© The Author(s) 2017
Received: 7 June 2017
Accepted: 20 August 2017
Published: 25 August 2017
The efficacy of vaccines aimed at inhibiting the growth of malaria parasites in the blood can be assessed by comparing the growth rate of parasitaemia in the blood of subjects treated with a test vaccine compared to controls. In studies using induced blood stage malaria (IBSM), a type of controlled human malaria infection, parasite growth rate has been measured using models with the intercept on the y-axis fixed to the inoculum size. A set of statistical models was evaluated to determine an optimal methodology to estimate parasite growth rate in IBSM studies.
Parasite growth rates were estimated using data from 40 subjects published in three IBSM studies. Data was fitted using 12 statistical models: log-linear, sine-wave with the period either fixed to 48 h or not fixed; these models were fitted with the intercept either fixed to the inoculum size or not fixed. All models were fitted by individual, and overall by study using a mixed effects model with a random effect for the individual.
Log-linear models and sine-wave models, with the period fixed or not fixed, resulted in similar parasite growth rate estimates (within 0.05 log10 parasites per mL/day). Average parasite growth rate estimates for models fitted by individual with the intercept fixed to the inoculum size were substantially lower by an average of 0.17 log10 parasites per mL/day (range 0.06–0.24) compared with non-fixed intercept models. Variability of parasite growth rate estimates across the three studies analysed was substantially higher (3.5 times) for fixed-intercept models compared with non-fixed intercept models. The same tendency was observed in models fitted overall by study. Modelling data by individual or overall by study had minimal effect on parasite growth estimates.
The analyses presented in this report confirm that fixing the intercept to the inoculum size influences parasite growth estimates. The most appropriate statistical model to estimate the growth rate of blood-stage parasites in IBSM studies appears to be a log-linear model fitted by individual and with the intercept estimated in the log-linear regression. Future studies should use this model to estimate parasite growth rates.
The Global Technical Strategy for Malaria 2016–2030 aims to reduce the incidence of new malaria cases by at least 90% by 2030 . Among the tools that could assist achieving this goal are vaccines that prevent malaria parasite growth in the blood, that is, when the parasite is in the blood stage of its lifecycle. A reliable method to assess the efficacy of blood-stage vaccines is fundamental to decide which candidates are worth further development. A standard methodology to evaluate the activity of blood-stage vaccines is measuring the parasite growth rate, from which the parasite multiplication rate (PMR) can be derived . Parasite growth rate can be estimated in controlled human malaria infection studies [3, 4].
The induced blood stage malaria (IBSM) model is a type of controlled human malaria infection in which subjects are inoculated with blood-stage parasites. The inoculum size can be controlled and therefore all subjects in the study can be inoculated safely and uniformly . Parasitaemia in the blood of subjects is monitored by quantitative PCR (qPCR) , which allows timely data collection from study subjects to estimate parasite growth rate at low levels of quantitation. Efficacy of blood-stage vaccines can be assessed in IBSM studies by determining the reduction in parasite growth rate in the treatment group compared to the control group. As a result, the IBSM model is been increasingly used to test the efficacy of blood-stage vaccine candidates [7, 8].
Statistical approaches to estimate parasite growth rate include either log-linear or sine-wave models fitted to the log10 parasite counts over time [4, 9]. The models used in published IBSM studies [7, 8, 10] have fixed the intercept on the y-axis to the inoculum size administered to subjects in a given cohort as determined by qPCR. Given that the first parasite counts are only detected by qPCR around 4 days after inoculation, the intercept is fixed to the inoculum size by extrapolating the parasitaemia curve to day 0, which is outside of the range of available data, that is, from day 4 to day 7 or 8, the day when the first anti-malarial treatment is typically given. This extrapolation presumes that parasites would grow log-linearly from day 0 to day 4 and at the same rate as in the measured growth period. Extrapolating the available data from day 4 to day 0 generates a highly influential point (a point of high leverage) assumed to be measured without error, which could bias estimation of the parasite growth rate.
Additionally, models with the intercept fixed to the inoculum size assume that the starting circulating parasitaemia equals the inoculum size and is known for each individual. Although the preparation of the inoculum can be standardised and its size quantified, the actual number of viable parasites introduced into the blood stream of each subject cannot be known with certainty and may be influenced by a number of factors. For example, the time interval between thawing of parasite vials and injection into subjects varies, both within a cohort and between cohorts. Thus, the loss of parasite viability over time would result in some variation in the inoculum size administered to each subject. Moreover, variations in the process of inoculum preparation may result in differences in the inoculum size between cohorts. Hence inoculum size is a controlled variable rather than a constant.
An accurate estimation of the parasite growth rate is paramount to assess the efficacy of vaccine candidates against malaria. In this report, data from three published IBSM studies in which the parasite growth rates were estimated using models with the intercept fixed to the inoculum size was re-analysed [7, 8, 10]. A set of statistical models was fitted to the published data, including both a fixed and a non-fixed intercept approach, and the estimated parasite growth rates compared.
Studies and subjects analysed
Data from three previously published studies in which subjects were inoculated with Plasmodium falciparum 3D7 IBSM was analysed [7, 8, 10]. A total of 40 subjects were analysed: five subjects from the Sanderson et al. study; eight subjects from the Duncan et al. study (five vaccinated with AMA1-C1/Alhydrogel+ CPG 7909 and three unvaccinated controls); and 27 subjects from the Payne et al. study (12 vaccinated with FMP2.1/AS01 and 15 unvaccinated controls). Details about study design, and inclusion and exclusion criteria can be found in the original publications [7, 8, 10].
Description of statistical models
Statistical models used in this study
Type of model
1 and 7
2 and 8
3 and 9
4 and 10
5 and 11
6 and 12
The intercept of fixed-intercept models was fixed to the reported inoculum size in each study: ~1800 viable parasites in Sanderson et al. , ~250 viable parasites in Duncan et al.  and ~690 viable parasites in Payne et al. . The size of the inocula was converted to parasites per millilitre by assuming the volume of blood for an individual was 5000 mL. In the instance of Payne et al. , subjects’ body weights were known, and hence more accurate blood volumes could be derived (Additional file 1). The body weight of subjects from the Sanderson et al. and Duncan et al. studies was not available.
Data were processed as detailed in the relevant publications. The parasite growth rate estimated in this study were compared to the estimates reported in the original publications using the same model: Payne et al.  fitted log-linear models, whereas Duncan et al.  and Sanderson et al.  fitted sine-wave models with the period fixed to 48 h. In all three studies, the authors fitted the models by individual and fixed the intercept to the inoculum size. The average parasite growth rate and confidence of interval (CI) was calculated for Duncan et al. and Payne et al. studies by averaging the pooled results from the vaccine and control subjects in each of the studies (n = 8 for Duncan et al., n = 27 for Payne et al.).
The average parasite growth rates estimated for each study are presented along with their standard deviation (SD) and 95% CI for individual models, and the parasite growth rates for each study along with the standard error (SE) and 95% CI for the mixed effects models. The SD across studies was calculated from the average parasite growth rate values estimated for each of the three studies.
Coefficients of multiple determinations (R2) for the individual log-linear models with non-fixed intercept were calculated as 1-RSS/TSS, where RSS and TSS are the residual and total sum of squares, respectively. In linear regression, the TSS is corrected for the mean in non-fixed intercept models, but not in fixed-intercept models. To give comparable results, TSS was corrected for the mean in fixed-intercept models as described by Gordon .
Models fitted by individual
Average parasite growth rate estimates for models fitted by individual (models 1–6)
Sanderson et al.
Duncan et al.
Payne et al.
SD across studies fixed/non-fixed intercept model
Fixed intercept (n = 5)
Non-fixed intercept (n = 5)
Fixed intercept (n = 8)a
Non-fixed intercept (n = 8)b
Fixed intercept (n = 27)c
Non-fixed intercept (n = 27)c
Sine-wave (fixed period)
Sine-wave (non-fixed period)
Log-linear models, as well as sine-wave models fitted with the period fixed to 48 h or non-fixed, resulted in almost identical estimates of average parasite growth rates (within 0.05 log10 parasites per mL/day) and SD (within 0.07) in the three studies analysed, regardless of fixing or not fixing the intercept (Table 2).
In contrast, fixing the intercept had a substantial effect on average parasite growth rate estimates in all fitted models. Fixed-intercept models estimated lower average parasite growth rate values than the corresponding non-fixed intercept models (Table 2). The average parasite growth rate estimate was 0.17 log10 parasites per mL/day (range 0.06–0.24) lower for fixed-intercept models. Moreover, variability (SD) of the parasite growth rate estimates between the three studies analysed was substantially higher (3.5-fold) with fixed-intercept models than with non-fixed intercept models. This increase in variability was observed in log-linear models (SD: 0.073 vs 0.021), sine-wave models with fixed period (SD: 0.073 vs 0.021) and sine-wave models with non-fixed period (SD: 0.067 vs 0.019). However, the variability of the parasite growth rate estimates within a study appears to be lower in fixed-intercept models (Table 2). Non-fixed intercept models had a higher R2 in all log-linear fits than the corrected R2 value for the fixed-intercept models (Additional file 1).
Mixed effects models fitted overall by study
Parasite growth rate estimates for models fitted overall by study using mixed effects models (models 7–12)
Sanderson et al.
Duncan et al.
Payne et al.
SD across studies fixed/non-fixed intercept model
Fixed intercept (n = 5)
Non-fixed intercept (n = 5)
Fixed intercept (n = 8)
Non-fixed intercept (n = 8)
Fixed intercept (n = 27)
Non-fixed intercept (n = 27)
Sine-wave (fixed period)
Sine-wave (non-fixed period)
In the present study, 12 different statistical models were fitted to data from three previously published studies to identify the optimal model for estimation of the parasite growth rate in IBSM studies. The analyses show that fitting log-linear and sine-wave models to data without fixing the intercept to the inoculum size results in smaller variability of the parasite growth rate estimates between studies than fitting models with the intercept fixed. This decrease in variability was observed in models fitted by individual and overall by study. The results of this study suggest that the parasite growth rate is similar regardless of inoculum size, which is consistent with the understanding of the biology of parasite growth.
The variability of the parasite growth rate estimates for models fitted by individual within a study is lower in fixed than non-fixed intercept models, which may be an artefact due to the high leverage of the fixed intercept. When the intercept is fixed to the inoculum size, the parasite growth rate is forced to be similar for all subjects within a study, hence reducing the variability across individual parasite growth rate estimates. Variability of the parasite growth rate is crucial for calculation of sample size of IBSM studies: the lower the variability, the smaller the required sample size. Therefore, it is important that variability of the parasite growth rate is correctly estimated and generalizable to the larger population, that is, not study specific.
The error associated with the parasite growth rate estimates for models fitted overall by study using mixed effects models appears also lower for fixed than for non-fixed intercept models. However, as detailed in Marquardt et al. , comparing the error from fixed and non-fixed intercept models estimated using mixed effects is not appropriate.
The results presented in this report confirm previously reported findings that parasite growth rate estimates are similar in log-linear and sine-wave models  and that log-linear models are functionally equivalent to sine-wave models when evaluating parasite growth rate. Sine-wave models provide useful additional information on the periodicity and amplitude of the in vivo growth of P. falciparum. For computational purposes, fixing the intercept to the inoculum size can facilitate modelling as estimating one fewer parameter can reduce difficulties with model convergence. This is particularly true for sine-wave modelling, where even after fixing the period to 48 h the model will still require five or more data points per subject to estimate all parameters. Nevertheless, sine-wave, non-linear mixed effects models allow all data points to be included, even if fewer than five data points are available for some subjects.
Modelling the data by individual or overall by study had minimal effect on parasite growth rate estimates in malaria-naïve subjects. Mixed effect models used to fit data overall by study combine data with appropriate weights across individuals to estimate an overall parasite growth rate. In models fitted by individual, averages of the individual fits are an unweighted version of the same analysis. Hence, it is not surprising that the analyses performed either by individual or overall by study give very similar estimates of the in vivo growth rate of the P. falciparum 3D7 parasite. Based on simplicity and greater flexibility, the individual fits are preferred over overall study fits. Moreover, individual fits allow investigation of individual immune factors, which are of interest in vaccine trials. However, if the subjects differ greatly in number of data points or have very few points available for modelling because of logistical issues, a weighted average of the individual fits should be considered.
A number of biological reasons further support the rationale for not fixing the intercept when estimating the parasite growth rate. Fixed intercept models assume that the number of viable parasites in the inoculum is constant, both between study subjects in an individual cohort and across studies. However, there is a paucity of experimental data to support this hypothesis. Moreover, a range of sources indicate that parasites may grow at different rates in different subjects, depending on factors such as the subject age, immunological response and red cell factors that may influence parasite replication [16–18]. Thus, extrapolating data from day 4, when parasites are initially detected by qPCR, to day 0, may introduce a confounding effect that is numerically substantial and lacking in biologic plausibility. By not fixing the intercept, this potential confounding effect is accounted for. Therefore, parasitaemia at day 0 for individual study subjects is more accurately estimated using non-fixed intercept models.
The analyses presented in this report were slightly different compared with the original reports. Whether the intercept was fixed to the same inoculum size as in the original reports is not certain. However, since this study closely reproduces the parasite growth rate estimates reported in each of the original publications, the differences between the analyses are not critical for the conclusions of this study.
The most appropriate model to estimate the parasite growth rate in IBSM studies appears to be a log-linear model fitted by individual and with the intercept not fixed to the inoculum size. Parasite growth rates estimated with this model are less variable across studies than the equivalent model with the intercept fixed to the inoculum size. Importantly, using non-fixed intercept models to estimate the parasite growth rate would allow comparison of parasite growth rate estimates between studies, resulting in a more powerful assessment of efficacy of anti-malarial vaccines. Extending the comparison of vaccine efficacy across different research centres would accelerate the development of efficient vaccines against malaria by improving the design of clinical trials that test interventions aimed to eradicate malaria. Moreover, the parasite growth rate could also be used to evaluate the efficacy of chemoprophylaxis that target the blood-stage parasite.
LW data analysis and interpretation, and writing the draft manuscript. IH data management and analysis. LM guidance of mixed model fitting algorithms and interpretation of model parameters. PO study formulation and interpretation of model parameters. JSM interpretation of model parameters. All authors read and approved the final manuscript.
We thank Dr. Laura Cascales for serving as a medical writer; Prof. Sandy Douglas for providing access to original data and advice on analytical techniques used in the original studies; Dr. Ruth Payne for providing data from the original study.
The authors declare that they have no competing interests.
Availability of data and materials
The dataset analysed during the current study are available in the original publications.
Consent for publication
Ethics approval and consent to participate
The data used for the analysis was derived from subjects who consented to participate in the original studies.
This work was supported by the Bill and Melinda Gates Foundation.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- WHO. Global technical strategy for malaria 2016–2030. Geneva: World Health Organization; 2015.Google Scholar
- Sheehy SH, Douglas AD, Draper SJ. Challenges of assessing the clinical efficacy of asexual blood-stage Plasmodium falciparum malaria vaccines. Hum Vaccines Immunother. 2013;9:1831–40.View ArticleGoogle Scholar
- Cheng Q, Lawrence G, Reed C, Stowers A, Ranford-Cartwright L, Creasey A, et al. Measurement of Plasmodium falciparum growth rates in vivo: a test of malaria vaccines. Am J Trop Med Hyg. 1997;57:495–500.View ArticlePubMedGoogle Scholar
- Bejon P, Andrews L, Andersen RF, Dunachie S, Webster D, Walther M, et al. Calculation of liver-to-blood inocula, parasite growth rates, and preerythrocytic vaccine efficacy, from serial quantitative polymerase chain reaction studies of volunteers challenged with malaria sporozoites. J Infect Dis. 2005;191:619–26.View ArticlePubMedGoogle Scholar
- McCarthy JS, Sekuloski S, Griffin PM, Elliott S, Douglas N, Peatey C, et al. A pilot randomised trial of induced blood-stage Plasmodium falciparum infections in healthy volunteers for testing efficacy of new antimalarial drugs. PLoS ONE. 2011;6:e21914.View ArticlePubMedPubMed CentralGoogle Scholar
- Rockett RJ, Tozer SJ, Peatey C, Bialasiewicz S, Whiley DM, Nissen MD, et al. A real-time, quantitative PCR method using hydrolysis probes for the monitoring of Plasmodium falciparum load in experimentally infected human volunteers. Malar J. 2011;10:48.View ArticlePubMedPubMed CentralGoogle Scholar
- Duncan CJ, Sheehy SH, Ewer KJ, Douglas AD, Collins KA, Halstead FD, et al. Impact on malaria parasite multiplication rates in infected volunteers of the protein-in-adjuvant vaccine AMA1-C1/Alhydrogel+ CPG 7909. PLoS ONE. 2011;6:e22271.View ArticlePubMedPubMed CentralGoogle Scholar
- Payne RO, Milne KH, Elias SC, Edwards NJ, Douglas AD, Brown RE, et al. Demonstration of the blood-stage controlled human malaria infection model to assess efficacy of the Plasmodium falciparum AMA1 vaccine FMP2. 1/AS01. J Infect Dis. 2016;213:1743–51.View ArticlePubMedPubMed CentralGoogle Scholar
- Simpson J, Aarons L, Collins W, Jeffery G, White N. Population dynamics of untreated Plasmodium falciparum malaria within the adult human host during the expansion phase of the infection. Parasitology. 2002;124:247–63.View ArticlePubMedGoogle Scholar
- Sanderson F, Andrews L, Douglas AD, Hunt-Cooke A, Bejon P, Hill AV. Blood-stage challenge for malaria vaccine efficacy trials: a pilot study with discussion of safety and potential value. Am J Trop Med Hyg. 2008;78:878–83.PubMedGoogle Scholar
- Gordon H. Errors in computer packages. Least squares regression through the origin. Stat. 1981;37:23–9.Google Scholar
- R Core Team. R: a language and environment for statistical computing. http://www.R-project.org (2015). Accessed 10 Feb 2017.
- Pinheiro J, Bates D, DebRoy S, Sarkar D, R Core Team. nlme: linear and nonlinear mixed effects models. R package version 3.1. http://CRAN.R-project.org/package=nlme (2015).
- Marquardt DW, Snee RD. Test statistics for mixture models. Technometrics. 1974;16:533–7.View ArticleGoogle Scholar
- Douglas AD, Edwards NJ, Duncan CJ, Thompson FM, Sheehy SH, O’Hara GA, et al. Comparison of modeling methods to determine liver-to-blood inocula and parasite multiplication rates during controlled human malaria infection. J Infect Dis. 2013;208:340–5.View ArticlePubMedPubMed CentralGoogle Scholar
- Pinkevych M, Petravic J, Chelimo K, Kazura JW, Moormann AM, Davenport MP. The dynamics of naturally acquired immunity to Plasmodium falciparum infection. PLoS Comput Biol. 2012;8:e1002729.View ArticlePubMedPubMed CentralGoogle Scholar
- Mohandas N, An X. Malaria and human red blood cells. Med Microbiol Immunol. 2012;201:593–8.View ArticlePubMedPubMed CentralGoogle Scholar
- Leffler EM, Band G, Busby GBJ, Kivinen K, Le QS, Clarke GM, et al. Resistance to malaria through structural variation of red blood cell invasion receptors. Science. 2017;356:eaam6393.View ArticlePubMedGoogle Scholar