 Methodology
 Open access
 Published:
Multiple treatment comparisons in a series of antimalarial trials with an ordinal primary outcome and repeated treatment evaluations
Malaria Journal volumeÂ 11, ArticleÂ number:Â 147 (2012)
Abstract
Background
Artemisininbased combination therapies (ACT) are widely used in African countries, including Cameroon. Between 2005 and 2007, five randomized studies comparing different treatment arms among artesunateamodiaquine and other ACT were conducted in Cameroonian children aged two to 60 months who had uncomplicated Plasmodium falciparum malaria. In these studies, the categorical criterion proposed by the World Health Organization (WHO) to assess the relative effectiveness of antimalarial drugs was repeatedly evaluated on Days 14, 21 and 28 after treatment initiation. The aim of the present study was to compare the effects of different treatments on this repeated ordinal outcome, hence using the fully available information.
Methods
The quantitative synthesis was based on individual patient data. Due to the incomplete block design concerning treatment arms between different trials, a mixed treatment comparison (MTC) metaanalysis approach was adopted. The repeated ordinal outcome was modelled through a latent variable, as a proportional odds mixed model with trial, period and treatment arms as covariates. The model was further complexified to account for the variance heterogeneity, and the individual logresidual variance was modelled as a linear mixed model, as well. The effects of individual covariates at inclusion, such as parasitaemia, fever, gender and weight, were also tested. Model parameters were estimated using a Bayesian approach via the WinBUGS software. After selecting the best model using Deviance Information Criterion (DIC), mixed treatment comparisons were based on the estimated treatment effects.
Results
Modeling the residual variance improved the model ability to adjust the data. The results showed that, compared to artesunateamodiaquine (ASAQ), dihydroartemisininpiperaquine (DHPP) was significantly more efficacious. Artesunatechlorproguanildapsone (ASCD) was less efficacious than artesunatesulphadoxinepyrimethamine (ASSP), artemetherlumefantrine (AMLM) and DHPP, the difference with the latter being significant. No difference in efficacy was found between ASAQ and AMLM.
Conclusions
Bayesian mixed treatment comparisons of a network of connected randomized trials with repeated measurements of the primary categorical outcome allowed to take into account both the individual and between studies sources of heterogeneity. The results of the present study complete the previous quantitative review based on a binary outcome at a fixed time point, suggesting that DHPP represents an alternative for the treatment of uncomplicated P. falciparum malaria in Cameroonian children.
Background
Although malaria is a global disease, over 90% of the disease burden concern the populations in subSaharan African countries, where Plasmodium falciparum particularly affects both the young children and pregnant women. Eightyfive percent of the deaths concern children less than five years of age [1].
The treatment strategy recommended by the World Health Organization (WHO) is based on artemisininbased combination therapy (ACT), which rapidly eliminates asexual parasites. Only a few cases of treatment failure due to drug resistance have been reported so far for these treatments [2]. Artemisinin, a natural product extracted from Artemisia annua, was identified as a highly active antimalarial drug. Its derivatives, such as artesunate (AS), artemether (AM) and dihydroartemisinin (DH), were found to be among the most potent of all antimalarial drugs.
To compare the drug efficacy in Cameroon (Central Africa), a series of five trials with different combination therapies was jointly conducted by Organisation de Coordination pour la lutte contre les EndÃ©mies en Afrique Centrale (OCEAC) and Institut de Recherche pour le DÃ©veloppement (IRD) in Yaounde, Cameroon. The standardized 2003 WHO protocol [3] was used to assess drug efficacy in children under five years of age with a patient followup on days 1, 2, 3, 7, 14, 21 and 28 and evaluation of treatment outcome on day 14, day 21 and day 28. A categorical outcome with four categories is recommended in the WHO standardized protocol, which can be considered as an ordinal variable [4]: ACPR (adequate clinical and parasitological response), LPF (late parasitological failure), LCF (late clinical failure) and ETF (early treatment failure).
According to the WHO protocol for intense transmission area, ETF is defined either as a development of danger signs or severe malaria on day 1, day 2 or day 3, in the presence of parasitaemia, or parasitaemia on day 2 higher than day 0 count irrespective of axillary temperature or parasitaemia on day 3 with axillary temperature â‰¥ 37.5 Â°C or parasitaemia on day 3 â‰¥ 25 % of count on day 0. LCF is defined either as the development of danger signs or severe malaria after day 3 in the presence of parasitaemia, without meeting any of the previous criteria of Early Treatment Failure or the presence of parasitaemia and axillary temperature â‰¥ 37.5 Â°C on any day from day 4 to day 28, without meeting any of the previous criteria of Early Treatment Failure. LPF is defined as the presence on day 14 and after of parasitaemia and axillary temperature < 37.5 Â°C, without meeting any of the previous criteria of Early Treatment Failure and Late Clinical Failure. ACPR was defined as an absence of parasitaemia and axillary temperature < 37.5 Â°C without meeting any of the criteria of Early Treatment Failure or Late Clinical Failure or Late Parasitological Failure.
Each trial was conducted to test a new combination of treatments in terms of failure or success. The outcome of these studies presented a clinical heterogeneity due to the diversity of treatments and different timeperiods between 2005 and 2007, which may correspond to different malaria incidences in relation to environment.
Data were first analysed with the WHO criterion considered as a binary criterion (success/failure) fitted separately on either day 14, or day 28 [5], according to the study period. A multitreatment binary mixedeffect regression model was used with a study random effect modeling this heterogeneity. In this first analysis [5], none of the tested treatment was significantly different from the artesunateamodiaquine (ASAQ) treatment reference arm. However, this previous work faced two limits: (i) a binary criterion was used instead of the recommended primary categorical outcome, and (ii) data were fitted separately on days 14 and 28, even though repeated measurements for each individual were available. A possible solution of the first limitation, concerning the use of a binary criterion instead of the primary categorical outcome, was proposed in a subsequent work [6], by analysing the data set on day 14 using the primary outcome as categorical. The second issue regarding repeated measurements on days 14, 21 and 28 of the primary outcome is considered in the present work with the aim to integrate the repeated measurements of the categorical outcome in a global metaanalysis approach.
Whatever the primary outcome is, the metaanalysis approach is not straightforward when more than two treatment arms are present. Indeed, a classical metaanalysis assumes identical two treatment arms in all the randomized trials. However, more complex situations occur when pooling studies with either more than two treatment arms or no identical treatment arms between studies. This results in a situation where a common treatment effect among trials cannot be easily estimated. Mixed treatment comparison (MTC) metaanalysis has been recently proposed as an extension of classical metaanalysis, by including multiple different pairwise comparisons across a range of different interventions [7]. MTC was first introduced in case of evidence synthesis [8], and is now developed in metaanalysis of clinical trials [9, 10]. In this situation, MTC metaanalysis appears as a method for inferring relative treatment effects based on a synthesis of both direct and indirect evidence [11â€“13]. These direct and indirect evidences are usually estimated using Bayesian methods [10, 14, 15].
The main objective of this work was to compare the efficacy of the available combinations over time and to study the effect of individual covariates, by taking into account the subject variability and betweentrials heterogeneity due to different treatment arms. A mixed model for repeated ordinal data is proposed to analyse the clinical and parasitological data. This seems to be the first mixed metaanalysis approach in pooling antimalarial drug, in which the WHO criterion is considered as a repeated categorical outcome though with possible timecensoring.
Data description
A total of 795 children aged two to 60 months were included in five clinical trials, one in 2005, three in 2006 and one in 2007. These successive trials corresponded to a prospective and systematic comparison of antimalarial drugs initiated in 2003 by both OCEAC and IRD. The project at that time was approved by the Ministry of Public Health and the Cameroonian national ethics comittee. All parents or legal guardians gave their written informed consent. The data set was made available by the principal investigator of the project (LB), who initiated the present reanalysis. Data were collected based on the 2003 WHO protocol [3, 16], with an evaluation at three timepoints, day 14, day 21 and day 28 after the start of treatment. The primary outcome was the four categorical response, ACPR, LPF, LCF, ETF, which was repeatedly recorded on days 14, 21 and 28. The category ETF was, in fact, never observed. Individual covariates such as weight, age, gender, parasitaemia on day 0 and day 3 were also measured. Each trial compared two or three treatments among either amodiaquine (AQ) in monotherapy or a combined treatment such as amodiaquinesulphadoxinepyrimethamine (AQSP), artesunateamodiaquine (ASAQ), artesunatesulpha doxinepyrimethamine (ASSP), artesunatemefloquine (ASMQ), artemetherlumefantrine (AMLM), dihydroartemisininpiperaquine (DHPP).
Figure 1 represents the set of treatment arms as a graph, in which each treatment arm is a node. An edge between two nodes exists when they were tested in the same randomized clinical subtrial. This graph can be viewed as a connected network with the exception of study # 2, which is unconnected to the other studies. As suggested by Jansen et al.[10], the following analysis was conducted without this specific study since no increase in the corresponding treatment effect estimates could be gained by pooling this specific trial with the others.
The sample size for each treatment arm was initially set at 50 children, then adjusted to account for dropouts. Details of the observed categorical outcomes, including missing responses (NA) according to each treatment arm within the different trials are shown in Table 1. Fortynine children (6.1%) were either excluded or lost to follow up before day 14. Consequently, 746 patients had their responses assessed on day 14. Missing responses on day 21 and day 28 were related to previously observed treatment failure or lost to followup after day 14. Indeed, as soon as a failure was noticed, the patients received an alternative drug to prevent clinical aggravation and progression towards potentially severe and complicated malaria. Finally, after excluding patients from study # 2, 621 patients were analysed in a perprotocol approach (PP). The sensitivity of the models to the missing responses was assessed by imputing the missing responses after day 14 using different scenarii, including the less favorable scenario in the course of the treated acute episode.
Statistical analyses
The categorical outcome was regressed via a latent continuous variable on various covariates of interest, using either fixed or mixedmodel formulation, with an attempt to take into account the individual response heterogeneity by modeling the residual variance.
Notations and associated latent variable modeling
The categorical ordinal outcome was measured in the studies _{ S m } where m\xe2\u02c6\u02c6\left\{1,3,4,5\right\}, as study _{S 2} was removed for the present analysis. Each study _{ S m }had i=1, â€¦ ,_{ N m } subjects observed at times t=1, â€¦ ,_{ O mi }for subject i. Let _{ Z mit }be the K=3 category response of subject i at time t in study m coded as 1 for ACPR, 2 for LPF and 3 for LCF, respectively, as the ETF category was never observed.
Categorical ordinal data are commonly analysed using an ordinal logistic model [17]. Briefly, this model assumes an underlying latent variable that is related to the ordinal response _{ Z mit } through threshold values. This latent variable corresponds to an unobserved variable, measured on a continuous scale which drives, in each infected patient, the patientâ€™s response to the antimalarial drug, he is exposed to. This latent variable is assumed to depend on observed covariates like patientâ€™s nutritional status, Plasmodium exposure, mosquito bite intensity, level of education or family income for each individual with an heterogeneity between subjects and is modelled accordingly. The thresholds correspond to different distinct values, depending on the number of ordinal categories that separate individuals into various response categories. The response of a given subject is determined by the interval in which its unobserved latent variable falls. Let _{ L mit } be the corresponding latent variable and _{ Î± k }k=1,â€¦,Kâˆ’1, the thresholds which are assumed \xe2\u02c6\u2019\mathrm{\xe2\u02c6\u017e}={\mathrm{\xce\pm}}_{0}<{\mathrm{\xce\pm}}_{1}\xe2\u2030\xa4\xe2\u20ac\xa6\xe2\u2030\xa4{\mathrm{\xce\pm}}_{K\xe2\u02c6\u20191}\xe2\u2030\xa4{\mathrm{\xce\pm}}_{K}=+\mathrm{\xe2\u02c6\u017e}. The relationship between between _{ Z mit }and _{ L mit } can be defined as follows
Let _{ Q mitk }=Pr(_{ Z mit }â‰¤k)=Pr(_{ L mit }â‰¤_{ Î± k }) be the cumulative probability. A natural statistical model links the cumulated probabilities _{ Q mitk } to the covariates via a link function g. Assuming a normal or logistic distribution for the underlying latent variable leads to an ordinal probit regression model or an ordinal logistic regression model, respectively. The complementary loglog link function can also be used. In the following, a logit link function which corresponds to the proportional odds model is used.
The latent variable _{ L mit }was assumed to follow a mixed logit model and could be expressed in the following way:
where _{ X mit } is the matrix of covariates, Î³ is the covariate parameter vector, _{ u i }is the subject random effect, assumed to follow a centered gaussian distribution with constant variance ^{Ï„ 2}. The residuals _{ e mit }, were assumed to be distributed according to a centered logistic random variable with variance _{ Ïƒ mit }. Conditionally to _{ u i }, this model is equivalent to
The covariate model _{ X mit }and the variances _{ Ïƒ mit }are detailed in the next two sections. No study random effect was introduced as the number of studies was small.
Covariate model
The covariate model was the following:
where Tr_{ t il }l=2,â€¦,6, are binary treatment covariates coding for the 6 different treatments; Tim_{ e it }t=2,3, are binary covariates coding for the _{ T m }=3 measurement times (day 14, day 21, day 28) and, Stud_{ y im }m=3,4,5 are 3 binary covariates coding for the four studies. Day 14 was selected as the reference time, study 1 as the reference study. The ASAQ treatment was the reference treatment as it is currently in use in Cameroon, as well as in many other African countries [18]. Comparison was made between ASAQ and the remaining 5 treatments \left\{\mathrm{AQ},\mathrm{ASSP},\mathrm{ASCD},\mathrm{AMLM},\mathrm{DHPP}\right\}.
The parameter vector, Î³=(_{ Î³ l },_{ Î³ t },_{ Î³ m }) represents the effect of the selected covariates, i.e., population mean, treatment, time, and study, respectively. Each _{ Î³ l }represents the treatment effect difference between ASAQ and the corresponding l th treatment, assuming the other fixed.
This general model assumes: i) that the same number of categories for the outcome holds both in each study and at the different time visit; ii) that, at each visit, the treatment differential effects verify the proportional odds hypothesis between studies. Each parameter is represented in terms of the logarithm of the cumulative Odds Ratio (logOR). The corresponding OR is obtained by taking the exponential. Because data were treated as categorical, log(OR) represents the posterior cumulative logarithm of odds ratio, linking ACPR to LPF. A log(OR) greater than 0 with a 95% confidence interval not containing 0 means that there is an improvement of subject status over time for a given treatment compared to the reference treatment. A positive regression coefficient means that the effects proceed towards the best response (ACPR), whereas a negative regression coefficient means that the effects go towards the worst response (LPF here).
Modeling the residual
The simplest residual variance model is the classical constant model (_{ Ïƒ mit }=Ïƒ). This model is referred as Model M1 or homogeneity model in the following sections. Because of the presence of multitreatments and heterogeneity of the discrete outcomes among treatment arms, a more flexible, yet parsimonious, general model was introduced to take into account the large heterogeneity of the residual variance. This approach is derived from Foulley & Jaffrezic [19], who proposed to model the residual variance as a function of some relevant covariates. Relevant covariates like treatment arms, different followup period, the different studies, and a subject random effect, were selected to enter the model. As described by Foulley & Jaffrezic[19], a structural mixed model on the log of variances was proposed:
where {v}_{i}\xe2\u02c6\xbc\mathcal{\xed\u2019\copyright}(0,{\mathrm{\xce\xb7}}^{2}) models the betweensubject heterogeneity of the discrete outcome, and the vector Î´=(_{ Î´ l }_{ Î´ h }_{ Î´ m }) represents the vector of covariates effects to be estimated. This leads to model M2.
Model M3 discarded the subjectspecific random effect _{ v i } on the log of the variances in equation (2):
Model M4 kept only the treatment effects in equation (2) to form the following:
Finally, another model called M5 was also considered by adding a subject random effect to equation (4), corresponding to:
Parameter estimation, model comparison and validation
All analyses were based on individual patient data. A Bayesian approach under the WinBUGS software [20] was used to estimate the parameters of models M1M5, as it handles easily hierarchical logistic models, together with model selection and model validation. The estimation procedure was based on Gibbs sampling. The above models were implemented by setting priors to all parameters. The threshold values _{ Î± k } were sampled as follows: _{Î± 1} was set to zero, _{Î± 2} was assumed _{Î± 1} + Î”, where Î” followed a uniform prior distribution \mathcal{\xed\u2019\xb0}(0,5). Priors for the time and study effects were assumed \mathcal{\xed\u2019\xb0}(\xe2\u02c6\u20195,5), whereas priors for the variances ^{Ï„ 2}and ^{Î· 2} were choosen \mathcal{\xed\u2019\xb0}(0,80) and \mathcal{\xed\u2019\xb0}(0,4), respectively, as suggested by [19], where \mathcal{\xed\u2019\xb0}(a,b) corresponds to a uniform distribution on the interval (a b). Priors for the other individual covariates in the different variance models, like weight, gender, age, parasitaemia, were assumed normally distributed \mathcal{\xed\u2019\copyright}(0,100).
All Bayesian analyses were performed using one chain of 50,000 samples, the first 25,000 of which were removed to allow for burnin. Credibility intervals were estimated together with the parameters. All parameters were expressed as logarithm of odds ratios. In practice, when these intervals contained zero, the parameter was considered to be not different from 0. To take into account the problem of multitreatment comparisons, the Bonferroni correction was used. The different models were compared using the DIC (deviance information criterion) [21]. The best model was considered to be the one with the smallest DIC.
Sensitivity analysis and missing responses imputation
Limiting the analysis to the observed responses only exposes to biases, as it does not take into account the responses recorded as NA, the details of which are given in Table 2. These NA responses could have several origins: i) the absence of the child at the time of the scheduled visit, due to some particular familial event related or not to the perceived health status of the child by the parents. The field worker usually managed to visit the family when they returned and record the outcome; ii) the decision to switch to another treatment before the scheduled visit when, at the previous visit or in the time interval between the two visits, the observed outcome suggested treatment failure and motivated the switch. Even if the child was still followed up in the trial design, his or her real status outcome was recorded not applicable. In the following these responses will be called missing, although they were recorded but considered not applicable, as the child was no longer under the allocated treatment. In order to test the sensitivity of the results to these missing responses, missing responses were replaced with the last observed response which was carried forward to all the following visits, except situations #1 and #2 in Table 2, which were imputed with the less favorable scenario LCF. This approach is refered as the imputation approach therafter.
When a failure was recorded, blood samples were tested using PCR for assessing either the persistance of the infection, i.e. a real treatment failure, or a new infection with a different parasite strain. In the latter situation, treatment failure could be cancelled and imputed ACPR. This PCR corrected data set was analysed in the sensitivity analysis to compare with the PP analysis.
Results
Individual covariates, i.e., weight, gender, age, and parasitaemia, were tested in a fixed effect model together with treatment, time and studyeffects using a fixed effect model, in the PP approach. As shown in Table 2, none of the individual covariates was significant, whereas both time and treatment effects were significant. ASCD appeared significantly less efficacious than ASSP. The negative time effect coefficient suggested that the complete response (ACPR) decreased significantly over time, from day 14 to day 28. This result can be related to a loss of improvement due to treatment failure caused by reinfections or recrudescence over time, or an overall efficacy of drugs as early as Day 14. The results for the other analyses performed with models M1, M2, M3, M4 and M5 without individual covariates, are displayed in Table 3 for both PP and imputation approaches. Both PP and imputation approaches gave similar results.
Comparison and validation of the different approaches
Different models were compared, starting with the standard threshold model with homogeneous variance (M1). Modeling the heterogeneity of residuals considerably improved the fit as shown in Table 4. This suggested a gain in modeling the heterogeneity of residuals in the presence of the treatment, time and study covariates. However, this gain decreased when modeling only the treatment effect within the residual variance. As shown in Table 4, the DICs in models M4 and M5 are larger than DICs in models M3 and M2. Consequently, the best model was M3 for the PP approach and M2 for the imputation approach.
Direct and indirect comparisons
The model M3, which gave the best adjustment to the data set, was selected for a simultaneous comparison between treatments. Figure 2 shows the treatment effects estimated in Model M3 using the PP approach, ranked in chronological order of the trials. Direct and indirect treatment effects could then be computed and are represented in the same figure.
ASAQ and DHPP treatments differed significantly. DHPP was globally more efficacious than ASAQ (log\mathrm{OR}=2.88, 95%CI=[1.18;4.57]). DHPP was more efficacious than ASCD (log\mathrm{OR}=4.13, 95%CI=[1.37;6.88]). As compared to AMLM, the combination ASCD was less efficacious (log\mathrm{OR}=\xe2\u02c6\u20192.60, 95%CI=[âˆ’5.81;0.61]); ASCD was found less efficacious than ASSP (log\mathrm{OR}=\xe2\u02c6\u20192.84, 95%CI=[âˆ’5.90;0.22]), though both differences were not significant. All the other direct and indirect comparisons did not differ significantly as well.
Discussion
The aim of this work was to pool the results from five randomized clinical trials comparing the efficacy of antimalarial drugs based on the same repeated observationtime design but with partially overlapping treatment arms, in order to improve the estimated treatment effects and their corresponding variances. Among the five studies, one was discarded (study #2) as it was not connected to the other ones, whereas the four remaining studies (studies # 1,3,4,5) were analysed with a mixed ordinal logistic model incorporating a betweensubject heterogeneity variance model. This approach can be considered as an extension of the multitreatment approach of Jansen et al.[22], which was limited to a binary response at a single time point (day 28) or, an alternative to a recent work carried by Dakin et al.[23], where the outcome was continuous. Results concerning the unconnected study are just mentioned for the sake of completeness, as they were not part of the global analysis: they showed that the combination ASMQ was more effective than AQSP. In the global analysis, the best model was M3 with a random individual effect, in which the residual variance was a function of explanatory covariates. Modeling the subject residual variance appeared to improve the model ability to fit the data by reducing heterogeneity within the analysed trials. Based on model M3, DHPP was significantly more efficacious than ASAQ, whereas ASCD appeared less efficacious than ASSP, AMLM and DHPP, the latter difference being significant. These results slightly differ from the results of our previous work [5], in which no significant treatment difference was found. Therefore, taking into consideration both the ordinal type of the WHO criteria and the results at the repeated visits seems to increase the power for finding a difference, if any.
Regarding the categorical outcome, LCF is symptomatic, whereas LPF is not. It remains possible that a patient with LPF become symptomatic beyond day 28. However, the protocol was designed to separate the two endpoints when performing a 28day treatment evaluation. The clinical implications of LPF and LCF on day 28 seem to be quite different. Moreover, the more recent WHO document [24] maintains the four treatment outcomes.
In the present study, analyses were based on the observed treatment responses between day 14 and day 28 (due to the absence of ETF), and the contribution of each observed category was evaluated. Pooling randomized clinical trials raises the issue of heterogeneity between studies. However, all studies included in this analysis were based on the same population of children, within the same age range and in the same geographic area. These studies had the same design and were run by the same investigators and field workers over the years. Mixed treatment comparison (MTC) metaanalysis faces several limits leading to the possibility of biased estimates. Comparing treatment arms using indirect comparisons apparently exposes to the loss of the benefits of randomization. However, it is partially preserved using adjusted comparisons with possibly less biased differences towards positive results, according to Song et al.[25]. A study random effect was not considered in the models as the number of studies was too small. None of the study fixed effects was significant, but including them in the model allowed for a correlation between the treatment arms within a single study, which kept part of the randomisation process. Missing responses represent a frequent issue in antimalarials trials, usually carried out in field conditions. The absence of a patient during a scheduled visit could be due either to an earlier treatment failure leading to another treatment, which could be considered as missing at random (MAR), according to Rubin [26], or a lost to followup considered as missing completely at random (MCAR) or an exclusion due to some protocol violation, considered as missing not at random (MNAR). In order to explore the internal validity of our results, a sensitivity analysis was carried out in which missing responses were imputed according to different scenarii, including the worst scenario where missing responses were imputed as failures. None of the evaluations carried out before day 14 (i.e. days 1, 2, 3, and 7) was considered because early treatment failure (ETF, for days 1 to 3) and late failure between day 7 and day 13 were not observed. In addition the whole purpose for WHO to extend the follow up beyond day 14 up to day 28 was to study the long term efficacy of antimalarial drugs following an acute episode. Each of the 3 categories ACPR, LCF, LPF on days 14, 21 and 28, according to the 2003 WHO protocol, was observed. On the observed data, one subject cannot be LPF or LCF without being ACPR at least on day 14. When the outcome of a subject is classified as LPF or LCF, the next outcome is missing since the evaluation of drug efficacy is terminated for that particular patient and an alternative treatment is necessary because of ethical consideration. Therefore, outcomes are not strictly speaking repeated. Modeling repeated observations over time can been achieved either using a conditional model, where the outcome at time t is modelled according to the previous outcomes, or using a marginal model, where the individual outcomes are modelled in relation to a mean outcome at each time point, the time dependency reflecting this memory effect acting on the categorical response. As the main objective of the present work was to pool the results of different multi arm trials, the latter approach was adopted, which could be directly related to recent advances in metaanalysis developments [27]. Analyses with incomplete (PP) and complete outcomes (imputation approach) were performed by imputing missing outcomes on days 14, 21 and 28. The results were then compared to check for biases (Table 5). The results remained similar in all approaches. It is now common in antimalarial drug trials to distinguish between new infections and recrudescence by PCR, although, from the pragmatic point of view, one might expect that an optimal treatment of an acute episode would protect the patients from new infection in the weeks following the episode, in areas without a large variability in parasite phenotype. In case of unevenly distributed missing categories at different times and/or treatment arms, difficulties in adjusting the proposed models could occur. The main difficulty was related either to a too small number or an absence of failure categories over time after PCR correction. This could be considered as extreme category outcomes, for which the clog log link can be more adapted than the logit link in the fitting process. When the missing responses were imputed as previously described except for the cases of PCRdetected new infections where the missing observations were imputed ACPR, the analyses using the Gibbs sampler failed to converge.
From the clinical standpoint, it is worth noting that the present data set concerned the use of highly efficacious antimalarial combination drugs, thus explaining the absence of the ETF category. AMLM is already an alternative to ASAQ in Cameroon. Both ASAQ and AMLM treatments are recommended by the WHO, based on several published trials, comparing different subsets of the treatments listed in the present analysis [28â€“38]. The results of the present analysis complete the previous metaanalysis based on a binary outcome at a fixed time point, where it was concluded that AMLM appeared to be the most effective drug with no treatment failure due to recrudescence, closely followed by DHPP. However, the previous analysis did not take into account the individual repeated measurements.
DHPP showed a higher efficacy as compared to the reference treatment ASAQ in all tested models, whereas ASCD appeared less efficacious than ASAQ. AMLM did not differ significantly in efficacy from ASAQ. It should be remembered that the present analysis discarded study #2, as it was unconnected to others, increasing the power for comparison between the remaining treatment arms. The final result is in agreement with the metaanalysis conducted by Sinclair et al.[39], which was based on the binary outcome on Day 28. In that study, both DHPP and ASMQ appeared more efficacious than AMLM. ASMQ, which is not recommended by the WHO in Africa at present, although it is the firstline treatment in Southeast Asia, was not connected to the other treatment arms in the analysed network of randomised trials, and could only be compared to AQSP, showing a significantly higher efficacy. Treatment failure may have several origins including individual pharmacokinetic and pharmacodynamic variations and intensity of transmission. For instance, as CD has a shorter halflife than the other drugs, new infections could occur more easily than with other drugs, which explains why in a non PCRcorrected data analysis ASCD appears less effective. While a 100% full success rate (ACPR) represents the optimal target when treating acute malaria, it is worth noting that incorporating the information about the other intermediary states and the absence of parasitaemia appear to be of importance, at least from the public health standpoint to limit the burden of circulating parasites. Taking into account these intermediary outcomes could more adequately participate in the evaluation of different public health policies for malaria control in parallel to other validated interventions, such as the distribution of insecticideimpregnated bednets, environmental drainage and other mosquito control measures.
Abbreviations
 ACT:

Artemisininbased combination therapy
 AMLM:

Artemether  lumefantrine
 ASAQ:

Artesunate  amodiaquine
 ASCD:

Artesunate  chlorproguanil  dapsone
 ASSP:

Artesunatesulphadoxinepyrimethamine
 DHPP:

Dihydroartemisinin  piperaquine
 ASMQ:

Artesunate  mefloquine
 AQSP:

Amodiaquine  sulphadoxine  pyrimethamine
 PP:

Per protocol
 WHO:

World Health Organization.
References
WHO: World malaria report 2008. 2008,http://www.who/int/malaria/wmr2008/MAL2008SumKeyEN.pdf,
Dondorp A, Yeung S, White L, Nguon C, Day N, Socheat D, von Seidlein L: Artemisinin resistance: current status and scenarios for containment. Nat Rev Microbiol. 2010, 8: 272280.
WHO: Assessment and monitoring of antimalarial drug efficacy for the treatment of uncomplicated falciparum malaria Geneva: World Health Organization. Tech rep. 2003
Agresti A: Categorical Data Analysis, (2nd edn). 2002, New Jersey: Wiley
Whegang S, Tahar R, Foumane VN, Soula G, GwÃ¨t H, Thalabard J, Basco L: Efficacy of nonartemisinin and artemisininbased combination therapies for uncomplicated falciparum malaria in Cameroon. Malar J. 2010, 9: 5610.1186/14752875956.
Whegang S, Basco L, GwÃ¨t H, Thalabard J: Analysis of an ordinal outcome in a multicentric randomized controlled trial: application to a 3 arm anti malarial drug trial in Cameroon. BMC Med Res Methodol. 2010, 10: 5810.1186/147122881058.
Hasselblad V: Metaanalysis of multitreatment studies. Med Decis Making. 1998, 18: 3743. 10.1177/0272989X9801800110.
Ades A: A chain of evidence with mixed comparisons: models for multiparameter synthesis and consistency of evidence. Stat Med. 2003, 22: 29953016. 10.1002/sim.1566.
Lu G, Ades A, Sutton A, Cooper NJ, Briggs AH, Caldwell DM: Metaanalysis of mixed treatment comparisons at multiple followup times. Stat Med. 2007, 26: 36813699. 10.1002/sim.2831.
Jansen J, Crawford B, Bergman G, Stam W: Bayesian metaanalysis of multiple treatment comparisons: an introduction to mixed treatment comparisons. Value Health. 2008, 11: 956964. 10.1111/j.15244733.2008.00347.x.
Lu G, Ades A: Combination of direct and indirect evidence in mixed treatment comparisons. Stat Med. 2004, 23: 31053124. 10.1002/sim.1875.
Glenny A, Altman DG, Song F, Sakarovitch C, Deeks JJ, Dâ€™Amico R, Bradburn M, Eastwood AJ, Group ISTC: Indirect comparisons of competing interventions. Health Technol Assess. 2005, 9: 1134.
Jansen J: Selfmonitoring of glucose in type 2 diabetes mellitus: a Bayesian metaanalysis of direct and indirect comparisons. Curr Med Res Opin. 2006, 22: 671681. 10.1185/030079906X96308.
Griffin S, Bojke L, Main C, Palmer S: Incorporating direct and indirect evidence using bayesian methods: an applied case study in ovarian cancer. Value Health. 2006, 9: 123131. 10.1111/j.15244733.2006.00090.x.
Caldwell D, Ades AE, Higgins JPT: Simultaneous comparison of multiple treatments: combining direct and indirect evidence. BMJ. 2005, 331: 897900. 10.1136/bmj.331.7521.897.
WHO: Susceptibility of Plasmodium falciparum to antimalarial drugs. Report on global monitoring 19962004. Tech rep. 2005
McCullagh P: Regression models for ordinal data. J R Statist Soc. 1980, 42: 109142.
Zwang J, Olliaro P, Barennes H, Bonnet M, Brasseur P: Efficacy of artesunateamodiaquine for treating uncomplicated falciparum malaria in subSaharan Africa: a multicentre analysis. Malar J. 2009, 8: 20310.1186/147528758203.
Foulley J, Jaffrezic F: Modelling and estimating heterogeneous variances in threshold models for ordinal discrete data via Winbugs/Openbugs. Comput Methods Programs Biomed. 2010, 24: 1927.
Lunn D, Thomas A, Best N, Spiegelhalter D: WinBUGS a Bayesian modelling framework: concepts, structure, and extensibility. Stat Comput. 2000, 10: 325337. 10.1023/A:1008929526011.
Spiegelhalter D, Best N, Carlin B, van der Linde A: Bayesian measures of model complexity and fit (with discussion). J R Stat Soc B. 2002, 64: 583640. 10.1111/14679868.00353.
Jansen F, Lesaffre E, Penali L, GarciaZattera M, DieKakou H, Bissagnene E: Assessment of the relative advantage of various artesunatebased combination therapies by a multitreatment Bayesian randomeffects metaanalysis. Am J Trop Med Hyg. 2007, 27: 17031717.
Dakin HA, JWelton N, Ades AE, Collins S, Ormec M, Kelly S: Mixed treatment comparison of repeated measurements of a continuous endpoint: an example using topical treatments for primary openangle glaucoma and ocular hypertension. Stat Med. 2011, 20: 25112535.
WHO: Rapport 2009 sur le paludisme dans le monde. Tech rep. 2009
Song F, Harvey I, Lilford R: Adjusted indirect comparison may be less biased than direct comparison for evaluating new pharmaceutical interventions. J Clin Epidemiol. 2008, 61: 455463. 10.1016/j.jclinepi.2007.06.006.
Rubin D: Inference and missing data. Biometrika. 1976, 5: 581592.
Liu Y, Agresti A: The analysis of ordered categorical data: an overview and a survey of recent developments. Societas de Estadistica e Investigacion Operativa. 2005, 24: 173.
Hutagalung R, Paiphun L, Ashley E, McGready R, Brockman A, Thwai K, Singhasivanon P, Jelinek T, White N, Nosten F: A randomized trial of artemetherlumefantrine versus mefloquineartesunate for the treatment of uncomplicated multidrug resistant Plasmodium falciparum on the western border of Thailand. Malar J. 2005, 4: 4610.1186/14752875446.
Meremikwu M, Alaribe A, Ejemot R, OyoIta A, Ekenjoku J, Nwachukwu C, Ordu D, Ezedinachi E: Artemetherlumefantrine versus artesunate plus amodiaquine for treating uncomplicated childhood malaria in Nigeria: randomized controlled trial. Malar J. 2006, 5: 4310.1186/14752875543.
Guthmann J, Cohuet S, Rigutto C, Fortes F, Saraiva N, Kiguli J, Kyomuhendo J, Francis M, Noel F, Mulemba M, Balkan S: High efficacy of two artemisininbased combinations (artesunate + amodiaquine and artemether + lumefantrine) in Caala, Central Angola. Am J Trop Med Hyg. 2006, 75: 143145.
Smithuis F, Kyaw MK, Phe O, Aye K, Htet L, Barends M, Lindegardh N, Singtoroj T, Ashley E, Lwin S, Stepniewska K, White N: Efficacy and effectiveness of dihydroartemisininpiperaquine versus artesunatemefloquine in falciparum malaria: an openlabel randomised comparison. Lancet. 2006, 367: 20752085. 10.1016/S01406736(06)689319.
Hasugian A, Purba H, Kenangalem E, Wuwung RM, Ebsworth EP, Penttinen PMP, Laihad F, Anstey NM, Tjitra E, Price RN, Maristela, R: Dihydroartemisininpiperaquine versus artesunateamodiaquine: superior efficacy and posttreatment prophylaxis against multidrugresistant Plasmodium falciparum and Plasmodium vivax malaria. Clin Infect Dis. 2007, 44: 10671074. 10.1086/512677.
Yeka A, Dorsey G, Kamya M, Talisuna A, Lugemwa M, Rwakimari J, Rosenthal P, WabwireMangen F, Bukirwa H, Staedke, S: Artemetherlumefantrine versus dihydroartemisininpiperaquine for treating uncomplicated malaria: a randomized trial to guide policy in Uganda. PLoS One. 2008, 3: e239010.1371/journal.pone.0002390.
Sagara I, Diallo A, Kone M, Coulibaly M, Diawara S, Guindo O, Maiga H, Niambele M, Sissoko M, Dicko A, Djimde A, Doumbo O: A randomized trial of artesunatemefloquine versus artemetherlumefantrine for treatment of uncomplicated Plasmodium falciparum malaria in Mali. Am J Trop Med Hyg. 2008, 79: 655661.
Mens P, Sawa P, van Amsterdam S, Versteeg I, Omar S, Schallig H, Kager P: A randomized trial to monitor the efficacy and effectiveness by QTNASBA of artemetherlumefantrine versus dihydroartemisininpiperaquine for treatment and transmission control of uncomplicated Plasmodium falciparum malaria in western Kenya. Malar J. 2008, 7: 23710.1186/147528757237.
Arinaitwe E, Sandison TG, Wanzira H, Kakuru A, Homsy J, Kalamya J, Vora N, Greenhouse B, Rosenthal PJ, Tappero J, Dorsey G, Kamya, M R: Artemetherlumefantrine versus dihydroartemisininpiperaquine for falciparum malaria: a longitudinal, randomized trial in young Ugandan children. Clin Infect Dis. 2009, 49: 16291637. 10.1086/647946.
Kayentao K, Maiga H, Newman R, McMorrow M, Hoppe A, Yattara O, Traore H, Kone Y, Guirou E, Saye R, Traore B, Djimde A, Doumbo O: Artemisininbased combinations versus amodiaquine plus sulphadoxinepyrimethamine for the treatment of uncomplicated malaria in Faladje, Mali. Malar J. 2009, 8: 510.1186/1475287585.
Faye B, Ndiaye J, Tine R, Sylla K, Gueye A, Colle A, Gaye O: A randomized trial of artesunate mefloquine versus artemether lumefantrine for the treatment of uncomplicated Plasmodium falciparum malaria in Senegalese children. Am J Trop Med Hyg. 2010, 82: 140144. 10.4269/ajtmh.2010.090265.
Sinclair D, Zani B, Donegan S, Olliaro P, Garner P: Artemisininbased combination therapy for treating uncomplicated malaria. Cochrane Database Syst Rev. 2009, 3: 1270.
Acknowledgements
We thank all the health workers of the Nlongkak Catholic missionary dispensary where the clinical trials were conducted. The clinical studies were supported by the French Ministry of Research (Programme PAL+), European Union (INCODEV contract no. ICA4CT2001 10078 and STREP contract no. 018602), and French Agence Nationale de la Recherche (RESATQ project, ANR08MIE024). We would also like to thank JeanLouis Foulley (INRA, Jouy en Josas, France) for his advices, suggestions contributions and support. The first author was supported by the IRD doctoral grant.
Author information
Authors and Affiliations
Corresponding author
Additional information
Competing interests
The authors declare that they have no competing interests.
Authorsâ€™ contributions
SWY developed the analysis plan and carried out both the statistical analyses and software implementations under the close supervision of AS and JCT. She also drafted the manuscript. LKB was responsible for the overall data collection and supervision of clinical trials. All authors read and approved the final manuscript.
Authorsâ€™ original submitted files for images
Below are the links to the authorsâ€™ original submitted files for images.
Rights and permissions
Open Access This article is published under license to BioMed Central Ltd. This is an Open Access article is distributed under the terms of the Creative Commons Attribution License ( https://creativecommons.org/licenses/by/2.0 ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
About this article
Cite this article
Youdom, S.W., Samson, A., Basco, L.K. et al. Multiple treatment comparisons in a series of antimalarial trials with an ordinal primary outcome and repeated treatment evaluations. Malar J 11, 147 (2012). https://doi.org/10.1186/1475287511147
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/1475287511147