Assessment of severe malaria in a multicenter, phase III, RTS, S/AS01 malaria candidate vaccine trial: case definition, standardization of data collection and patient care
- Johan Vekemans1Email author,
- Kevin Marsh2,
- Brian Greenwood3,
- Amanda Leach1,
- William Kabore4,
- Solange Soulanoudjingar5,
- Kwaku Poku Asante6,
- Daniel Ansong7,
- Jennifer Evans8,
- Jahit Sacarlal9,
- Philip Bejon2,
- Portia Kamthunzi10,
- Nahya Salim11,
- Patricia Njuguna2,
- Mary J Hamel12,
- Walter Otieno12,
- Samwel Gesase13,
- David Schellenberg2, 14 and
- the Clinical Trials Partnership Committee
© Vekemans et al; licensee BioMed Central Ltd. 2011
Received: 3 March 2011
Accepted: 4 August 2011
Published: 4 August 2011
An effective malaria vaccine, deployed in conjunction with other malaria interventions, is likely to substantially reduce the malaria burden. Efficacy against severe malaria will be a key driver for decisions on implementation. An initial study of an RTS, S vaccine candidate showed promising efficacy against severe malaria in children in Mozambique. Further evidence of its protective efficacy will be gained in a pivotal, multi-centre, phase III study. This paper describes the case definitions of severe malaria used in this study and the programme for standardized assessment of severe malaria according to the case definition.
Case definitions of severe malaria were developed from a literature review and a consensus meeting of expert consultants and the RTS, S Clinical Trial Partnership Committee, in collaboration with the World Health Organization and the Malaria Clinical Trials Alliance. The same groups, with input from an Independent Data Monitoring Committee, developed and implemented a programme for standardized data collection.
The case definitions developed reflect the typical presentations of severe malaria in African hospitals. Markers of disease severity were chosen on the basis of their association with poor outcome, occurrence in a significant proportion of cases and on an ability to standardize their measurement across research centres. For the primary case definition, one or more clinical and/or laboratory markers of disease severity have to be present, four major co-morbidities (pneumonia, meningitis, bacteraemia or gastroenteritis with severe dehydration) are excluded, and a Plasmodium falciparum parasite density threshold is introduced, in order to maximize the specificity of the case definition. Secondary case definitions allow inclusion of co-morbidities and/or allow for the presence of parasitaemia at any density. The programmatic implementation of standardized case assessment included a clinical algorithm for evaluating seriously sick children, improvements to care delivery and a robust training and evaluation programme for clinicians.
The case definition developed for the pivotal phase III RTS, S vaccine study is consistent with WHO recommendations, is locally applicable and appropriately balances sensitivity and specificity in the diagnosis of severe malaria. Processes set up to standardize severe malaria data collection will allow robust assessment of the efficacy of the RTS, S vaccine against severe malaria, strengthen local capacity and benefit patient care for subjects in the trial.
Malaria remains a considerable burden despite progress in implementation of malaria control policies. It is estimated that malaria causes 709,000 deaths every year in Africa; 85% in children less than five years of age . Used in conjunction with existing interventions such as indoor residual insecticidal spraying, long-lasting insecticide-impregnated bed nets, intermittent preventive anti-malarial therapy in pregnancy, and prompt treatment with an effective anti-malarial, an effective malaria vaccine for young children in Africa has the potential to reduce the burden of the disease substantially.
The malaria vaccine at the most advanced stage of development is RTS, S, a pre-erythrocytic vaccine candidate containing Plasmodium falciparum circumsporozoite surface antigen. This vaccine is formulated with new proprietary Adjuvant Systems - AS01 or AS02 . Earlier studies have demonstrated the potential of RTS, S/AS02 [3, 4] and RTS, S/AS01 to provide partial protection against uncomplicated malaria . In addition to prevention of uncomplicated malaria, one of the main aims of malaria vaccines is to prevent severe malaria. Although severe malaria can present in many different ways, typical symptoms in young children include severe anaemia, respiratory distress, hypoglycaemia, repeated seizures, acidosis, prostration and fever . Severe malaria is most commonly caused by P. falciparum, and in areas of stable endemicity is mainly a disease of children under five years of age .
Efficacy against severe malaria is a key factor that will determine evidence-based decisions on the implementation of new malaria control tools [7, 8]. Evidence from phase II RTS, S trials showed the vaccine can provide protection against severe disease. In the proof-of-concept study conducted in Mozambique, the RTS, S/AS02 vaccine prevented 49% (95% CI 12-71) of severe malaria episodes during 18 months of follow-up . In a study in Kenya and Tanzania, out of 809 children, half of whom had received RTS, S/AS01, one case of severe malaria was reported in the experimental malaria vaccine group as compared with eight in the control group, over an eight months follow-up period . These encouraging results need confirmation in a larger phase III multicentre study with a robust and standardized assessment of cases of severe malaria.
Previous multi-centre studies on severe malaria have demonstrated that standardized assessment of cases is challenging . Success depends on the use of common case definitions, standardized investigation of patients and the quality of diagnosis and care. Accurate diagnosis of severe malaria can be difficult because of the diversity in presentation and because its symptoms overlap with those of many common febrile childhood illnesses including pneumonia, meningitis and sepsis [10–12]. For example, an autopsy study of 31 children diagnosed with cerebral malaria in Malawi showed that 23% had died from other causes .
The current, internationally accepted definition of severe malaria in children is based on the need for prompt treatment of children with a medical history and clinical presentation compatible with severe malaria, given the high complication and fatality rate of this condition [6, 14]. In clinical practice, the threshold for initiation of anti-malaria treatment needs to be low, and is sometimes based on syndromic assessment only rather than on investigation-supported diagnosis. In these circumstances, a highly sensitive but non-specific case definition is appropriate to determine treatment. However, use of a sensitive but non-specific case definition as a trial endpoint would be expected to result in an underestimation of vaccine efficacy . Conversely, by using a highly specific but poorly sensitive case definition, a large sample size will be required to provide a sufficient number of cases. An ideal case definition for the purpose of a clinical trial thus needs to combine a level of specificity that provides an accurate estimate of vaccine efficacy with a level of sensitivity that optimizes the power of the study [16, 17]. A World Health Organization (WHO) expert study group has developed recommendations on appropriate criteria for severe malaria case definitions for use as a vaccine trial endpoint .
The results of phase II studies led to a decision to employ the RTS, S/AS01 vaccine formulation for the pivotal phase III trial. The objectives and design of the phase III RTS, S/AS01 study are described in a companion paper . This paper provides a detailed description of the case definitions of severe malaria used for the trial, the work undertaken to ensure standardized assessment of severe malaria across different study centers and the efforts made to ensure optimal patient care.
Severe malaria endpoint case definitions for evaluation in the RTS, S/AS01 Phase III trial
The case definitions of severe malaria were developed prospectively through a literature review and consensus meeting of the Clinical Trial Partnership Committee (CTPC) severe malaria working group and expert consultants, in collaboration with representatives of the WHO and the Malaria Clinical Trials Alliance (MCTA). The CTPC includes representatives of all the research centres collaborating on the RTS, S clinical development programme, GlaxoSmithKline and the Malaria Vaccine Initiative.
The main objective of this discussion was the development of a primary case definition which balanced sensitivity and specificity, reflecting true paediatric malaria cases at risk of an adverse outcome, usually needing hospital admission, taking into account the fact that symptoms often overlap with other diseases, and that other co-morbidities can be present.
A retrospective study of 1,361 children admitted to a Kenyan District hospital and 4,583 community controls showed how the specificity of a case definition for severe malaria varied depending upon the intensity of transmission, the parasite density threshold applied, the markers of severity that were included and upon how co-morbidities were dealt with during analysis. Among children under two years old who presented with symptoms compatible with severe malaria, logistic regression models showed that the malaria-attributable fraction of these cases was only 85%. This increased to 89% when children with identified co-morbidities (similar to those proposed here) were excluded and to 95% when a threshold of 2500 parasites/μL was also applied .
Case definitions of severe malaria
Secondary definition 1
Secondary definition 2
Secondary definition 3
P. falciparum asexual parasitaemia >5,000 parasites/μL
One or more markers of disease severity
P. falciparum asexual parasitaemia >5,000 parasites/μL
One or more markers of disease severity
P. falciparum asexual parasitaemia >0 parasites/μL
One or more markers of disease severity
P. falciparum asexual parasitaemia >5,000 parasites/μL
One or more markers of disease severity
No HIV infection
Markers of disease severity included in the severe malaria case definition
Marker of severity
• Inability to perform a previously-acquired motor function:
- Inability to stand in a child previously able to do so
- Inability to sit in a child previously able to do so
- Inability to suck in a very young child
Blantyre score ≤2
• Conscious level scored (0-5) using the Blantyre coma scale . Determined by adding the scores for:
- Best motor response (scored 0-2)
- Best verbal response (scored 0-2)
- Eye movement (scored 0-1)
Seizures, 2 or more
• Number of seizures occurring in the total time period including 24 h before admission, the emergency room and hospitalization
• Lower chest wall in-drawing or abnormally deep breathing
• Blood glucose <2.2 mmol/L
• Base excess ≤-10.0 mmol/L
• Lactate ≥5.0 mmol/L
• Haemoglobin <5.0 g/dL
Markers of disease severity (Table 2)
Many studies have investigated the value of various clinical and laboratory markers as prognostic indicators of mortality and sequelae in malaria. In 1995, Marsh and colleagues showed that impaired consciousness, respiratory distress and severe anaemia were three central markers of disease severity associated with adverse outcome, especially when present together . More recently, a two-year observational study of children in Gabon with P. falciparum malaria showed that coma, seizures, lactic acidaemia, respiratory distress and hypoglycaemia were independent predictors of death . The highest fatality rate occurred in children with a combination of coma/seizures, lactic acidaemia and hypoglycaemia. A recent study of children in Mali showed that hypoglycaemia, respiratory distress and deep coma are independent predictors of death .
Neurological impairments: prostration, Blantyre coma score, repeated seizures
Neurological impairment is a frequent marker of disease severity, and can result in long-term neurological sequelae . In a retrospective study of patient records collected from 1992 to 2004 in a district hospital in Kenya, neurological involvement was detected in nearly half of 19,560 children with malaria . The most common manifestations were seizures (37.5%), prostration (20.6%) and impaired consciousness or coma (13.2%). Numerous studies have demonstrated that coma/impaired consciousness and seizures are independently associated with mortality in African children with malaria [19–21, 24–26]. In this phase III study, prostration, Blantyre coma score <2 and repeated seizures have been selected as markers of neurological impairment for the severe malaria case definition.
Respiratory distress: deep breathing, lower chest wall in-drawing
Respiratory distress is also an important predictor of mortality in severe malaria [18–21, 25, 28–30]. Two specific markers of respiratory distress have been shown to be associated with an adverse outcome in malaria and are, therefore, included in the definition of severe malaria: abnormally deep breathing and lower chest wall in-drawing. Abnormally deep breathing is defined as deep or laboured respiration (acidotic or Kussmaul respiration) with increased inspiratory excursion and expiratory incursion of the chest. The respiratory rate may or may not be increased. Deep breathing is indicative of metabolic acidosis and associated with an increased risk of mortality in children with malaria [6, 18, 30]. The second marker of respiratory distress, lower chest wall in-drawing, is defined as the inward movement of the bony structure of the lower chest wall with inspiration. Chest wall in-drawing was independently associated with death in a study of 2400 malaria cases in Tanzania . Other respiratory distress markers, such as nasal flaring or visible inward movement of intercostal tissues (intercostal recession), have not independently been shown to be associated with an adverse outcome in malaria .
Metabolic complications; hypoglycaemia, acidosis, hyperlactacidaemia
Metabolic complications are common in severe malaria, particularly hypoglycaemia and acidosis . Hypoglycaemia has been identified as a key prognostic indicator of high risk of death for children with malaria [6, 18–20, 23–25, 27, 32]. The risk of cognitive impairment following hypoglycaemia in malaria has also been described . As no single clinical sign is a pathognomonic marker of hypoglycaemia, a blood measurement is required. In the phase III study, hypoglycaemia will be defined as a blood glucose concentration <2.2 mmol/L.
Acidosis, associated with lactic acidaemia and a low serum bicarbonate or base excess, has also been shown to be associated with an increased risk of mortality in patients with malaria [18, 24, 31, 33–36]. The physiopathology of acidosis in malaria is complex. Studies have suggested key roles for both direct metabolic disturbances due to the parasitic infection, and a subsequent inflammatory response, and for a low circulatory blood volume [37, 38]. The optimal cut-off points for lactic acidaemia and base excess that predict mortality have usually been around 5 mmol/L and from -8 to -12 mmol/L, respectively [32, 39, 40]. In the pivotal phase III study, acidosis will be defined by a negative base excess ≤-10.0 mmol/L or by lactic acidaemia ≥5.0 mmol/L.
Severe malaria anaemia is a frequently overlooked contributor to overall malaria mortality, especially in young children. Studies have reported case fatality rates from severe malaria anaemia varying between 5.6% and 16%, with over 50% of deaths occurring within 24 hours of admission [18, 27]. However, the exact mortality burden due to severe malarial anaemia is obscured by rapid transfusion in clinical research settings, which have enhanced case management practices that are unavailable to most children developing severe malaria anaemia [19, 27, 41]. Although anaemia is often multifactorial, the contribution of single or repeated malaria episodes is well recognized, and illustrated by the impact of malaria control measures on anaemia and by the peak in hospital admissions for severe anaemia and blood transfusion seen during the malaria season [6, 42–44]. In the trial, severe anaemia, defined as a haemoglobin concentration <5.0 g/dL, has been included as one of the criteria of severe malaria.
Markers of disease severity that were not selected for inclusion in the endpoint case definition
Markers of disease severity included in the case definition were chosen on the basis of their association with poor outcome, occurrence in a significant fraction of cases and an ability to standardize their measurement across sites. The selected markers also minimized data redundancy. For example, although circulatory collapse and delayed capillary refill time predicts mortality in children with severe malaria , it was agreed that patients with this indicator would be captured by the presence of prostration or acidosis. Markers of severity considered but not included were those that apply to only a small fraction of cases, are difficult to measure in a standardized way or are not part of accepted clinical practice or research methodology. For example, renal failure is not included as it is rarely seen in children with severe malaria . Although retinal haemorrhage has been shown to correlate well with cerebral malaria [45, 46], and is predictive of poor outcome [47, 48], the method for monitoring retinal changes  would have been difficult to implement and standardize across sites.
Exclusion from the severe malaria primary case definition upon presence of co-morbidities
While children in areas of intense malaria transmission may have P. falciparum parasitaemia and remain seemingly healthy, children admitted to hospital with P. falciparum parasitaemia often have an associated illness with symptoms which overlap with those of severe malaria [10, 11, 50, 51]. Thus, parasitaemia in a severely ill child may sometimes be coincidental and not the cause of presenting symptoms. Four major, common infections have clinical features which can overlap with those of severe malaria: pneumonia, meningitis, sepsis and gastroenteritis with severe dehydration.
Chest X-ray interpretation (WHO 2001)
Classification of quality of chest x-rays
Quality X-ray parameters
Classification of quality of chest x-rays (enter result in CRF)
• ID on the right side
• Position: clavicles and ribs symmetric on each side of the spine
• Boundaries: rib cage and costophrenics angles seen
• Inspiration: dome of the diaphragm is below the anterior tip of the 6th right rib
• Movement: heart, diaphragm, central vessels and ribs sharply defined, without blurring
• Exposure: vascular shadows can be seen in lung periphery, thoracic vertebrae and large lower lobe vessels visible through cardiac silhouette
• Contrast: background outside patient's silhouette is black. Bones and airway easily distinguished from soft tissue
• Uninterpretable: if the features of the image are not interpretable without additional images. No further reading should be made for such images
• Suboptimal: if the features allow interpretation of primary endpoint but not of other infiltrates or findings. No entries should be made for other infiltrates for such images
• Adequate: if the features allow confident interpretation of endpoint as well as other infiltrates
Classification of findings of chest x-rays
• Consolidation or pleural effusion :
▪ where consolidation is defined as a dense opacity that may be a fluffy consolidation of a portion or whole of a lobe or of the entire lung, often containing air bronchograms*
▪ where pleural effusion is defined if it occurs in the lateral pleural space (and not just in the minor or oblique fissure) and is spatially associated with a pulmonary parenchymal infiltrate (including other infiltrate) or if the effusion obliterates enough of the hemithorax to obscure an opacity
* atelectasis of an entire lobe that produces a dense opacity and a positive silhouette sign with the mediastinal border will be considered to be an endpoint consolidation
• Other infiltrate linear and patchy densities (interstitial infiltrate) in a lacy pattern involving both lungs, featuring peribronchial thickening and multiple areas of atelectasis. Lung inflation is normal to increased. It also includes minor patchy infiltrates that are not of sufficient magnitude to constitute primary end-point consolidation, and small areas of atelectasis which in children can be difficult to distinguish from consolidation.
• No consolidation, infiltrate or effusion
Criteria for diagnosis of co-morbidities to be excluded from the primary case definition of severe malaria
Criteria for co-morbidity
Radiographically proven pneumonia
• Consolidation or pleural effusion on a chest X-ray taken within 72 h of admission
Meningitis on cerebrospinal fluid examination
• White cells ≥50 × 106/L or positive culture of compatible organism or latex agglutination antigen detection test positive for Hib, pneumococci or meningococci
Sepsis (positive blood culture)
• Blood culture taken within 72 h of admission is considered positive if:
- A definite pathogen is isolated (e.g. Streptococcus pneumoniae, S agalactiae, S pyogenes, Haemophilus influenzae, Salmonella spp.)
- A bacteria that could be either a pathogen or a contaminant is isolated within 48 h of incubation (e.g. Escherichia coli, Klebsiella pneumoniae, Staphylococcus aureus, Enterococcus faecalis)
Gastroenteritis with dehydration
• A history of 3 or more loose or watery stools in previous 24 h and an observed watery stool with decreased skin turgor (>2 seconds for skin to return following skin pinch)
Reliable clinical differentiation between severe malaria and meningitis can be difficult, impaired consciousness and seizures being cardinal symptoms of both [11, 55]. Lumbar puncture is needed to confirm a diagnosis of meningitis, and to contribute to better treatment . Establishing optimal criteria that indicate the need for a lumbar puncture has been the subject of considerable debate in all settings, and should be influenced by the background epidemiology of diseases affecting the central nervous system and meninges in the study area as well as by the availability of laboratory support. In malaria-endemic countries, the threshold for undertaking lumbar puncture should be low in order to differentiate between cerebral malaria and meningitis [11, 57]. In the phase III RTS, S/AS01 trial, a lumbar puncture will be performed in the absence of contra-indications in children with an altered state of consciousness or seizures (excluding simple febrile seizures and seizures without fever in a known epileptic child). Patients with a cerebrospinal fluid (CSF) white blood cell (WBC) count ≥50 × 106/L, a positive culture of an organism known to cause meningitis, or a positive Hib, pneumococcal or meningococcal latex agglutination antigen detection test will be excluded from the primary case definition of severe malaria (Table 4) . A high CSF WBC count was selected as the threshold because cerebral malaria without meningitis can cause mild elevation of CSF WBC counts; patients with meningitis are likely to have WBC counts that are considerably higher than 50 × 106/L . This definition allows cases of cerebral malaria with only a mild increase in WBC count to be included in the primary analysis.
Bacteraemia is common, and associated with a high mortality, in children admitted to hospital in sub-Saharan Africa . Several studies have shown that invasive bacterial infections, clinically indistinguishable from severe malaria, are often under-diagnosed in malaria-endemic areas [50, 60–62]. For this reason, all children in the phase III RTS, S/AS01 trial admitted to hospital for medical reasons (excluding planned admissions and surgical conditions) will have a blood culture taken on admission. Capture of cases of sepsis will be allowed up to 72 hours after admission (Table 4). Blood culture will be considered positive if a definite pathogen is isolated (for example, Streptococcus pneumoniae, Streptococcus agalactiae, Streptococcus pyogenes, Haemophilus influenzae, Salmonella spp.) or a bacteria that could be either a pathogen or a contaminant is isolated within 48 hours of incubation (for example, Escherichia coli, Klebsiella pneumoniae, Staphylococcus aureus, Enterococcus faecalis) .
Gastroenteritis with severe dehydration
For the purposes of the trial, gastroenteritis with severe dehydration will be defined as a history of three or more loose or watery stools in the previous 24 hours and an observed watery stool with decreased skin turgor (>2 seconds for the skin to return to normal following a skin pinch) (Table 4). It was considered that this definition would allow the exclusion of cases of gastro-enteritis with dehydration severe enough to be the cause of prostration or acidosis but not cases of mild diarrhoea frequently associated with malaria. Decreased skin turgor is a key marker of severe intra-cellular dehydration, and so more typical of severe gastroenteritis than severe malaria. The exclusion of gastroenteritis cases with reduced skin turgor  will increase the specificity of the severe malaria endpoint .
Co-morbidities associated with malaria may not always be a coincidental, unrelated event. This is clearly demonstrated for invasive bacterial diseases, especially those due to Gram negative bacteria that can be a complication of severe malaria . It will be important to know whether the malaria vaccine impacts on diseases other than malaria, through an indirect effect, as suggested by a previous phase II trial of RTS, S/AS01  and by results from bed net trials . Vaccine efficacy against severe malaria defined according to secondary case definitions, where patients with co-morbidities are not excluded from the analysis, will also be measured (Table 1).
Implementation of standardized patient assessment
The standardized management algorithm will require that for all acute hospital admissions (excluding trauma and planned admission), a blood sample is taken for the evaluation of haemoglobin, glucose, lactate, base excess, parasitaemia and blood culture, and that a case report form is completed. The decision to perform a lumbar puncture or chest X-ray will be made according to specific indications for each procedure and, in addition, if the clinician judges such an investigation likely to be useful to guide management. As far as possible, procedures and evaluations will be carried out in a child-friendly, relaxed environment, in the presence of a parent. Lumbar puncture will be indicated when children present with prostration, meningism (stiff neck or bulging fontanel), reduced conscious level (abnormal Blantyre coma score), or seizure other than a simple, generalized febrile seizure defined as one associated with fever, lasting ≤ 5 minutes, followed by no neurological abnormalities other than post-ictal sleep, and occurring in a child ≥ 6 months with full recovery within 1 hour. If there are signs of raised intracranial pressure, if there is no access to the puncture point or if lumbar puncture would compromise the child's respiratory efforts, then lumbar puncture will be delayed until after the patient's condition has stabilized. A chest X-ray will be done if there is tachypnoea or respiratory distress, especially lower chest wall in-drawing or abnormally deep breathing.
Implementation of standardized patient assessment is supported by a rigorous training and accreditation programme for all clinicians involved in patient care, including regular monitoring and evaluation during the trial. An online training and accreditation resource will be available to facilitate new staff training or refresher training of accredited staff if necessary.
Provisions for optimising general patient care in the Phase III RTS, S/AS01E study
In study centres
In the field
• Paediatric care under the supervision of a qualified pediatrician
• Facilitate access to care and cover costs of care
• Clinical training and accreditation programme, with regular subsequent monitoring and evaluation
▪ Transport to hospital reimbursement
• Regular meetings of the Patient Care Forum to discuss patient care, vaccine safety, data collection, and management of specific conditions
▪ Local field workers to facilitate transportation
• Distribution of WHO Pocket Book of Hospital Care for Children
• Assure access to recommended prevention and treatment approaches:
• Improvements to care delivery that benefit the wider community
▪ Bed nets to be distributed during screening process in areas with no bed net access
• Improved infrastructure, wards refurbishment, introduction of new diagnostic techniques (microbiology, X-ray radiology)
▪ Where available, normal distribution channels encouraged through information sessions
• Hospital medical notes developed for patient follow up, extended to all admissions
▪ Exclude malaria treatments based on drugs with high resistance rates
• Address HIV/AIDS through collaboration with local HIV care delivery facilities
• Local implementation of national recommendations access to voluntary counselling and testing
• Access to highly active antiretroviral paediatric therapy at the local or regional level
• Refer patients to hospitals with more comprehensive facilities when more precise diagnostic techniques or specialized care required
The severe malaria case definitions described in this paper have been adopted for evaluation of vaccine efficacy against severe malaria at the trial analysis stage, and their use will not compromise the ability of study physicians to treat study children who present unwell with malaria, regardless of whether the criteria of standardized trial case definition are met, according to international guidelines and national recommendations. These are reviewed in one of the modules in the training and accreditation programme for investigators, covering aspects such as triage, nursing, emergency care, treatment of hypoglycaemia, convulsions, acidosis and anaemia (including precautions for blood transfusion), and use of antibiotics and anti-malarials.
The infrastructure of study centres has been improved to ensure that patients have standardized access to the assessment and diagnostic techniques needed for the study. This required patient access to care to be facilitated, wards to be refurbished and the introduction or strengthening of radiological and microbiological capacities (Table 4). These improvements to local facilities will remain beyond the trial and benefit the community at large. The clinical research know-how and infrastructures will reinforce the ability of research centres to diversify the research agenda, thereby reinforcing the sustainability of these improvements.
Severe malaria has been identified by a WHO expert study group as an important endpoint for trials of malaria vaccines . Its public health burden is sufficiently great to warrant its inclusion as a key endpoint and evidence of efficacy against severe malaria is likely to encourage implementation decisions when a vaccine becomes available. However, severe malaria is difficult to define, mainly because of the diversity in its clinical presentation and the frequent overlap of symptoms with other common illnesses. The definitions commonly used to diagnose severe malaria in clinical practice are not sufficiently specific for use in vaccine trials.
In the present study, the primary and secondary case definitions reflect the presentation of severe malaria that typically leads to hospitalization of young children in Africa. Furthermore, they are in accordance with the recommendations of the WHO , are locally applicable and appropriately balance sensitivity and specificity for the purpose of a clinical trial. A robust implementation programme ensures standardization of measurements across research centres. Furthermore, children will benefit from the diagnostic investigations introduced and the optimized clinical management of severe malaria cases. These strengthened capacities will benefit the local communities.
The following authors worked on behalf of the Clinical Trials Partnership Committee;
Kevin Marsh, Brian Greenwood, Amanda Leach, Kwaku Poku Asante, Daniel Ansong, Jennifer Evans, Jahit Sacarlal, Philip Bejon, Patricia Njuguna, Mary J Hamel and Samwel Gesase.
We hereby would like to thank the following people for their critical scientific contribution: Bernards Ogutu, Jay Berkley, Kathrin Maitland, Quique Bassat, Vasee Moorthy, Santiago Ferro, Jackie Deen, Terrie Taylor and to the members of the RTS,S Independent Data Monitoring Committee for their continuous commitment: Malcolm Molyneux (chair), Kathryn O'Brien, Juanita Hatcher, Kwodjo Koram, Zul Premji, Tom Doherty. Philip Bejon is funded by the NIHR Biomedical research Centre in Oxford. Editorial assistance and manuscript coordination were provided by Julia Donnelly, Jarno Jansen, and Sarah Benns on behalf of GlaxoSmithKline Biologicals.
Members of the CTPC during the period of protocol development (2005-2009) included:
Kintampo Health Research Centre, Ghana: Seth Owusu-Agyei, Kwaku Poku Asante;
Ifakara Health Institute, Tanzania: Salim Abdulla; Centro de Investigação em Saude de Manhiça, Mozambique: Eusebio Macete, Jahit Sacarlal; KEMRI-Wellcome Trust Research Programme, Kenya: Philip Bejon, Trudie Lang, Kevin Marsh, Patricia Njugana, Ally Olotu;
Institut de Recherche en Science de la Santé, Burkina Faso: Tinto Halidou; Albert Schweitzer Hospital, Gabon: Selidji Todagbe Agnandji, Bertrand Lell; Kumasi Centre for Collaborative Research, Ghana: Jennifer Evans; School of Medical Sciences, Kwame Nkrumah University of Science and Technology, Ghana: Tsiri Agbenyega, Daniel Ansong; KEMRI/CDC Research and Public Health Collaboration, Kenya: Mary Hamel, Simon Kariuki;
KEMRI-Walter Reed Project, Kenya: David Jones, Walter Otieno; University of North Carolina Project, Malawi: Francis Martinson; Institut de Recherche pour le Development, Senegal: Cheikh Sadibou-Sokhna, Jean-François Trape; National Institute of Medical Research, Tanzania: Samwel Gesase, Martha Lemenge, John Lusingu; Prince Leopold Institute of Tropical Medicine, Belgium: Umberto D'Allessandro; University of Tübingen, Germany: Peter Kremsner, University of Barcelona, Spain: John Aponte; Swiss Tropical Institute, Switzerland: Marcel Tanner; London School of Hygiene and Tropical Medicine, UK: Brian Greenwood, Lorenz von-Seidlein; Centers for Disease Control and Prevention, USA: Laurence Slutsker; University of North Carolina at Chapel Hill, USA: Irving Hoffman;
GlaxoSmithKline Biologicals, Belgium: W. Ripley Ballou, Alice Grasset, Didier Lapierre, Amanda Leach, Johan Vekemans, Laurence Vigneron, Anne Walsh; PATH Malaria Vaccine Initiative, USA: Alan Brooks, Filip Dubovsky, Santiago Ferro Carol Hooks, Christian Loucq, Melinda Moree, John McNeil, Carolyn Petersen, David Poland, Patricia Atkinson, Barbara Savarese, Marla Sillman, Tonya Villafana
Disclaimer: Views expressed in this paper represent those of the authors and do not necessarily reflect those of the US Centers for Disease Control and Prevention
- WHO: World malaria report 2009. 2009, World Health Organization (WHO), ISBN 978 92 4 156390 1
- Garçon N, Chomez P, Van Mechelen M: GlaxoSmithKline Adjuvant Systems in vaccines: concepts, achievements and perspectives. Expert Rev Vaccines. 2007, 6: 723-739. 10.1586/14760518.104.22.1683.View ArticlePubMed
- Alonso PL, Sacarlal J, Aponte JJ, Leach A, Macete E, Milman J, Mandomando I, Spiessens B, Guinovart C, Espasa M, Bassat Q, Aide P, Ofori-Anyinam O, Navia MM, Corachan S, Ceuppens M, Dubois MC, Demoitié MA, Dubovsky F, Menéndez C, Tornieporth N, Ballou WR, Thompson R, Cohen J: Efficacy of the RTS,S/AS02A vaccine against Plasmodium falciparum infection and disease in young African children: randomised controlled trial. Lancet. 2004, 364: 1411-1420. 10.1016/S0140-6736(04)17223-1.View ArticlePubMed
- Alonso PL, Sacarlal J, Aponte JJ, Leach A, Macete E, Aide P, Sigauque B, Milman J, Mandomando I, Bassat Q, Guinovart C, Espasa M, Corachan S, Lievens M, Navia MM, Dubois MC, Menendez C, Dubovsky F, Cohen J, Thompson R, Ballou WR: Duration of protection with RTS,S/AS02A malaria vaccine in prevention of Plasmodium falciparum disease in Mozambican children: single-blind extended follow-up of a randomised controlled trial. Lancet. 2005, 366: 2012-2018. 10.1016/S0140-6736(05)67669-6.View ArticlePubMed
- Bejon P, Lusingu J, Olotu A, Leach A, Lievens M, Vekemans J, Mshamu S, Lang T, Gould J, Dubois MC, Demoitié MA, Stallaert JF, Vansadia P, Carter T, Njuguna P, Awuondo KO, Malabeja A, Abdul O, Gesase S, Mturi N, Drakeley CJ, Savarese B, Villafana T, Ballou WR, Cohen J, Riley EM, Lemnge MM, Marsh K, von Seidlein L: Efficacy of RTS, S/AS01 vaccine against malaria in children 5 to 17 months of age. N Engl J Med. 2008, 359: 2521-2532. 10.1056/NEJMoa0807381.PubMed CentralView ArticlePubMed
- World Health Organization: Severe falciparum malaria. Trans R Soc Trop Med Hyg. 2000, 94 (Suppl 1): S1-S90.View Article
- Malaria Vaccine Technology Roadmap. Executive summary. 2006, [http://www.malariavaccineroadmap.net/pdfs/Malaria_Vaccine_TRM_Exec_Summary_Final.pdf]
- Moorthy V, Reed Z, Smith PG, WHO Study Group on Measures of Malaria Vaccine Efficacy: Measurement of malaria vaccine efficacy in phase III trials: report of a WHO consultation. Vaccine. 2007, 25: 5115-5123. 10.1016/j.vaccine.2007.01.085.View ArticlePubMed
- Taylor T, Olola C, Valim C, Agbenyega T, Kremsner P, Krishna S, Kwiatkowski D, Newton C, Missinou M, Pinder M, Wypij D: Standardized data collection for multi-centre clinical studies of severe malaria in African children: establishing the SMAC network. Trans R Soc Trop Med Hyg. 2006, 100: 615-622. 10.1016/j.trstmh.2005.09.021.PubMed CentralView ArticlePubMed
- O'Dempsey TJ, McArdle TF, Laurence BE, Lamont AC, Todd JE, Greenwood BM: Overlap in the clinical features of pneumonia and malaria in African children. Trans R Soc Trop Med Hyg. 1993, 87: 662-665. 10.1016/0035-9203(93)90279-Y.View ArticlePubMed
- Berkley JA, Versteeg AC, Mwangi I, Lowe BS, Newton CR: Indicators of acute bacterial meningitis in children at a rural Kenyan district hospital. Pediatrics. 2004, 114: e713-719. 10.1542/peds.2004-0007.View ArticlePubMed
- Mulholland K: Commentary: comorbidity as a factor in child health and child survival in developing countries. Int J Epidemiol. 2005, 34 (2): 375-7. 10.1093/ije/dyi028.View ArticlePubMed
- Taylor TE, Fu WJ, Carr RA, Whitten RO, Mueller JS, Fosiko NG, Lewallen S, Liomba NG, Molyneux ME: Differentiating the pathologies of cerebral malaria by postmortem parasite counts. Nat Med. 2004, 10: 143-145. 10.1038/nm986.View ArticlePubMed
- Bejon P, Berkley JA, Mwangi T, Ogada E, Mwangi I, Maitland K, Williams T, Scott JA, English M, Lowe BS, Peshu N, Newton CR, Marsh K: Defining childhood severe falciparum malaria for intervention studies. PLoS Med. 2007, 4: e251-10.1371/journal.pmed.0040251.PubMed CentralView ArticlePubMed
- Rogers WO, Atuguba F, Oduro AR, Hodgson A, Koram KA: Clinical case definitions and malaria vaccine efficacy. J Infect Dis. 2006, 193: 467-473. 10.1086/499314.View ArticlePubMed
- Alonso PL, Aponte JJ: Field Trials. Methods in Molecular Medicine. Edited by: Doolan DL. 2002, Malaria Methods and Protocols, Totowa, NJ: Humana Press Inc, 72: 607-616.
- Anstey NM, Price RN: Improving case definitions for severe malaria. PLoS Med. 2007, 4: e267-10.1371/journal.pmed.0040267.PubMed CentralView ArticlePubMed
- Leach A, Vekemans J, Lievens M, Ofori-Anyinam O, Cahill C, Owusu-Agyei S, Abdulla S, Macete E, Njugana P, Savarese B, Loucq C, Ballou WR, the Clinical Trials Partnership Committee: Design of a phase III multicenter trial to evaluate the efficacy of the RTS, S/AS01 malaria vaccine in children across diverse transmission settings in Africa. Malar J. 2011,
- Marsh K, Forster D, Waruiru C, Mwangi I, Winstanley M, Marsh V, Newton C, Winstanley P, Warn P, Peshu N, Pasvol G, Snow R: Indicators of life-threatening malaria in African children. N Engl J Med. 1995, 332: 1399-404. 10.1056/NEJM199505253322102.View ArticlePubMed
- Dzeing-Ella A, Nze Obiang PC, Tchoua R, Planche T, Mboza B, Mbounja M, Muller-Roemer U, Jarvis J, Kendjo E, Ngou-Milama E, Kremsner PG, Krishna S, Kombila M: Severe falciparum malaria in Gabonese children: clinical and laboratory features. Malar J. 2005, 4: 1-10.1186/1475-2875-4-1.PubMed CentralView ArticlePubMed
- Ranque S, Poudiougou B, Traoré A, Keita M, Oumar AA, Safeukui I, Marquet S, Cabantous S, Diakité M, Mintha D, Cissé MB, Keita MM, Dessein AJ, Doumbo OK: Life-threatening malaria in African children: a prospective study in a mesoendemic urban setting. Pediatr Infect Dis J. 2008, 27: 130-135.PubMed
- Idro R, Carter JA, Fegan G, Neville BG, Newton CR: Risk factors for persisting neurological and cognitive impairments following cerebral malaria. Arch Dis Child. 2006, 91: 142-148.PubMed CentralView ArticlePubMed
- Idro R, Ndiritu M, Ogutu B, Mithwani S, Maitland K, Berkley J, Crawley J, Fegan G, Bauni E, Peshu N, Marsh K, Neville B, Newton C: Burden, features, and outcome of neurological involvement in acute falciparum malaria in Kenyan children. JAMA. 2007, 297: 2232-2240. 10.1001/jama.297.20.2232.PubMed CentralView ArticlePubMed
- Mockenhaupt FP, Ehrhardt S, Burkhardt J, Bosomtwe SY, Laryea S, Anemana SD, Otchwemah RN, Cramer JP, Dietz E, Gellert S, Bienzle U: Manifestation and outcome of severe malaria in children in northern Ghana. Am J Trop Med Hyg. 2004, 71: 167-172.PubMed
- Waller D, Krishna S, Crawley J, Miller K, Nosten F, Chapman D, ter Kuile FO, Craddock C, Berry C, Holloway PA, Brewster D, Greenwood BM, White NJ: Clinical features and outcome of severe malaria in Gambian children. Clin Infect Dis. 1995, 21: 577-587. 10.1093/clinids/21.3.577.View ArticlePubMed
- Jaffar S, Van Hensbroek MB, Palmer A, Schneider G, Greenwood B: Predictors of a fatal outcome following childhood cerebral malaria. Am J Trop Med Hyg. 1997, 57: 20-24.PubMed
- Molyneux ME, Taylor TE, Wirima JJ, Borgstein A: Clinical features and prognostic indicators in paediatric cerebral malaria: a study of 131 comatose Malawian children. Q J Med. 1989, 71: 441-459.PubMed
- Schellenberg D, Menendez C, Kahigwa E, Font F, Galindo C, Acosta C, Schellenberg JA, Aponte JJ, Kimario J, Urassa H, Mshinda H, Tanner M, Alonso P: African children with malaria in an area of intense Plasmodium falciparum transmission: features on admission to the hospital and risk factors for death. Am J Trop Med Hyg. 1999, 61: 431-438.PubMed
- Bojang KA, Van Hensbroek MB, Palmer A, Banya WA, Jaffar S, Greenwood BM: Predictors of mortality in Gambian children with severe malaria anemia. Ann Trop Paediatr. 1997, 17: 355-359.PubMed
- Idro R, Karamagi C, Tumwine J: Immediate outcome and prognostic factors for cerebral malaria among children admitted to Mulago Hospital, Uganda. Ann Trop Paediatr. 2004, 24: 17-24. 10.1179/027249304225013240.View ArticlePubMed
- Planche T, Krishna S: Severe malaria: metabolic complications. Curr Mol Med. 2006, 6: 141-153. 10.2174/156652406776055177.View ArticlePubMed
- Krishna S, Waller DW, ter Kuile F, Kwiatkowski D, Crawley J, Craddock CF, Nosten F, Chapman D, Brewster D, Holloway PA, White NJ: Lactic acidosis and hypoglycemia in children with severe malaria: pathophysiological and prognostic significance. Trans R Soc Trop Med Hyg. 1994, 88: 67-73. 10.1016/0035-9203(94)90504-5.View ArticlePubMed
- Day NP, Phu NH, Mai NT, Chau TT, Loc PP, Chuong LV, Sinh DX, Holloway P, Hien TT, White NJ: The pathophysiologic and prognostic significance of acidosis in severe adult malaria. Crit Care Med. 2000, 28: 1833-1840. 10.1097/00003246-200006000-00025.View ArticlePubMed
- Taylor TE, Borgstein A, Molyneux ME: Acid-base status in paediatric Plasmodium falciparum malaria. QJM. 1993, 86: 99-109.PubMed
- Allen SJ, O'Donnell A, Alexander ND, Clegg JB: Severe malaria in children in Papua New Guinea. QJM. 1996, 89: 779-788. 10.1093/qjmed/89.10.779.View ArticlePubMed
- English M, Sauerwein R, Waruiru C, Mosobo M, Obiero J, Lowe B, Marsh K: Acidosis in severe childhood malaria. QJM. 1997, 90: 263-270. 10.1093/qjmed/90.4.263.View ArticlePubMed
- English M, Waruiru C, Amukoye E, Murphy S, Crawley J, Mwangi I, Peshu N, Marsh K: Deep breathing in children with severe malaria: indicator of metabolic acidosis and poor outcome. Am J Trop Med Hyg. 1996, 55: 521-524.PubMed
- Maitland K, Newton CR: Acidosis of severe falciparum malaria: heading for a shock?. Trends Parasitol. 2005, 21: 11-16. 10.1016/j.pt.2004.10.010.View ArticlePubMed
- Newton CR, Valim C, Krishna S, Wypij D, Olola C, Agbenyega T, Taylor TE: Severe Malaria in African Children Network. The prognostic value of measures of acid/base balance in pediatric falciparum malaria, compared with other clinical and laboratory parameters. Clin Infect Dis. 2005, 41: 948-957. 10.1086/432941.PubMed CentralView ArticlePubMed
- Evans JA, May J, Ansong D, Antwi S, Asafo-Adjei E, Nguah SB, Osei-Kwakye K, Akoto AO, Ofori AO, Sambian D, Sylverken J, Busch W, Timmann C, Agbenyega T, Horstmann RD: Capillary refill time as an independent prognostic indicator in severe and complicated malaria. J Pediatr. 2006, 149: 676-681. 10.1016/j.jpeds.2006.07.040.View ArticlePubMed
- Planche T, Agbenyega T, Bedu-Addo G, Ansong D, Owusu-Ofori A, Micah F, Anakwa C, Asafo-Agyei E, Hutson A, Stacpoole PW, Krishna S: A prospective comparison of malaria with other severe diseases in African children: prognosis and optimization of management. Clin Infect Dis. 2003, 37: 890-897. 10.1086/377536.View ArticlePubMed
- Menendez C, Fleming AF, Alonso PL: Malaria-related anaemia. Parasitol Today. 2000, 16: 469-476. 10.1016/S0169-4758(00)01774-9.View ArticlePubMed
- Newton CR, Warn PA, Winstanley PA, Peshu N, Snow RW, Pasvol G, Marsh K: Severe anemia in children living in a malaria endemic area of Kenya. Trop Med Int Health. 1997, 2: 165-178. 10.1046/j.1365-3156.1997.d01-238.x.View ArticlePubMed
- Casals-Pascual C, Roberts DJ: Severe malarial anemia. Curr Mol Med. 2006, 6: 155-168. 10.2174/156652406776055159.View ArticlePubMed
- White VA, Lewallen S, Beare N, Kayira K, Carr RA, Taylor TE: Correlation of retinal haemorrhages with brain haemorrhages in children dying of cerebral malaria in Malawi. Trans R Soc Trop Med Hyg. 2001, 95: 618-621. 10.1016/S0035-9203(01)90097-5.View ArticlePubMed
- Schémann JF, Doumbo O, Malvy D, Traore L, Kone A, Sidibe T, Keita M: Ocular lesions associated with malaria in children in Mali. Am J Trop Med Hyg. 2002, 67: 61-63.PubMed
- Lewallen S, Bakker H, Taylor TE, Wills BA, Courtright P, Molyneux ME: Retinal findings predictive of outcome in cerebral malaria. Trans R Soc Trop Med Hyg. 1996, 90: 144-146. 10.1016/S0035-9203(96)90116-9.View ArticlePubMed
- Beare NA, Southern C, Chalira C, Taylor TE, Molyneux ME, Harding SP: Prognostic significance and course of retinopathy in children with severe malaria. Arch Ophthalmol. 2004, 122: 1141-1147. 10.1001/archopht.122.8.1141.View ArticlePubMed
- Harding SP, Lewallen S, Beare NA, Smith A, Taylor TE, Molyneux ME: Classifying and grading retinal signs in severe malaria. Trop Doct. 2006, 36 (Suppl 1): 1-13.View ArticlePubMed
- Mulholland EK, Adegbola RA: Bacterial infections--a major cause of death among children in Africa. N Engl J Med. 2005, 352: 75-77. 10.1056/NEJMe048306.View ArticlePubMed
- Gwer S, Newton CR, Berkley JA: Over-diagnosis and co-morbidity of severe malaria in African children: a guide for clinicians. Am J Trop Med Hyg. 2007, 77 (Suppl 6): 6-13.PubMed CentralPubMed
- Redd SC, Bloland PB, Kazembe PN, Patrick E, Tembenu R, Campbell CC: Usefulness of clinical case-definitions in guiding therapy for African children with malaria or pneumonia. Lancet. 1992, 340: 1140-1143. 10.1016/0140-6736(92)93160-O.View ArticlePubMed
- English M, Punt J, Mwangi I, McHugh K, Marsh K: Clinical overlap between malaria and severe pneumonia in Africa children in hospital. Trans R Soc Trop Med Hyg. 1996, 90: 658-662. 10.1016/S0035-9203(96)90423-X.View ArticlePubMed
- WHO: Standardization of interpretation of chest radiographs for the diagnosis of pneumonia in children. 2001, World Health Organization, Geneva, [http://www.who.int/vaccine_research/documents/en/pneumonia_children.pdf]
- Molyneux E, Walsh A, Phiri A, Molyneux M: Acute bacterial meningitis in children admitted to the Queen Elizabeth Central Hospital, Blantyre, Malawi in 1996-97. Trop Med Int Health. 1998, 3: 610-618. 10.1046/j.1365-3156.1998.00278.x.View ArticlePubMed
- Berkley JA, Maitland K, Mwangi I, Ngetsa C, Mwarumba S, Lowe BS, Newton CR, Marsh K, Scott JA, English M: Use of clinical syndromes to target antibiotic prescribing in seriously ill children in malaria endemic area: observational study. BMJ. 2005, 330: 995-10.1136/bmj.38408.471991.8F.PubMed CentralView ArticlePubMed
- Lehmann D, Yeka W, Rongap T, Javati A, Saleu G, Clegg A, Michael A, Lupiwa T, Omena M, Alpers MP: Aetiology and clinical signs of bacterial meningitis in children admitted to Goroka Base Hospital, Papua New Guinea, 1989-1992. Ann Trop Paediatr. 1999, 19: 21-32. 10.1080/02724939992608.View ArticlePubMed
- Berkley JA, Mwangi I, Ngetsa CJ, Mwarumba S, Lowe BS, Marsh K, Newton CR: Diagnosis of acute bacterial meningitis in children at a district hospital in sub-Saharan Africa. Lancet. 2001, 357: 1753-1757. 10.1016/S0140-6736(00)04897-2.View ArticlePubMed
- Berkley JA, Mwangi I, Mellington F, Mwarumba S, Marsh K: Cerebral malaria versus bacterial meningitis in children with impaired consciousness. QJM. 1999, 92: 151-157. 10.1093/qjmed/92.3.151.View ArticlePubMed
- Evans JA, Adusei A, Timmann C, May J, Mack D, Agbenyega T, Horstmann RD, Frimpong E: High mortality of infant bacteraemia clinically indistinguishable from severe malaria. QJM. 2004, 97: 591-597. 10.1093/qjmed/hch093.View ArticlePubMed
- Brent AJ, Ahmed I, Ndiritu M, Lewa P, Ngetsa C, Lowe B, Bauni E, English M, Berkley JA, Scott JA: Incidence of clinically significant bacteraemia in children who present to hospital in Kenya: community-based observational study. Lancet. 2006, 367: 482-488. 10.1016/S0140-6736(06)68180-4.View ArticlePubMed
- Reyburn H, Mbatia R, Drakeley C, Carneiro I, Mwakasungula E, Mwerinde O, Saganda K, Shao J, Kitua A, Olomi R, Greenwood BM, Whitty CJ: Overdiagnosis of malaria in patients with severe febrile illness in Tanzania: a prospective study. BMJ. 2004, 329: 1212-10.1136/bmj.38251.658229.55.PubMed CentralView ArticlePubMed
- The WHO Young Infants Study Group: Bacterial etiology of serious infections in young infants in developing countries: results of a multicentre study. Pediatr Infect Dis J. 1999, 18 (Suppl 10): S17-22.
- Steiner MJ, DeWalt DA, Byerley JS: Is this child dehydrated?. JAMA. 2004, 291: 2746-2754. 10.1001/jama.291.22.2746.View ArticlePubMed
- Berkley J, Mwarumba S, Bramham K, Lowe B, Marsh K: Bacteremia complicating severe malaria in children. Trans R Soc Trop Med Hyg. 1999, 93: 283-286. 10.1016/S0035-9203(99)90024-X.View ArticlePubMed
- Binka FN, Hodgson A, Adjuik M, Smith T: Mortality in a seven-and-a-half-year follow-up of a trial of insecticide-treated mosquito nets in Ghana. Trans R Soc Trop Med Hyg. 2002, 96: 597-599. 10.1016/S0035-9203(02)90321-4.View ArticlePubMed
- WHO: Pocket book of hospital care for children. guidelines for the management of common illnesses with limited resources. 2005, World Health Organization, Geneva, [http://www.who.int/child_adolescent_health/documents/9241546700/en/index.html]
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.