- Open Access
Mind the gaps - the epidemiology of poor-quality anti-malarials in the malarious world - analysis of the WorldWide Antimalarial Resistance Network database
Malaria Journal volume 13, Article number: 139 (2014)
Poor quality medicines threaten the lives of millions of patients and are alarmingly common in many parts of the world. Nevertheless, the global extent of the problem remains unknown. Accurate estimates of the epidemiology of poor quality medicines are sparse and are influenced by sampling methodology and diverse chemical analysis techniques. In order to understand the existing data, the Antimalarial Quality Scientific Group at WWARN built a comprehensive, open-access, global database and linked Antimalarial Quality Surveyor, an online visualization tool. Analysis of the database is described here, the limitations of the studies and data reported, and their public health implications discussed.
The database collates customized summaries of 251 published anti-malarial quality reports in English, French and Spanish by time and location since 1946. It also includes information on assays to determine quality, sampling and medicine regulation.
No publicly available reports for 60.6% (63) of the 104 malaria-endemic countries were found. Out of 9,348 anti-malarials sampled, 30.1% (2,813) failed chemical/packaging quality tests with 39.3% classified as falsified, 2.3% as substandard and 58.3% as poor quality without evidence available to categorize them as either substandard or falsified. Only 32.3% of the reports explicitly described their definitions of medicine quality and just 9.1% (855) of the samples collected in 4.6% (six) surveys were conducted using random sampling techniques. Packaging analysis was only described in 21.5% of publications and up to twenty wrong active ingredients were found in falsified anti-malarials.
There are severe neglected problems with anti-malarial quality but there are important caveats to accurately estimate the prevalence and distribution of poor quality anti-malarials. The lack of reports in many malaria-endemic areas, inadequate sampling techniques and inadequate chemical analytical methods and instrumental procedures emphasizes the need to interpret medicine quality results with caution. The available evidence demonstrates the need for more investment to improve both sampling and analytical methodology and to achieve consensus in defining different types of poor quality medicines.
Malaria, in the world’s 104 endemic countries, occurs predominantly among intertwined poverty and lack of access to efficacious medicines . A grossly neglected aspect of malaria control is the importance that patients should not just have access to medicines, but should have access to good quality-assured medicines. This was recently emphasized in the resolution adopted by the United Nations Human Rights Council “Access to medicines in the context of the right of everyone to the enjoyment of the highest attainable standard of physical and mental health, to medicines that are affordable, safe, efficacious and of quality” .
In the last decade many studies have highlighted deficiencies in medicine quality afflicting all classes of medicines, with no country immune [3–11]. The problem is not new, with reports of falsified cinchona bark from the 1600s  and falsified quinine from the 1800s [13–15].
There has been considerable confusion over definitions of different types of poor quality medicines [16–18]. The terms falsified (i.e. produced by criminals fraudulently), substandard (i.e. unintentional but negligent errors in factory processes) and degraded (i.e. degradation through inadequate storage after leaving the factory or interaction with inadequate excipients) were used to define medicine quality. With increasing use of the term ‘counterfeit’ to refer to intellectual property (IP) concerns, the term falsified was used to avoid IP associations. Public health should be the prime consideration in defining and combating poor quality medicines [19, 20]. Nonetheless, there remains a lack of worldwide consensus on what constitutes a falsified medicine and no international treaty to criminalize the manufacturer or distributor of falsified medicines .
Falsified medicines may usually be identified by their fake packaging but both packaging and chemical analysis are required to be sure of a sample’s regulatory status and public health impact. Such investigations are difficult as instrumental and chemical analysis with sophisticated and expensive equipment, reagents and technical capacity are essential. For packaging analysis, genuine examples of products, direct from the manufacturer, are needed as comparators but are difficult to obtain . Recently, portable instruments to determine the quality of anti-malarials, such as Raman spectrometers and the Global Pharma Health Fund GPHF- Minilab®, have become available and are being used to screen medicine chemical quality [21–23]. For forensic investigations, innovative chemical fingerprinting and palynology techniques can provide clues as to the origin of medicines through analysis of their mineral and pollen composition, respectively [5, 24–26].
The consequences of using poor quality medicines range from prolonged sickness, treatment failure, side effects, loss of income, increased healthcare costs and death. In addition, societies may lose confidence in otherwise effective medicines, in healthcare systems and suffer major economic losses. Of particular current relevance, falsified or substandard anti-malarials containing subtherapeutic amounts of artemisinin derivatives or only one of the two active ingredients in artemisinin combination therapy (ACT), the primary treatment recommended for uncomplicated falciparum malaria, are very likely to contribute to disastrous anti-malarial artemisinin resistance [27, 28], increasing mortality and morbidity and risking the loss of these vital medicines for malaria control.
Nevertheless, objective data on the geography and epidemiology of poor quality medicines are sparse. Estimates of anti-malarial quality vary widely depending on the sampling methodology used, with most reports not employing rigorous scientific techniques, potentially biasing results . In order to understand the shortcomings of the data and how the existing data may help inform policy to improve anti-malarial quality, an openly accessible databank of all the published reports of the quality of anti-malarials was developed: the WWARN Antimalarial Quality Surveyor [9, 30]. Here, the Surveyor is described, the database analysed and the implications for public health and potential interventions discussed.
Structure of the Antimalarial Quality Surveyor Database
A systematic review was conducted of scientific and lay reports on anti-malarial medicine quality, using Pubmed, Scielo, Embase, Embase-Classic, Medline, Google, Google Scholar, World Health Organization (WHO), United States Pharmacopeia (USP), and Medicines Regulatory Agencies (MRA) websites from 1946 to March 2013 in English, French and Spanish (Table 1). Search terms used were ‘anti-malarials’ or ‘artemisinin derivatives’ or ‘antimalarial agent’ and ‘counterfeit’ or ‘substandard’ or ‘fake’ or ‘spurious’ or ‘falsified’ or ‘quality’. Abstracts and full text of 404 studies were reviewed (See the “Inclusion and exclusion criteria of published reports included in WWARN database” subsection; Additional file 1). Data were extracted and entered in a database constructed using MS Access 2007. Descriptive analysis was conducted in Excel and STATA (v11.2, Stata Corp, College Station, TX, USA).
Inclusion and exclusion criteria of published reports included in WWARN database
Inclusion criteria; Any of:
Any study describing in vivo or in vitro tests to determine anti-malarial medicine quality, assays to determine quality, discussion over sampling methodology & pharmaceutical legislation
Any published report from 1946 to March 2013 in English, French and Spanish
Articles about seizures, recalls and confiscations of anti-malarials
Case reports or articles describing side effects or patients not responding to anti-malarial treatments where quality was questioned
Studies with results from several countries or locations are included under each specific country/location.
Studies with results for a whole region or a whole class of drugs, without specific country or location data.
Key variables and definitions
Anti-malarial quality failure rate is quoted from each report without additional analysis. If additional important information, other than packaging and amount of active pharmaceutical ingredient (API), such as disintegration, dissolution, and microbiology are given they are also included in the database. (For a more detailed description of each variable and methodology see ).
In view of the controversy over the terms used to describe medicine quality, author’s definitions were tabulated in and interpreted relation to the definitions used by WHO (Additional file 2), whilst a consensus is sought. ‘Falsified’ is used as a synonym for counterfeit or spurious, referring to a medical product produced with criminal intent to mislead, but without reference to intellectual property concerns. Samples that failed chemical assays, but without detection of wrong active ingredients and without packaging analysis, are classified as poor quality and not as falsified or substandard as this distinction cannot be reliably made without reference to the packaging . However, samples that contained wrong API or no API but without packaging analysis were assumed to be falsified. There is a small risk of misclassification of such samples as falsified when they are actually substandard, due to gross manufacturing errors. However, such catastrophic errors of potential criminal negligence appear to be relatively rare [6, 7]. Samples that did not fail chemical and packaging tests (when these were done) are considered as good quality. As there is little information available to distinguish substandard (i.e. errors in factory production) from degraded (i.e. degradation due to post-production inappropriate storage) medicines, substandard medicines may also, in error, include degraded products that left the factory as good quality [17, 32].
Antimalarial Quality Surveyor
The Antimalarial Quality (AQ) Surveyor is an open access, web-based visualization tool that tabulates and maps published reports on the quality of anti-malarial medicines . The system was designed with medicine regulatory authorities (MRAs), national malaria control programmes (NMCPs) and medicine funding agencies as the target main users. A simple dashboard allows users to filter and explore the data and examine standardized summaries of anti-malarial quality reports. Key information that can be filtered includes the quality of anti-malarial medicines, where they were obtained and from what type of outlet and what sampling techniques and chemical assays were used.
The AQ Surveyor also includes a filterable tabular view, listing all the source reports plus other publications, such as reviews and descriptions of assay techniques, without primary data amenable to mapping, but relevant to medicine quality. The AQ Surveyor was reviewed by key audiences, including MRAs, NMCPs, pharmacists, and academics for feedback and adapted accordingly.
Of the 404 reports reviewed, 251 were eligible for inclusion into the database (Additional file 1). Of publications included, 51.8% (130) described anti-malarial quality survey(s) in a specific location or region with enough information to yield an estimate of the frequency of poor quality anti-malarials. From the 130 publications, a total of 529 records-surveys are plotted on the AQ Surveyor map. Specific details about the techniques used for analysis, quality result for a specific brand, dosage or pharmaceutical ingredient, were given in 82.3% (107) reports, giving 987 records in the database. The total number of samples included is 9,348, not including reports with more than 680 samples collected in five confiscations and reports with unknown number of samples in 38 reports.
Geographical and temporal data
Of 104 malaria-endemic countries , some published information on anti-malarial quality is publicly available from 41.3% (43), with over half of these (58.1%, 25) only having one or two reports available. Of malarious countries in South and Central America, Africa and Asia, anti-malarial quality data are only available from 19, 61 and 50% countries, respectively. There are no reports from vast swathes of central Africa, such as Zambia. There is only one report each from DRC, Angola and Gabon (that represent 40% of the estimated global burden of malaria); and Sri Lanka, Nepal and Melanesia. There are very few from India, South and Central America and southern Africa. No report was found from the Eastern Mediterranean WHO Region or the six endemic-malaria countries in Europe (Additional file 3). Nigeria has highest number of reports followed by Tanzania, Ghana, Cambodia, Kenya, and the Lao PDR (Laos) (Figure 1). There are only 82 locations listed in the AQ Surveyor, with 36.7% (61) of publications not stating where within countries samples were collected.
The number of surveys of anti-malarial quality has increased over the last decade (Additional file 4). In the last five years the focus of anti-malarial quality publications appears to have shifted to medicine regulation and chemical analysis techniques, with fewer peer-reviewed primary research articles on anti-malarial quality surveys. Peer-reviewed articles accounted for 24.3% (61) of the 251 publications, with medicine regulation 16.7% (42), analysis techniques 11.2% (28) and lay press 10.4% (26) accounting for the remainder (Figure 2). The median (range) delay between collection and publication was one (zero to 11) years, with 26.7% (39) of publications not stating when the sampling was conducted.
Sampling and definitions
Of the 130 published reports only 5% (six) included evidence for randomization of sample location selection (Additional file 5) [33–38]. For papers published since the Medicine Quality Assessment Reporting Guidelines (MEDQUARG)  for conducting and reporting surveys of medicine quality were published in 2009, only 15.4% (six of 39), describe following them. Of 529 surveys, 32.3% (171) explicitly describe their definitions of counterfeit, falsified, and/or substandard and 20.6% reports (27) used contemporary WHO definitions. Another four reports mentioned the WHO definitions but called the medicines substandard, classifying them according to whether they complied with colour tests, had a different retention time (Rf) value in thin layer chromatography (TLC) or used the terms ‘poor quality’ and ‘substandard’ without conducting packaging analysis and based only on amount of active ingredient.
Of the 130 primary survey research papers, 47.7% (62) stated in which country the chemical analysis was performed, for 32.3% (20) of these, it was performed in high-income, non-malarious countries and in 17.7% (11) the analysis was conducted in WHO prequalified labs.
Antimalarial Quality surveys
The majority of the surveys (61.4%, 323) examined the quality of non-artemisinin derivative anti-malarials, especially chloroquine (23.4%, 76) and sulphadoxine-pyrimethamine (SP) (23.1%, 75; see Additional file 6). To date only one report of falsified ACT has been reported in Asia (a seizure in China with medicines for sale in Africa, ) but there have been numerous reports from Africa. Figure 3 shows the number of failing samples classified by anti-malarial category and region.
Out of 9,348 samples included in the database, 30.1% (2,813) failed chemical/packaging quality tests. Oral artesunate was the medicine most commonly reported as falsified (with 61.9% of it failing) see Figure 4. Of the 2,813 samples that failed a chemical quality test, 39.3% (1,107) were classified as falsified, 2.3% (66) as substandard and 58.3% (1,640) were classified as poor quality, without evidence to categorize them as either substandard or falsified (Additional file 7).
An important minority (14.0%, 74) of the 529 surveys did not state the number of samples collected, and 45.7% (242) included less than ten samples per international non-proprietary name (INN) see Figure 5. The median (range) number of samples collected per study was ten (one to 258), excluding reports describing confiscations.
No surveys were found of a significant number of anti-malarials, including atovaquone, cycloguanil, clindamycin, dapsone-pyrimethamine, napthoquine, piperaquine, and parenteral artesunate. Surveys have mainly been conducted on oral artesunate, chloroquine and sulphadoxine-pyrimethamine with a mean number of different anti-malarial INNs collected per study of two, up to a maximum of nine (Additional file 8). As an example, the figure in Additional file 9 gives the different published failure rate results for all the anti-malarials sampled and classified as falsified in Cambodia, a country with many published reports. The numbers vary greatly depending on the number of samples analysed and methodology followed.
Of 130 publications, 45% (59) stated whether the 1,132 failing samples (including samples from one confiscation ) had high, low or a different API from that stated on the packaging. Of the failed samples with chemical data, 27.0% (306) had no API detected, 25.7% (291) had high API, 24.7% (280) had low API and 22.5% (255) had wrong API (Additional files 10 and 11). Of samples with different ingredients to those stated on the packaging, 20 different ingredients were found, ranging from aspirin, acetaminophen, mercaptobenzothiazole to soya flour (Table 2).
The types of outlets where medicines were sampled was not specified in 23.8% (126) of the 529 surveys; 2.5% (13) of the surveys stated that they sampled only public-sector outlets, 37.0% (196) included private outlets alone and 28.0% (148) did not specify which results referred to private or public outlets.
Chemical analysis techniques
Thirty-three different techniques to determine the quality of the medicines was stated in one-hundred and seven publications, including high-performance liquid chromatography (HPLC) 37.4% (40), thin layer chromatography (TLC) 12.1% (13), direct mass spectrometry (MS) 4.6% (five), liquid chromatography–mass spectrometry (LC-MS) 2.8% (three), colorimetry 2.8% (three) and dissolution 24.3% (26). Examination of the packaging was reported in 21.5% (23) publications. For API content analysis technique and interpretation, the US Pharmacopoeia (31.1%, 41) was most commonly used, followed by the British Pharmacopoeia (9.9%, 13), but this vital information was not given in 41.7% (55) of publications.
In 60.2% (53) of reports, details of the manufacturers stated on the sample were not included. In a further 25 reports the country of manufacture was given without the stated manufacturer’s name. Samples labelled, correctly or incorrectly, as made by Guilin Pharmaceutical Co Ltd, China, were the most commonly collected but details of 90 anti-malarial manufacturers from 36 countries, as stated on the packaging, were found in the reports. The alleged country of manufacture was specified in 934 failing samples (of 2,813) and China was the alleged country of manufacture of 35.2% (329) failing samples followed by Pakistan 16.2% (151), India 13.7% (128) and Switzerland 11.8% (110); whether these were the countries of manufacture is unknown.
Fifteen of the 36 (50%) stated countries of manufacture, have stringent regulatory authorities (SRA) that are members/observers/associates of the International Conference on Harmonization of Technical Requirements for Registration of Pharmaceutical for Human Use (ICH) .
Of the samples that failed chemical and/or packaging analysis 8.2% (209) were labelled as from a WHO prequalified manufacturer, 0.9% (24) labelled as from a manufacturer with an address within a SRA country and 4.1% (104) labelled both from a WHO prequalification programme (PQP) and from a SRA country. Of the eight WHO prequalified anti-malarial manufacturers , products from three manufacturers were found in the database.
The literature review available through the WWARN AQ Surveyor illustrates the alarming scale of poor anti-malarial quality in many malarious countries, and also highlights the major geographical gaps with no published information on the quality of anti-malarials for much of the malarious world and severe problems of data interpretation. The AQ Surveyor is the first freely available global repository compiling all published anti-malarial quality reports from the last 60 years.
No reports of anti-malarial quality were found for 60.6% (63) of the 104 malaria-endemic countries and 38.6% (17) of the 44 African malarious countries. Although there are clear foci of poor quality anti-malarials, the current global situation remains unclear, poorly documented; and their impact on public health uncertain. The data are insufficient to understand the distribution of ‘hotspots’ of poor anti-malarial quality and the reasons for heterogeneity.
The data suffer from important limitations that are vital to bear in mind in their interpretation. There is likely to be a large unpublished ‘grey literature’ held by MRAs and the pharmaceutical industry that would contain useful information. The pharmaceutical industry, while paying close attention to falsification of their products, are often reluctant to share figures or specific examples [56, 57]. The lack of standardization of reporting is also serious limitation. Results are frequently not broken down by country and/or medicine, making it very difficult for individual countries to plan their response unless they are sent data by the authors of reports.
Difficulties of interpreting the data
Studies are not reported in a consistent manner, hampering comparison with other studies through time and space. The number of samples is commonly not representative and the small number of units tested also limits the interpretation of the results. One third of the reports (29.2%) did not state the number of samples they collected.
Estimates vary greatly depending on the sampling methodology and the technique used, probably greatly influencing reported failure rates. In 13 reports a portable technique was used to determine medicine quality and in eight of those, no confirmation analysis was conducted in a certified quality control laboratory whilst the accuracy of these portable techniques has not been properly evaluated in the field.
Most importantly, randomization, usually considered as the gold standard in estimation of disease prevalence was used very rarely. Without such an objective sampling strategy it will not be possible to obtain confidence intervals, objectively compare between regions or through time or test the effectiveness of interventions . Convenience sampling can be useful for yielding alerts about poor quality medicines but cannot be used reliably to estimate their frequency.
Thirty-four (26%) studies did not report when the collection was conducted and there were long delays, up to seven years, between sample collection and publication.
Ambiguous definitions over what constitutes falsified and substandard medicines make data standardization difficult and 74% of the reports did not state what definition they used. A vital problem is the frequent lack of distinction between falsified and substandard medicines. This distinction requires additional time-consuming packaging analysis but is indispensable, as without these data MRAs do not know if they are dealing with fraud and criminal ‘pharmaceutical’ production or with poorly functioning manufacturing plants, or issues related to medicine storage. How an MRA will respond to reports of poor medicine quality depends on this distinction. This problem is exacerbated by the difficulty of accessing examples of genuine packaging to conduct packaging analysis. Out of the failing samples, 58.3% (1,640) were classified as poor quality. These poor quality anti-malarials tended to have either greater or lesser amounts of API in comparison to that stated on the packaging, suggesting that they are most likely substandard. Quinine and artesunate seem to be the most commonly falsified with wrong API, together with artemether-lumefantrine with no API. SP and chloroquine most commonly had incorrect amounts of API.
A further important issue is that dissolution testing was only included in 24.3% (26) of the chemical analyses, presumably because of the large investments in equipment, funds and laboratory time required. Anti-malarials may have the correct amount of API, but especially for SP, may have very poor dissolution . Recent data suggest that similar problems may affect poor quality ACT .
More investigation needs to be done in the Americas and the central and southern African regions as there are very few reports from these malarious areas. Six countries: Nigeria, the Democratic Republic of Congo, Burkina Faso, Mozambique, Côte d'Ivoire, and Mali, account for 60%, or 390,000, of estimated global malaria deaths , but only one report of anti-malarial quality was found from Burkina Faso and Mali, and two reports for Côte d'Ivoire. There is little confidence in the generalizability of anti-malarial quality for large populations afflicted with malaria. More surveys are needed in populations with high malaria risk (Figure 6). Also, little information is available about the registration status of the manufacturers in endemic countries or about expiry date tampering. Only 13.1% (17) reports stated whether samples were registered in the country of collection and 16.9% stated whether expired samples were found.
Other reviews summarizing the prevalence of poor quality anti-malarials did not have access to a full database of a long period of data in multiple languages [11, 61] and gave aggregated estimates of the prevalence of poor quality anti-malarials through space and time without emphasizing the limitations of the data and dangers of over-interpretation. The aggregation of information from sources with variable credibility with equal weight may not be appropriate and this issue needs to be addressed.
Therefore, the data reviewed here cannot be summarized as stating that 30.1% of the world’s anti-malarial medicine supply is poor quality. All that can be concluded is, mindful of the above caveats, that 30.1% of anti-malarials tested over 67 years were poor quality and that this is an important public health problem. Enormous quantities of anti-malarials are consumed in comparison to the number of samples with published quality data. In Africa, an estimated 200-400 million courses of anti-malarial treatment are used per year with an additional 100 million courses elsewhere . The number of ACT treatment courses delivered globally to the public and private sectors increased from 11 million in 2005 to 278 million in 2011 . However, information of the quality of 9,348 samples and 1,034 ACT were only found since 1946.
‘Talk only, no action’
Despite evidence that poor quality anti-malarials are focally common and are bad for patients, there have been few interventions and the subject has been dominated by discussions with little action. The efforts put into addressing the quality of medicines have had little tangible impact, in comparison to the size of the problem, because the programmes have mostly been slow, under-funded and fragmented. Many parallel interventions are needed [3, 5, 11, 16, 19, 63]. The controversy over definitions has disabled much that could be done and the use of the unwieldy term ‘substandard/spurious/falsely labelled/falsified/counterfeit medical products (SSFFCs)’ has not helped. The international community should act with much greater speed and focus to build interventions to safeguard global medicine supply (Newton et al. submitted).
The newly created Member State Mechanism on SSFFCs should rationalize this term into definitions that are accessible and accurate and aid public health [16, 17], help to focus on the development and maintenance of up-to-date international tools, guidelines and standards, identify major needs and challenges and make policy recommendations to strengthen national and regional capacities [64–68]. The provision of free or subsidized ACT through the Global Fund, President’s Malaria Initiative (PMI), the World Bank and other major donors has probably had a large impact on improving the quality of anti-malarials that patients take in the public sector, although it was not designed with this primary aim in mind . The WHO Rapid Alert System  should allow a better coordinated sharing of information and help fill in the many gaps. However, more data from countries with high malaria incidence but few data points on anti-malarial quality are urgently needed. Similarly, the pharmaceutical industry, both innovative and generic, should have a legal duty to report suspicions of poor quality medicines to key stakeholders such as MRAs and WHO . A major problem is that there are very few laboratories in the malarious world able to accurately analyse the quality of anti-malarials – there are only three countries in sub-Saharan Africa and five in Southeast Asia with WHO prequalified laboratories . Many of the current problems have arisen as a consequence of the lack of investment in MRAs in low- and middle-income countries, by national and international organizations, to allow them to effectively regulate and police the medicine supply. Of 100 primary survey research papers not performed by MRAs, only 26% (26) mentioned that they informed the MRA. Appropriate interventions to support MRAs are urgently needed.
The data available for assessing the frequency of poor quality anti-malarials and their public health impact are of poor quality but suggest that there are severe problems at least in some important foci with high malaria burden. Poor-quality antimalarials that contain sub-therapeutic amounts of active ingredient increase the risk of drug resistance and may put at risk current therapeutic control strategies. There is an immediate need for standardizing sampling and assay methods and achieve consensus in defining different types of poor quality medicines.
In a social and economic landscape where 30% of the world´s MRAs do not have functional capacity and most developing countries do not have national laboratories , inspectors are not able to objectively screen for suspect medicines. In order to properly assess the quality of medicines, it needs to be ensured that such techniques are accessible in lower income countries and, as has happened in wealthy countries, empowering routine inspection must be a much higher public health priority.
An ethics statement was not required for this work.
Patricia Tabernero and Paul N. Newton: Worldwide Antimalarial Resistance Network (WWARN), Churchill Hospital, University of Oxford, Oxford, UK.
Worldwide Antimalarial Resistance Network
Active pharmaceutical ingredients
Global Pharma Health Fund
Artemisinin combination therapy
World Health Organization
United States Pharmacopeia
Medicines Regulatory Agencies
- AQ Surveyor:
Antimalarial quality surveyor
National malaria control programmes
International non-proprietary name
Medicine quality assessment reporting guidelines
Thin layer chromatography
High-performance liquid chromatography
Liquid chromatography–mass spectrometry
Stringent regulatory authorities
International Conference on Harmonization of Technical Requirements for Registration of Pharmaceutical for Human Use
WHO prequalification programme
Substandard/spurious/falsely labelled/falsified/counterfeit medical products
President’s malaria initiative.
World Health Organization: World Malaria Report 2012. 2012, [cited 2013 March, 17th]; Available from: http://www.who.int/malaria/publications/world_malaria_report_2012/en/
United Nations Human Rights Council: Access to medicines in the context of the right of everyone to the to the enjoyment of the highest attainable standard of physical and mental health. Twenty-third session, Agenda item 3, Promotion and protection of all human rights, civil, political, economic, social and cultural rights, including the right to development 2013 [cited 2013 June 20th]; Available from: http://ap.ohchr.org/documents/dpage_e.aspx?si=A/HRC/23/L.10/rev.1
Caudron JM, Ford N, Henkens M, Macé C, Kiddle-Monroe R, Pinel J: Substandard medicines in resource-poor settings: a problem that can no longer be ignored. Médicaments sous-standard dans les milieux défavorisés: un problème qui ne peut plus être ignoré. Revue Medicamentos sub-estándar en lugares con pocos recursos: un problema que no puede ser ignorado por más tiempo. Revisión. Tropical Med Int Health. 2008, 13 (8): 1062-1072. 10.1111/j.1365-3156.2008.02106.x.
Institute of Medicine of the National Academies: Countering the Problem of Falsified and Substandard Drugs. 2013, National Academy of Sciences. The National Academies Press, Available from: http://www.iom.edu/reports/2013/countering-the-problem-of-falsified-and-substandard-drugs.aspx
Newton PN, Green MD, Mildenhall DC, Plancon A, Nettey H, Nyadong L, Hostetler DM, Swamidoss I, Harris GA, Powell K, Timmermans AE, Amin AA, Opuni SK, Barbereau S, Faurant C, Soong RCW, Faure K, Thevanayagam J, Fernandes P, Kaur H, Angus B, Stepniewska K, Guerin PJ, Fernandez FM: Poor quality vital antimalarials in Africa – an urgent neglected public health priority. Malar J. 2011, 10: 352-10.1186/1475-2875-10-352.
Dorlo TPC, Eggelte TA, Schoone GJ, de Vries PJ, Beijnen JH: A Poor-Quality Generic Drug for the Treatment of Visceral Leishmaniasis: A Case Report and Appeal. PLoS Negl Trop Dis. 2012, 6 (5): e1544-10.1371/journal.pntd.0001544.
Nishtar S: Pakistan's deadly cocktail of substandard drugs. Lancet. 2012, 379 (9821): 1084-5. 10.1016/S0140-6736(12)60277-3.
Food & Agricultural Organisation of the United Nations (FAO): Report on the investigation of the quality of diminazene preparations in sub-Saharan Africa in Report prepared under a Special Services Agreement to investigate the quality of veterinary trypanocides in sub-Saharan Africa. Edited by: Tettey JNA. 2001, Food & Agricultural Organisation of the United Nations,
Tabernero P, Newton PN: The WWARN Antimalarial Quality Surveyor. Pathog Glob Health. 2012, 106 (2): 77-78. 10.1179/204777312X13419245939520.
U.S. Food & Drug Administration (FDA): Counterfeit Version of Avastin in U.S. Distribution. 2012, [cited 2012 February, 14]; Available from: http://www.fda.gov/Drugs/DrugSafety/ucm291960.htm
Newton PN, Green MD, Fernandez FM, Day NP, White NJ: Counterfeit anti-infective drugs. Lancet Infect Dis. 2006, 6: 602-613. 10.1016/S1473-3099(06)70581-3.
Saunders W: Letter from Dr Edward Rigby, Norwich, 8th September 1782. Vol. 4th edition. Observations on the superior efficacy of the Red Peruvian Bark. 1782, London, UK: J Johnson & J Murray
Heath WJ: America’s First Drug Regulation Regime: The Rise and Fall of the Import Drug Act of 1848. Food Drug Law J. 2004, 59: 169-200.
GP A:Drug Adulteration. Lancet. 1826, 6 (147): 413-
Croft CJ:Adulteration Quinine. Lancet. 1838, 31 (794): 292-10.1016/S0140-6736(02)82655-1.
Attaran A, Barry D, Basheer S, Bate R, Benton D, Chauvin J, Garrett L, Kickbusch I, Kohler JC, Midha K, Newton PN, Nishtar S, Orhii P, Martin McKee M: How to achieve international action on falsified and substandard medicines. BMJ. 2012, 345:
Newton PN, Amin AA, Bird C, Passmore P, Dukes G, Tomson G, Simons B, Bate R, Guerin PJ, White NJ: The Primacy of Public Health Considerations in Defining Poor Quality Medicines. PLoS Med. 2011, 8 (12): e1001139-10.1371/journal.pmed.1001139.
European Union: Amending Directive 2001/83/EC on the Community code relating to medicinal products for human use, as regards the prevention of the entry into the legal supply chain of falsified medicinal products., in Directive 2011/62/EU Of The European Parliament And Of The Council. 2011, Official Journal of the European Union, 74-87. Available from: http://ec.europa.eu/health/files/eudralex/vol-1/dir_2011_62/dir_2011_62_en.pdf,
Bate R, Attaran A: A counterfeit drug treaty: Great idea, wrong implementation. Lancet. 2010, 376 (9751): 1446-1448. 10.1016/S0140-6736(10)61416-X.
WHO: Substandard/spurious/falsely-labelled/falsified/counterfeit medical products: report of the Working Group of Member States. Sixty-fifth World Health Assembly. Provisional Agenda item 13.13 A65/23. 2012, WHO,Available from:http://apps.who.int/gb/ebwha/pdf_files/WHA65/A65_23-en.pdf,
de Veij M, Vandenabeele P, Hall KA, Fernandez FM, Green MD, White NJ, Dondorp AM, Newton PN, Moens L: Fast detection and identification of counterfeit antimalarial tablets by Raman spectroscopy. J Raman Spectrosc. 2007, 38 (2): 181-187. 10.1002/jrs.1621.
Ricci C, Nyadong L, Yang F, Fernandez FM, Brown CD, Newton PN, Kazarian SG: Assessment of hand-held Raman instrumentation for in situ screening for potentially counterfeit artesunate antimalarial tablets by FT-Raman spectroscopy and direct ionization mass spectrometry. Anal Chim Acta. 2008, 623 (2): 178-186. 10.1016/j.aca.2008.06.007.
Ricci C, Eliasson C, Macleod N, Newton P, Matousek P, Kazarian S: Characterization of genuine and fake artesunate anti-malarial tablets using Fourier transform infrared imaging and spatially offset Raman spectroscopy through blister packs. Anal Bioanal Chem. 2007, 389 (5): 1525-1532. 10.1007/s00216-007-1543-1.
Fernández FM, Cody RB, Green MD, Hampton CY, McGready R, Sengaloundeth S, White NJ, Newton PN: Characterization of Solid Counterfeit Drug Samples by Desorption Electrospray Ionization and Direct-analysis-in-real-time Coupled to Time-of-flight Mass Spectrometry. ChemMedChem. 2006, 1 (7): 702-705. 10.1002/cmdc.200600041.
Fernandez FM, Hostetler D, Powell K, Kaur H, Green MD, Mildenhall DC, Newton PN: Poor quality drugs: grand challenges in high throughput detection, countrywide sampling, and forensics in developing countries. R Soc of Chem. 2010, 136 (15): 3073-3082.
Kaur H, Green MD, Hostetler DM, Fernandez FM, Newton PN: Antimalarial drug quality: Methods to detect suspect drugs. Therapy. 2010, 7 (1): 49-57. 10.2217/thy.09.84.
Dondorp AM, Dondorp AM, Nosten F, Yi P, Das D, Phyo AP, Tarning J, Lwin KM, Ariey F, Hanpithakpong W, Lee SJ, Ringwald P, Silamut K, Imwong M, Chotivanich K, Lim P, Herdman T, An SS, Yeung S, Singhasivanon P, Day NPJ, Lindegardh N, Socheat D, White NJ: Artemisinin Resistance in Plasmodium falciparum Malaria. N Engl J Med. 2009, 361 (5): 455-467. 10.1056/NEJMoa0808859.
White N, Pongtavornpinyo W, Maude R, Saralamba S, Aguas R, Stepniewska K, Lee S, Dondorp A, White L, Day N: Hyperparasitaemia and low dosing are an important source of anti-malarial drug resistance. Malar J. 2009, 8 (1): 253-10.1186/1475-2875-8-253.
Newton PN, Lee SJ, Goodman C, Fernandez FM, Yeung S, Phanouvong S, Kaur H, Amin AA, Whitty CJM, Kokwaro GO, Lindegardh N, Lukulay P, White LJ, Day NPJ, Green MD, White NJ: Guidelines for field surveys of the quality of medicines: A proposal. PLoS Med. 2009, 6 (3): 0252-0257.
Worldwide Antimalarial Resistance Network, A.Q.S.G: Antimalarial Quality Surveyor. 2012, [cited 2013 December 12th]; Available from: http://www.wwarn.org/resistance/surveyors/antimalarial-quality
Worldwide Antimalarial Resistance Network, A.Q.S.G: Antimalarial Quality Surveyor. Methodology. 2012, [cited 2013 December 16th]; Available from: http://www.wwarn.org/resistance/surveyors/antimalarial-quality/methodology
Keoluangkhot V, Green MD, Nyadong L, Fernández FM, Mayxay M, Newton PN: Impaired Clinical Response in a Patient with Uncomplicated Falciparum Malaria Who Received Poor-Quality and Underdosed Intramuscular Artemether. AmJTrop Med Hyg. 2008, 78 (4): 552-555.
Kaur H, Goodman C, Thompson E, Thompson K-A, Masanja I, Kachur SP, Abdulla S: A Nationwide Survey of the Quality of Antimalarials in Retail Outlets in Tanzania. PLoS One. 2008, 3 (10): e3403-10.1371/journal.pone.0003403.
Onwujekwe O, Kaur H, Dike N, Shu E, Uzochukwu B, Hanson K, Okoye V, Okonkwo P: Quality of anti-malarial drugs provided by public and private healthcare providers in south-east Nigeria. Malar J. 2009, 8 (1): 22-10.1186/1475-2875-8-22.
Ogwal-Okeng JW, Okello DO, Odyek O: Quality of oral and parenteral chloroquine in Kampala. East Afr Med J. 1998, 75 (12): 692-694.
Taylor RB, Shakoor O, Behrens RH, Everard M, Low AS, Wangboonskul J, Reid RG, Kolawole JA: Pharmacopoeial quality of drugs supplied by Nigerian pharmacies. Lancet. 2001, 357 (9272): 1933-1936. 10.1016/S0140-6736(00)05065-0.
Odeniyi MA: Comparative analysis of eight brands of sulfadoxinepyrimethamine tablets. Trop J Pharm Res. 2003, 2 (1): 161-167.
Sengaloundeth S, Green MD, Fernandez FM, Manolin O, Phommavong K, Insixiengmay V, Hampton CY, Nyadong L, Mildenhall DC, Hostetler D, Khounsaknalath L, Vongsack L, Phompida S, Vanisaveth V, Syhakhang L, Newton PN: A stratified random survey of the proportion of poor quality oral artesunate sold at medicine outlets in the Lao PDR - implications for therapeutic failure and drug resistance. Malar J. 2009, 8: 172-10.1186/1475-2875-8-172.
IPR in China: Judicial Protection of IPR in China. GlaxoSmithKline Case Study. Intellectual Property Rights in China 2000 December 2000 [cited March 3rd, 2013]; Available from: http://www.chinaiprlaw.com/english/news/news14.htm
Newton PN, McGready R, Fernandez F, Green MD, Sunjio M, Bruneton C, Phanouvong S, Millet P, Whitty CJM, Talisuna AO, Proux S, Christophel EM, Malenga G, Singhasivanon P, Bojang K, Kaur H, Palmer K, Day NPJ, Greenwood BM, Nosten F, White NJ: Manslaughter by Fake Artesunate in Asia-Will Africa Be Next?. PLoS Med. 2006, 3 (6): e197-10.1371/journal.pmed.0030197.
Ndomondo-Sigonda M: Counteracting Counterfeiting: Strategies for Improving the Integrity of the Medicinal Marketplace in Tanzania. 2005, Tanzania Food and Drugs Authority, Available from: http://projects.msh.org/seam/reports/fip-cairo_2005/57_counteracting.pdf
News MG: Pharmacia Withdraws Metakelfin in White Sachets. modern.ghana.com 2002 [cited 2011 November, 7th]; Available from: http://www.modernghana.com/news/20469/1/pharmacia-withdraws-metakelfin-in-white-sachets.html
Sesay MM: Fake drugs- A new threat to health-care delivery. Africa Health. 1988
Gaudiano M, Di Maggio A, Cocchieri E, Antoniella E, Bertocchi P, Alimonti S, Valvo L: Medicines informal market in Congo, Burundi and Angola: counterfeit and sub-standard antimalarials. Malar J. 2007, 6 (1): 22-10.1186/1475-2875-6-22.
Basco LK: Molecular Epidemiology of Malaria in Cameroon. XIX. Quality of antimalarial drugs used for self-medication. AmJTrop Med Hyg. 2004, 70 (3): 245-250.
Mugabe D: Fake drugs hit Ugandan market. 2009, [cited 2012 October 8th]
Erhun WO, Babalola OO, Erhun MO: Drug Regulation and Control in Nigeria: The Challenge of Counterfeit Drugs. J Health Popul Dev Ctries. 2001, 4 (2): 23-24.
Alter K, Fernández F, Green M, Newton PN: Analysis of counterfeit antimalarial drugs. Eur Pharm Rev. 2004, 2004 (3):
Hall KA, Newton PN, Green MD, De Veij M, Vandenabeele P, Pizzanelli D, Mayxay M, Dondorp A, Fernández FM: Characterization of Counterfeit Artesunate antimalarial tablets from Southeast Asia. AmJTrop Med Hyg. 2006, 75 (5): 804-811.
Bagala A: 3 held over fake malaria drugs. 2008, [cited 2012 December 20th]; Available from: http://www.monitor.co.ug/News/Education/-/688336/759052/-/view/printVersion/-/13hs21sz/-/index.html
Rozendaal J: Fake antimalaria drugs in Cambodia. Lancet. 2001, 357 (9259): 890-890.
Bagozzi D: Substandard and counterfeit medicines. 2003, WHO, Fact sheet 275. Available from: http://www.who.int/mediacentre/factsheets/2003/fs275/en/
Wolff J-C, Thomson LA, Eckers C: Identification of the ‘wrong’ active pharmaceutical ingredient in a counterfeit Halfan™ drug product using accurate mass electrospray ionisation mass spectrometry, accurate mass tandem mass spectrometry and liquid chromatography/mass spectrometry. Rapid Commun Mass Spectrom. 2003, 17 (3): 215-221. 10.1002/rcm.893.
The International Conference on Harmonisation of Technical Requirements for Registration of Pharmaceuticals for Human Use (ICH). 2013, ICH, [cited 2013 August 20th]; Available from: http://www.ich.org/
WHO: Prequalification Programme. A United Nations Programme managed by WHO. 2013, [cited 2013 February 8th]; Available from: http://apps.who.int/prequal/
Cockburn R, Newton PN, Agyarko EK, Akunyili D, White NJ: Global threat of counterfeit drugs: Why industry and governments must communicate the dangers. PLoS Med. 2005, 2 (4): 0302-0308.
The Lancet Editorial: Editorial, Fighting fake drugs: the role of WHO and pharma. Lancet. 2011, 377: 1-10.1016/S0140-6736(10)62319-7.
Newton PN, Fernández FM, Green MD, Primo-Carpenter J, White NJ: Counterfeit and Substandard Anti-infectives in Developing Countries. Antimicrob Resist Dev Ctries. 2009, Chapter 24: 413-443.
Leslie T, Kaur H, Mohammed N, Kolaczinski K, Ord RL, Rowland M: Epidemic of Plasmodium falciparum malaria involving substandard antimalarial drugs, Pakistan, 2003. Emerg Infect Dis. 2009, 15 (11): 1753-1759. 10.3201/eid1511.090886.
Sabartova J, Toumi A, World Health Organization: Survey of the quality of selected antimalarial medicines circulating in six countries of sub-Saharan Africa. 2011, WHO, 118-Available from: http://www.who.int/entity/medicines/publications/WHO_QAMSA_report.pdf
Nayyar GML, Breman JG, Newton PN, Herrington J: Poor-quality antimalarial drugs in southeast Asia and sub-Saharan Africa. Lancet Infect Dis. 2012, 12 (6): 488-496. 10.1016/S1473-3099(12)70064-6.
Arrow KJ, Panosian CB, Gelband H: Saving lives, buying time: economics of malaria drugs in an age of resistance. Edited by: Committee on the Economics of Antimalarial Drugs Board on Global Health. Institute of Medicine of the National Academies. 2004, Washington D.C: The National Academies Press
Newton PN, White NJ, Rozendaal JA, Green MD: Murder by fake drugs: Time for international action. Br Med J. 2002, 324 (7341): 800-801. 10.1136/bmj.324.7341.800.
WHO: Report of the Open-ended Working Group to Identify the Actions, Activities and Behaviours that Result in Substandard/Spurious/Falsely-labelled/Falsified/Counterfeit Medical Products. Second Meeting of the Member State Mechanism on Substandard,Spurious,Falsely-labelled,Falsified,Counterfeit Medical Products. Provisional Agenda item. Vol. A/MSM/2/3. 2013, World Health Organization, Available from: http://apps.who.int/gb/ssffc/pdf_files/A_MSM2_3-en.pdf
WHO:Open-ended working group to identify the actions, activities and behaviours that result in substandard/spurious/falsely-labelled/falsified/counterfeit medical products.Provisional agenda item 3. Report by the Secretariat. Vol. A/MSM/WG/1/2. 2013, World Health Organization, Available from: http://apps.who.int/gb/ssffc/pdf_files/WG1b/A_MSM_WG1_2-en.pdf,
WHO: WHO, Substandard/Spurious/Falsely-labelled/Falsified/Counterfeit medical products. Situation report by the Secretariat. First Meeting of the Member State Mechanism on Substandard/Spurious/Falsely-labelled/Falsified/Counterfeit Medical Products. Provisional Agenda item 4. 2012, World Health Organization, Available from: http://apps.who.int/gb/ssffc/pdf_files/A_MSM1_INF1-en.pdf
WHO: Options for the structure and governance of the Member State mechanism on substandard/spurious/falsely-labelled/falsified/counterfeit medical products. First meeting of the Member State Mechanism on Substandard,Spurious,Falsely-labelled,Falsified,Counterfeit medical products. Provisional Agenda item 6. 2012, World Health Organization, Available from: http://apps.who.int/gb/ssffc/pdf_files/A_MSM1_3-en.pdf
WHO: Substandard/spurious/falsely-labelled/falsified/counterfeit medical products. Report by the Secretariat in Sixty-sixth World Health Assembly. Provisional agenda item 17.1. 2013, World Health Organization, Available from: http://apps.who.int/gb/ebwha/pdf_files/WHA66/A66_22-en.pdf,
WHO: WHO project for the surveillance and monitoring of SSFFC medical products. WHO Drug Information. Quality and Safety of Medicines. 2013, 115-
World Health Organization: WHO List of Prequalified Quality Control Laboratories. Version 26th Edition 2013 [cited 2013 August 20th]; Available from: http://www.who.int/prequal/lists/pq_qclabs list.pdf
WHO: World Malaria Report 2011. 2011, World Health Organization, [cited 2013 March, 17th] Available from: http://www.who.int/malaria/world_malaria_report_2011/9789241564403_eng.pdf
We greatly appreciate the work conducted by the WWARN IT team in Oxford, Richard Cooksey and Andrew Payne, for the design and help on the map web application and deployment of the AQ Surveyor; and Julián Atienza for the design of the database. We are very grateful to all those who have given advice and information and to all those who have helped with Beta testing of the AQ Surveyor: A.A. Amin, Liz Ashley, Amir Attaran, Michael J. Bangs, Roger Bate, Joel Breman, Kennedy Chibwe, Latifa El-Hadri, Mustapha Hajjour, Glenn Harris, Alicia Hartman, Yonah Hebron, Jim Herrington, Harparkash Kaur, Patrick Lukulay, Mayfong Mayxay, Leonard Nyadong, Jayesh M. Pandit, Souly Phanouvong, Aline Plançon, Victor Pribluda, Anne-Lise Sauterey, Raffaella Ravinetto, Lukas Roth, Jitka Sabartova, David Schellenberg, Chanvilay Sichanh, Jeffery Smith, Ambrose Talisuna and Shunmay Yeung.
We thank the French Ministry of Foreign and European Affairs (FSP Mekong Project), the Bill and Melinda Gates Foundation and the Wellcome Trust of Great Britain for financial support.
The authors have declared that they have no competing interests.
PTE conducted the literature search, designed the database and the map, conducted the analysis and wrote the first draft. PNN designed the project, supported the literature search and provided scientific support. PG, FF and MG provided scientific support. All the authors read and approved the final manuscript.
Electronic supplementary material
Additional file 4: Number of surveys by medicine category and year of publication. (A total of 529 surveys are included in 130 reports). (TIFF 483 KB)
Additional file 7: Medicine quality category classification of failing samples. (Poor quality medicines may include many substandard medicines as this distinction cannot be reliably made without reference to packaging). (TIFF 483 KB)
Additional file 11: Description of failing samples and amount of active ingredient found in falsified, substandard and poor quality medicines. Samples that failed chemical assays, but without detection of wrong active ingredients and without packaging analysis, are classified as poor quality and not as falsified or substandard as this distinction cannot be reliably made without reference to the packaging. Poor quality medicines may therefore include many substandard medicines. (PNG 436 KB)
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
About this article
Cite this article
Tabernero, P., Fernández, F.M., Green, M. et al. Mind the gaps - the epidemiology of poor-quality anti-malarials in the malarious world - analysis of the WorldWide Antimalarial Resistance Network database. Malar J 13, 139 (2014). https://doi.org/10.1186/1475-2875-13-139
- Active Pharmaceutical Ingredient
- Artemisinin Combination Therapy
- Chemical Analysis Technique