Laboratory evaluation on the sensitivity and specificity of a novel and rapid detection method for malaria diagnosis based on magneto-optical technology (MOT)
© Mens et al; licensee BioMed Central Ltd. 2010
Received: 18 March 2010
Accepted: 19 July 2010
Published: 19 July 2010
This study describes the laboratory evaluation of a novel diagnostic platform for malaria. The Magneto Optical Test (MOT) is based on the bio-physical detection of haemozoin in clinical samples. Having an assay time of around one minute, it offers the potential of high throughput screening.
Blood samples of confirmed malaria patients from different regions of Africa, patients with other diseases and healthy non-endemic controls were used in the present study. The samples were analysed with two reference tests, i.e. an histidine rich protein-2 based rapid diagnostic test (RDT) and a conventional Pan-Plasmodium PCR, and the MOT as index test. Data were entered in 2 × 2 tables and analysed for sensitivity and specificity. The agreement between microscopy, RDT and PCR and the MOT assay was determined by calculating Kappa values with a 95% confidence interval.
The observed sensitivity/specificity of the MOT test in comparison with clinical description, RDT or PCR ranged from 77.2 - 78.8% (sensitivity) and from 72.5 - 74.6% (specificity). In general, the agreement between MOT and the other assays is around 0.5 indicating a moderate agreement between the reference and the index test. However, when RDT and PCR are compared to each other, an almost perfect agreement can be observed (k = 0.97) with a sensitivity and specificity of >95%.
Although MOT sensitivity and specificity are currently not yet at a competing level compared to other diagnostic test, such as PCR and RDTs, it has a potential to rapidly screen patients for malaria in endemic as well as non-endemic countries.
Initiation of malaria treatment largely depends on good, laboratory confirmed diagnosis. However, in many disease endemic countries clinical diagnosis is the only method used to decide whether or not to treat, since laboratory techniques to confirm the clinical suspicion are considered to be too labour-intensive or not sensitive enough [1, 2]. In general, screening of blood slides by microscopy is still considered to be the "gold standard". This method is cheap and simple but labour intensive, time consuming and requires well-trained personnel that can differentiate between the different Plasmodium species . In recent years, a variety of rapid diagnostic tests (RDTs), detecting circulating Plasmodium antigen(s) in the blood of a patient, has been developed for the diagnosis of malaria and are currently rolled out by the World Health Organization (WHO) . These tests are fast, easy to perform and do not require electricity or specific equipment [5–7], but may be limited in sensitivity (detecting only parasitaemia levels above 200 parasites/μl blood) and concerns have arisen about their stability . Alternative platforms to detect malaria are, therefore, still being developed.
Overview of samples included in the evaluation of the MOT device.
Country of Origin
Number used for analysis
Microscopically confirmed malaria cases
Microscopically confirmed malaria cases
Sickle cell anaemia patients*
Sickle cell anaemia patients
Sickle cell anaemia patient
Visceral leishmaniasis patients (returning travels)
Sample collection and handling
From all patients and controls, 2 ml of venous EDTA blood was collected for DNA extraction and PCR analysis, immunochromatic histidine rich protein-2 (HRP-2) detection and MOT analysis. After collection the blood was stored at -20°C until further use. All blood samples were examined for the presence of Plasmodium DNA by conventional PCR detecting all four human plasmodium species, Plasmodium falciparum, Plasmodium vivax, Plasmodium ovale and Plasmodium malariae as described in previous publications and with a human household gene GAPDH to control for isolation and amplification . If no internal control appeared after amplification the PCR reaction was scored as invalid. The presence of HRP-2 indicating an active or recently passed infection with malaria was detected in 5 μl blood by an immunochromatic assay (RDT) (Paracheck, Orchid Biomedical Systems, Verna, Goa, India), according to the manufacturer's instructions and read after 15 minutes by two independent scientists. Both the RDT and PCR reactions were performed independently by experienced laboratory technicians familiar with the respective tests. Data was scored on a data sheet and communicated to the data manager who entered the data into the database.
Calibration of the MOT instrument was by a serial dilution of β-haematin in phosphate buffered saline (PBS) prior to the initial testing of the patient samples. The instrument is sensitive to the presence of haemozoin in the blood down to concentrations of 5 ng/μl or better which as discussed in  is considered to be equivalent to between 50 and 100 parasites/μl
Before final analysis of the data, samples for which insufficient clinical or analytical information was available were removed from the study. Microscopy performed at initial diagnosis is considered as the golden standard for malaria diagnosis. Results of the MOT assay are consequently tested against this standard and also compared to the RDT and PCR obtained data.
In the equations above, TN represents true negative, TP true positive, FN false negative and FP false positive. In addition likelihood ratios (LR) were calculated. The agreement between microscopy, RDT and PCR and the MOT assay was determined by calculating Kappa values with a 95% confidence interval  using Epi-info version 6. Kappa values express the agreement beyond chance and a kappa value of 0.21-0.60 is a moderate, a kappa value of 0.61-0.80 a good and kappa > 0.80 an almost perfect agreement beyond chance.
Results of confirmed malaria samples in comparison to the MOT results.
Also a direct comparison between the different alternative diagnostic methods (RDT and PCR) and MOT was done. When RDT results were compared to MOT, a sensitivity of 77.2% and a specificity of 72.5% were observed for the MOT test. For PCR, one sample could not be analysed, because the internal control was not amplified, leaving 216 samples for further analysis. If the inconclusive MOT results are not taken into consideration, then a sensitivity of 78.8% was found and a specificity of 74.6% for the MOT test.
Of the 30 samples from endemic negative controls, seven samples were found false positive with the MOT test while being negative with all other employed tests; they originated from Sudanese sickle cell patients. The Sudanese malaria confirmed patients that were missed in the MOT test (n = 17) had a parasitaemia ranging from 5,680 to 78,000 parasites/μl (mean: 32,615 parasites/μl). One sample from Vietnam missed with the MOT analysis had a parasitaemia of 10,000 parasites/μl. One sickle cell patient that was found positive with RDT and PCR for malaria was scored inconclusive with MOT.
Overview of the RDT results in comparison to the MOT results
Overview of the PCR results in comparison to the MOT results
Statistical analyses of the different comparisons excluding inconclusive PCR or MOT results
Sensitivity in %
Specificity in %
+ Likelihood ratio
- Likelihood ratio
Confirmed vs MOT
74.4 (65.8 -80.9)
RDT vs MOT
PCR vs MOT
PCR vs RDT
This paper describes an extensive laboratory evaluation of a new and very rapid technology for the diagnosis of malaria by detecting the presence of haemozoin in the blood sample of suspected patients. Although several similar routes for the diagnosis of malaria via detection of the malarial pigment in a patient's blood have been explored in recent years this present technique uniquely utilises the magneto-optical properties of the blood-haemozoin system.
Automated blood count machines, such as Cell-Dyn® (Abbot, Santa Clara, California) utilize flow cytometry techniques to detect haemozoin-containing monocytes (PCM) during routine full blood count (FBC) in research settings but have not been applied in medical practice [16–18]. Such technology performs cell-by-cell analysis of the optical scattering properties of circulating cell suspension yielding information on cell size, internal structure, granularity and surface morphology. FBC results are analysed by visual inspection of granularity/lobularity plot on the instrument's display monitor with certain recorded scattering events considered to represent an HZ containing monocyte. In small trials [16–18], samples from endemic countries suffered from persisting haemozoin-containing white blood cells that resulted in false positive observations and, therefore, the true sensitivity and specificity of these automated methods still have to be confirmed. Significant adjustments to the current software and measurement algorithm of these apparatus have to be implemented to ensure user-friendliness and flag suspicious samples more clearly  while extending the measurement to a greater number of cells . However, it is deemed unlikely  that the cost (~$40,000), complexity and physical size of commercial flow cytometers will ever decrease sufficiently to get such apparatus to the resource-poor areas most affected by malaria where it is needed. In contrast, the MOT test accesses the total haemozoin load from a given blood sample, including PCM and PRBC, by performing a volumetric test using an apparatus whose relatively simpler measurement principle lends itself to the production of a rapid portable, battery operated point-of-care device at costs one or two order of magnitude lower than currently available Cell-Dyn® apparatus.
The MOT test described has been extensively tested in the present study on a large sample set of positive and negative samples and the results were compared against microscopy, RDTs detecting HRP-2 antigen and PCR. The performance, in terms of sensitivity and specificity, of RDT and PCR employed in the present evaluation was good since there was an almost perfect agreement between the comparative tests. The observed sensitivity/specificity of the MOT test in comparison with clinical description, RDT or PCR ranged from 72.5 - 74.6% (specificity) and from 77.2 - 78.8% (sensitivity) with a very low positive likelihood ratio between 2.8 and 3.0. Although in other studies false positivity is often attributed to circulating antigen from cleared parasites, this can in the present study only explain seven of the false positive samples. All these samples were obtained form Sudanese sickle cell patients that were negative with the other employed tests. It remains unclear whether the false positivity is caused by circulating antigen or is influenced by their sickle cell trait and this should be studied further on a larger set of samples of malaria negative endemic controls. The other false positive samples were obtained from healthy non-endemic controls. These non-endemic samples were obtained from healthy donors of the Dutch blood bank who have not traveled to a malaria endemic country within the last five years before their donation. The false positivity of this specific group of samples is concerning but is possibly attributable to contaminant structures introduced during the hand assembly of the sample cells which is currently conducted without quality control. Cells are fabricated from two components a thin glass window (7 mm in diameter) and a carbon injection moulded cylinder. The single use disposable cell is formed by using pre-cut adhesive inserts to cement the glass window to the cylinder. Although all sample cells were only used once and no contaminants form other samples could explain the false positivity, other contaminants introduced during assembly process, for example particles from the environment, which are free and able to respond to the application of a magnetic field will generate a false signal. Problems associated with sample cells can ultimately be easily addressed by employing an automated assembly and quality control procedure whilst further study on the response of various lysis buffers to magnetic field will fully characterize and possibly reduce their magneto-optical contribution such that changes to the measurement algorithm may be implemented to significantly reduce false positivity.
A substantial number (n = 19) of malaria confirmed cases are being missed by the MOT test. These samples all had a parasitaemia above 1,000 parasites/μl and should be readily detectable by the MOT instrument, which has an estimated analytical sensitivity of between 50 and 100 parasites/μl. There are several possible explanations for these false negatives; the most obvious being associated with the fact that the MOT diagnostic process was developed and calibrated using fresh blood samples spiked with β-haematin or live cultured parasitized red blood cells. The samples used in the present study had been stored at -20°C before testing and some had been freeze thawed several times. This may have caused agglutination of haemozoin crystals resulting in a non-homogenous sample and thus not representative anymore for the original sample. Furthermore, if the agglutinated crystals are not fully sonicated the mobility of the haemozoin under action of the magnetic field will be impaired. Either or both these effects could result in the Cotton-Mouton signal massively under representing the mass of haemozoin present and thus might result in a false negative signal. A second factor that currently further complicates the relationship between parasitaemia and haemozoin and which might also lead to false positivity or false negativity is the wide variation of haematocrit levels between patients. These can result in patients sampled at the same point in the parasites life cycle and found to have identical levels of parasitaemia registering vastly different levels of haemozoin. Variations in haematocrit also impact adversely on the measurement procedure by producing corresponding variations in sample transmittance and hence in the signal level and dynamic range recorded at the optical detector. None of the above issues are currently allowed for by the decision-making algorithms of the MOT instrumentation. Attention is drawn however to the point that although presented as a screening device, with a positive or negative diagnostic output, the MOT technique in returning a magneto-optic signal proportional to the haemozoin concentration (as evidenced by calibration data) together with an optical signal proportional to the haematocrit, offers a means of studying the complex inter-relationship between haemozoin, parasitaemia and haematocrit in blood samples. This may allow correlating haemozoin concentration against parasitaemia for the widest range of haematocrit levels experienced in practice. If necessary this process can be further extended to include the impact of other disease states such as anaemia on diagnostic sensitivity. These clinical parameters could be programmed into the decision-making algorithms of future MOT instrumentation and may substantially improve the performance of the instrument with respect to false reporting.
A commercially viable product must be able to compete with RDT and microscopy and the current sensitivity/specificity and predictive value of MOT is not yet at an appropriate level.
The principle limitations of the current study are the lack of fresh samples, lack of information on haemozoin and haemoglobin levels that may influence the outcome of the result, the limited amount of endemic controls and the influence of hand assembly of the sample cells making it difficult to asses the true potential of the device. These issues can however easily be addressed in a future trail. Having a large range of samples from the same setting with known malaria prevalence could give a better indication on its positive and negative predictive value which is not possible with the current sample set.
It is however very promising that the device has been designed and assembled in less than 3 years after the initial idea with still potential for substantial improvement in the design of the hard- and software. The simplicity of the device, low costs (a sample cell will only cost 25 euro cents), the straightforward operation with a limited number of handling steps and the possibility to operate the instrument without a constant supply of network electricity (i.e. it can operate on a battery) combined with the short assay time of 1 minute creates a technology with great potential for simple malaria screening in malaria endemic as well as non endemic countries.
This paper describes the evaluation of a novel and very rapid diagnostic device based Magneto Optical Technology (MOT) for the diagnosis of malaria by detecting haemozoin in a small patient blood sample. The MOT technology has been evaluated on a large panel of stored blood samples. Although the sensitivity and specificity are not yet at a competing level compared to other diagnostic test, such as microscopy and RDTs, it has a potential to rapidly screen patients for malaria in endemic as well as non-endemic countries. Therefore, the technique should be evaluated on a panel of fresh blood samples after the necessary adaptations of the device's algorithm.
We would like to thank all patients, blood donors and their families for their donation of blood for this study. We also thank our collaborators in Sudan, Nigeria, Tanzania, Vietnam and the Netherlands for their support in obtaining clinical material. We thank G. Schoone and I. Versteeg (KIT) for their assistance in the laboratory.
We would like to acknowledge all partners from the MOT consortium for their individual contributions and in particular Philips who built the instrument tested. This work has been performed under "Novel Magneto-Optical Biosensors for Malaria Diagnosis" of the European Commission Framework 6 Program http://www.mottest.org.
- Rowe AK, de León GF, Mihigo J, Santelli AC, Miller NP, Van-Dúnem P: Quality of malaria case management at outpatient health facilities in Angola. Malar J. 2009, 8: 275-10.1186/1475-2875-8-275.PubMed CentralView ArticlePubMedGoogle Scholar
- Mens PF, Spieker N, Omar SA, Heijnen M, Schallig HDFH, Kager PA: Molecular biology the best alternative for diagnosis of malaria to microscopy? A comparison between microscopy, antigen detection and molecular tests in rural Kenya and urban Tanzania. Trop Med Int Health. 2007, 12: 238-244.PubMedGoogle Scholar
- Reyburn H, Mbita R, Drakely C, Carneiro I, Mwakasungula E, Mwerinde O, Saganda K, Shao J, Kitua A, Olomi R, Greenwood BM, Whitty CJ: Overdiagnosis of malaria patients with severe febrile illness in Tanzania: a prospective study. BMJ. 2004, 329: 2121-10.1136/bmj.38251.658229.55.View ArticleGoogle Scholar
- World Health Organization/FIND: Malaria rapid diagnostic test performance: results of WHO product testing of malaria RDTs: round 1. 2008, WHO, GenevaGoogle Scholar
- Mboera L, Fanello C, Malima R Talbert A, Fogliati P, Bobbio F, Molteni F: Comparison of the Paracheck-Pf® rest with microscopy, for the confirmation of Plasmodium falciparum malaria in Tanzania. Ann Trop Med Parasitol. 2006, 100: 115-122. 10.1179/136485906X78571.View ArticlePubMedGoogle Scholar
- Murray CK, Bell D, Gasser RA, Wongsrichanali C: Rapid diagnostic testing for malaria. Trop Med Int Health. 2003, 8: 876-883. 10.1046/j.1365-3156.2003.01115.x.View ArticlePubMedGoogle Scholar
- Murray CK, Bennett JW: Rapid diagnosis of malaria. Interdiscip Perspect Infect Dis. 2009, 1: 415953-Google Scholar
- Ashley EA, Touabi M, Ahrer M, Hutagalung R, Htun K, Luchavez J, Dureza C, Proux S, Leimanis M, Lwin MM, Koscalova A, Comte E, Hamade P, Page AL, Nosten F, Guerin PJ: Evaluation of three parasite lactate dehydrogenase-based rapid diagnostic tests for the diagnosis of falciparum and vivax malaria. Malar J. 2009, 8: 241-10.1186/1475-2875-8-241.PubMed CentralView ArticlePubMedGoogle Scholar
- Newman DM, Heptinstall J, Matelon RJ, Savage L, Wears ML, Beddow J, Cox M, Schallig HDFH, Mens PF: A magnetic-optic route towards the in-vivo diagnosis of malaria: preliminary results and pre-clinical trail data. Biophys J. 2008, 95: 994-1000. 10.1529/biophysj.107.128140.PubMed CentralView ArticlePubMedGoogle Scholar
- Hackett S, Hamzah J, Davis TM, St Pierre TG: Magnetic susceptibility of iron in malaria-infected red blood cells. Biochim Biophys Acta. 2009, 1792: 93-99.View ArticlePubMedGoogle Scholar
- Fairlamb AH, Paul F, Warhurst DC: A simple magnetic method for the purification of malarial pigment. Mol Biochem Parasitol. 1984, 12: 307-312. 10.1016/0166-6851(84)90087-2.View ArticlePubMedGoogle Scholar
- Karl S, David M, Moore L, Grimberg BT, Michon P, Mueller I, Zborowski M, Zimmerman PA: Enhanced detection of gametocytes by magnetic deposition microscopy predicts higher potential for Plasmodium falciparum transmission. Malar J. 2008, 7: 66-10.1186/1475-2875-7-66.PubMed CentralView ArticlePubMedGoogle Scholar
- World Health Organization WHO/CDS/RBM/2000.14: Malaria Diagnosis New Perspectives. In WHO/MAL/2000.1091-WHO. Basic malaria microscopy - part 1. 1991, WHO, Geneva, SwitzerlandGoogle Scholar
- Mens PF, van Amerongen A, Sawa P, Kager PA, Schallig HDFH: Molecular diagnosis of malaria in the field: development of a novel, one-step nucleic acid lateral flow immuno-assay for the detection of all 4 human Plasmodium species and its evaluation in Mbita, Kenya. DMID. 2008, 61: 421-427.Google Scholar
- Altman DG: Practical statistics for medical research. 1991, Chapman & Hall, London, 611-Google Scholar
- Hänscheid T, Längin M, Lell B, Pötschke M, Oyakhirome S, Kremsner PG, Grobusch MP: Full blood count and haemozoin-containing leukocytes in children with malaria: diagnostic value and association with disease severity. Malar J. 2008, 7: 109-10.1186/1475-2875-7-109.PubMed CentralView ArticlePubMedGoogle Scholar
- Hänscheid T, Frita R, Längin M, Kremsner PG, Grobusch MP: Is flow cytometry better in counting malaria pigment-containing leukocytes compared to microscopy?. Malar J. 2009, 8: 255-10.1186/1475-2875-8-255.PubMed CentralView ArticlePubMedGoogle Scholar
- Hanscheid T, Valadas E, Grobusch MP: Automated malaria diagnosis using pigment detection. Parasitol Today. 2000, 16: 549-551. 10.1016/S0169-4758(00)01742-7.View ArticlePubMedGoogle Scholar
- Hänscheid T, Längin M, Codices V, Luty AJF, Adegnika AA, Kremsner PG, Grobusch MP: Automated detection of haemozoin-containing monocytes for the diagnosis of malaria in microscopically negative cases during pregnancy. Acta Trop. 2009, 109: 245-246. 10.1016/j.actatropica.2008.12.002.View ArticlePubMedGoogle Scholar
- Shapiro HM, Ulrich H: Cytometry in Malaria: From Research Tool to Practical Diagnostic Approach?. Cytometry. 2010, 77A: 500-501. 10.1002/cyto.a.20903.View ArticleGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.