- Open Access
Laboratory evaluation on the sensitivity and specificity of a novel and rapid detection method for malaria diagnosis based on magneto-optical technology (MOT)
Malaria Journal volume 9, Article number: 207 (2010)
This study describes the laboratory evaluation of a novel diagnostic platform for malaria. The Magneto Optical Test (MOT) is based on the bio-physical detection of haemozoin in clinical samples. Having an assay time of around one minute, it offers the potential of high throughput screening.
Blood samples of confirmed malaria patients from different regions of Africa, patients with other diseases and healthy non-endemic controls were used in the present study. The samples were analysed with two reference tests, i.e. an histidine rich protein-2 based rapid diagnostic test (RDT) and a conventional Pan-Plasmodium PCR, and the MOT as index test. Data were entered in 2 × 2 tables and analysed for sensitivity and specificity. The agreement between microscopy, RDT and PCR and the MOT assay was determined by calculating Kappa values with a 95% confidence interval.
The observed sensitivity/specificity of the MOT test in comparison with clinical description, RDT or PCR ranged from 77.2 - 78.8% (sensitivity) and from 72.5 - 74.6% (specificity). In general, the agreement between MOT and the other assays is around 0.5 indicating a moderate agreement between the reference and the index test. However, when RDT and PCR are compared to each other, an almost perfect agreement can be observed (k = 0.97) with a sensitivity and specificity of >95%.
Although MOT sensitivity and specificity are currently not yet at a competing level compared to other diagnostic test, such as PCR and RDTs, it has a potential to rapidly screen patients for malaria in endemic as well as non-endemic countries.
Initiation of malaria treatment largely depends on good, laboratory confirmed diagnosis. However, in many disease endemic countries clinical diagnosis is the only method used to decide whether or not to treat, since laboratory techniques to confirm the clinical suspicion are considered to be too labour-intensive or not sensitive enough [1, 2]. In general, screening of blood slides by microscopy is still considered to be the "gold standard". This method is cheap and simple but labour intensive, time consuming and requires well-trained personnel that can differentiate between the different Plasmodium species . In recent years, a variety of rapid diagnostic tests (RDTs), detecting circulating Plasmodium antigen(s) in the blood of a patient, has been developed for the diagnosis of malaria and are currently rolled out by the World Health Organization (WHO) . These tests are fast, easy to perform and do not require electricity or specific equipment [5–7], but may be limited in sensitivity (detecting only parasitaemia levels above 200 parasites/μl blood) and concerns have arisen about their stability . Alternative platforms to detect malaria are, therefore, still being developed.
One such platform for the fast (less than one minute) and easy detection of malaria parasites in a patient blood sample is the Magneto Optical Test (MOT) . Depending on its final sensitivity and specificity, the MOT could potentially be used as a diagnostic device in resource limited settings because of its robustness and the potential of working without electricity (as it can operate on a solar battery) or the need of a cold chain. It would also be suitable for the screening of returning travellers, military personnel returning from a mission or the detection of asymptomatic carriers in a cross sectional or epidemiological survey because of its high throughput nature and limited costs. The MOT principle is based on the following: after invasion of malarial parasites into erythrocytes, Plasmodium parasites digest the globin part of haemoglobin. The haem component, which is toxic to the parasite, is converted into haemozoin in the form of rod shaped nano-crystals which, if found in a patient, are indicative of malaria infection. Haemozoin is paramagnetic, i.e. it has a small and positive susceptibility to externally applied magnetic fields under the action of which it develops a small magnetic moment that is not retained when the field is removed [10–12]. When a magnetic field is applied across a potentially infected sample any haemozoin crystals present align within the field whereas in the absence of a field the crystals remain free to orient randomly under the thermal energy of their immediate environment [10–12]. This phenomenon, which is correctly referred to as the Cotton-Mouton effect, can be used to differentiate between a sample containing haemozoin and one without (Figure 1). Laser-based instrumentation able to quantify this phenomenon (Figure 2) has previously shown promising results when attempting the diagnosis of malaria in an experimental setup . To further evaluate the potential of this technology a more elaborate prototype MOT device has been built by one of the partners in the EU sponsored project: "Novel Magneto-Optical Biosensors for Malaria Diagnosis" (the European Commission Framework 6 Programme contract: 016494). This device was extensively evaluated in a laboratory-based trial using a broad spectrum of stored clinical samples and its performance is reported here.
The study population (Table 1) comprised blood samples (N = 217) obtained from patients visiting various health clinics in disease endemic countries (Sudan, Nigeria, Tanzania, Vietnam) or from returned travellers visiting the outpatient clinic of the Academic Medical Centre (Amsterdam, The Netherlands). All malaria patients were physically examined by experienced medical doctors and a confirmed diagnosis was obtained for each patient by reading of Giemsa-stained slides according to WHO recommendations . Healthy control samples were obtained from 100 blood donations at the Sanquin blood bank in Amsterdam, The Netherlands. By the criteria used to select blood donors (i.e. no physical complaints, no stay in malaria endemic countries for the last five years), it was ensured that these can be considered malaria negative. A small subset of samples with other diseases was included to measure specificity. All patients consented to participate in the study and ethical clearance from the appropriate authorities was obtained when necessary.
Sample collection and handling
From all patients and controls, 2 ml of venous EDTA blood was collected for DNA extraction and PCR analysis, immunochromatic histidine rich protein-2 (HRP-2) detection and MOT analysis. After collection the blood was stored at -20°C until further use. All blood samples were examined for the presence of Plasmodium DNA by conventional PCR detecting all four human plasmodium species, Plasmodium falciparum, Plasmodium vivax, Plasmodium ovale and Plasmodium malariae as described in previous publications and with a human household gene GAPDH to control for isolation and amplification . If no internal control appeared after amplification the PCR reaction was scored as invalid. The presence of HRP-2 indicating an active or recently passed infection with malaria was detected in 5 μl blood by an immunochromatic assay (RDT) (Paracheck, Orchid Biomedical Systems, Verna, Goa, India), according to the manufacturer's instructions and read after 15 minutes by two independent scientists. Both the RDT and PCR reactions were performed independently by experienced laboratory technicians familiar with the respective tests. Data was scored on a data sheet and communicated to the data manager who entered the data into the database.
All analytical MOT measurements were taken using an experimental instrument having the same specifications and operational methodology described previously (figure 3) . Prior to analysis, the samples were thawed and 100 μl transferred to an Eppendorf tube together with 400 μl cell lysis buffer (pH 7.5 Tris/HCl 50 mM, NaCl 150 mM, Nonidet P40 1%, Sodium deoxycholate 0.5%) before sonicating for 10 seconds. After processing in this manner samples were immediately passed to the MOT instrument operator, an experienced physicist blinded from the available clinical and diagnostic information, who transferred 150 μl of each to one of the glass bottomed sample cells used by the instrument. The cells were then introduced into the instrument and the measurement sequence for the Cotton-Mouton effect initiated. The magnitude of the Cotton-Mouton effect is proportional to the level of haemozoin present in the blood sample. A value measured above the noise floor of the instrument is positively indicative of malaria. The results of MOT testing (i.e. positive or negative) were communicated to a data manager who entered the information into the database.
Calibration of the MOT instrument was by a serial dilution of β-haematin in phosphate buffered saline (PBS) prior to the initial testing of the patient samples. The instrument is sensitive to the presence of haemozoin in the blood down to concentrations of 5 ng/μl or better which as discussed in  is considered to be equivalent to between 50 and 100 parasites/μl
Before final analysis of the data, samples for which insufficient clinical or analytical information was available were removed from the study. Microscopy performed at initial diagnosis is considered as the golden standard for malaria diagnosis. Results of the MOT assay are consequently tested against this standard and also compared to the RDT and PCR obtained data.
Data were entered in 2 × 2 tables and analysed for sensitivity (i.e. the probability that the assay will be positive when the infection is present) and specificity (i.e. the probability that the assay will be negative when the infection is absent) using the formulas:
In the equations above, TN represents true negative, TP true positive, FN false negative and FP false positive. In addition likelihood ratios (LR) were calculated. The agreement between microscopy, RDT and PCR and the MOT assay was determined by calculating Kappa values with a 95% confidence interval  using Epi-info version 6. Kappa values express the agreement beyond chance and a kappa value of 0.21-0.60 is a moderate, a kappa value of 0.61-0.80 a good and kappa > 0.80 an almost perfect agreement beyond chance.
In this retrospective laboratory-based evaluation, a total of 217 samples were analysed with three reference tests and the MOT as index test. Samples were collected in 2008 and analysed with MOT in July 2009. In total, 84 samples out of the 217 were confirmed (either microscopy or, in the case of the sickle cell patients, RDT and PCR positive) malaria positive. Parasitaemia of the positive samples ranged from 600 parasites/μl to 85,500 parasites/μl. When these samples were tested with MOT, 65 were scored positive (see Table 2). Seven of the samples analysed with MOT were inconclusive. However, in all the comparisons, the inconclusive results were regarded as negative. Omitting the inconclusive samples from the analysis did not give a significant difference. Of the 133 confirmed negatives, 100 were found negative with MOT giving a sensitivity of 78.3% and a specificity of 74.4%.
Also a direct comparison between the different alternative diagnostic methods (RDT and PCR) and MOT was done. When RDT results were compared to MOT, a sensitivity of 77.2% and a specificity of 72.5% were observed for the MOT test. For PCR, one sample could not be analysed, because the internal control was not amplified, leaving 216 samples for further analysis. If the inconclusive MOT results are not taken into consideration, then a sensitivity of 78.8% was found and a specificity of 74.6% for the MOT test.
Of the 30 samples from endemic negative controls, seven samples were found false positive with the MOT test while being negative with all other employed tests; they originated from Sudanese sickle cell patients. The Sudanese malaria confirmed patients that were missed in the MOT test (n = 17) had a parasitaemia ranging from 5,680 to 78,000 parasites/μl (mean: 32,615 parasites/μl). One sample from Vietnam missed with the MOT analysis had a parasitaemia of 10,000 parasites/μl. One sickle cell patient that was found positive with RDT and PCR for malaria was scored inconclusive with MOT.
In general with all comparisons, the agreement between MOT and the other assays was around 0.5, indicating a moderate agreement between the reference and the index test. However, when RDT and PCR were compared to each other only three samples out of the 216 samples that could be compared were discordant (two PCR negative RDT positive and one vice versa). Of the other samples 135 were negative by both tests and 78 positive by both tests thus showing an almost perfect agreement (k = 0.97), with a sensitivity and specificity of over 95% indicating that the reference tests are performing at a competing level. For a complete overview and statistical analysis of the different comparisons see Table 2, Table 3, Table 4 and Table 5.
This paper describes an extensive laboratory evaluation of a new and very rapid technology for the diagnosis of malaria by detecting the presence of haemozoin in the blood sample of suspected patients. Although several similar routes for the diagnosis of malaria via detection of the malarial pigment in a patient's blood have been explored in recent years this present technique uniquely utilises the magneto-optical properties of the blood-haemozoin system.
Automated blood count machines, such as Cell-Dyn® (Abbot, Santa Clara, California) utilize flow cytometry techniques to detect haemozoin-containing monocytes (PCM) during routine full blood count (FBC) in research settings but have not been applied in medical practice [16–18]. Such technology performs cell-by-cell analysis of the optical scattering properties of circulating cell suspension yielding information on cell size, internal structure, granularity and surface morphology. FBC results are analysed by visual inspection of granularity/lobularity plot on the instrument's display monitor with certain recorded scattering events considered to represent an HZ containing monocyte. In small trials [16–18], samples from endemic countries suffered from persisting haemozoin-containing white blood cells that resulted in false positive observations and, therefore, the true sensitivity and specificity of these automated methods still have to be confirmed. Significant adjustments to the current software and measurement algorithm of these apparatus have to be implemented to ensure user-friendliness and flag suspicious samples more clearly  while extending the measurement to a greater number of cells . However, it is deemed unlikely  that the cost (~$40,000), complexity and physical size of commercial flow cytometers will ever decrease sufficiently to get such apparatus to the resource-poor areas most affected by malaria where it is needed. In contrast, the MOT test accesses the total haemozoin load from a given blood sample, including PCM and PRBC, by performing a volumetric test using an apparatus whose relatively simpler measurement principle lends itself to the production of a rapid portable, battery operated point-of-care device at costs one or two order of magnitude lower than currently available Cell-Dyn® apparatus.
The MOT test described has been extensively tested in the present study on a large sample set of positive and negative samples and the results were compared against microscopy, RDTs detecting HRP-2 antigen and PCR. The performance, in terms of sensitivity and specificity, of RDT and PCR employed in the present evaluation was good since there was an almost perfect agreement between the comparative tests. The observed sensitivity/specificity of the MOT test in comparison with clinical description, RDT or PCR ranged from 72.5 - 74.6% (specificity) and from 77.2 - 78.8% (sensitivity) with a very low positive likelihood ratio between 2.8 and 3.0. Although in other studies false positivity is often attributed to circulating antigen from cleared parasites, this can in the present study only explain seven of the false positive samples. All these samples were obtained form Sudanese sickle cell patients that were negative with the other employed tests. It remains unclear whether the false positivity is caused by circulating antigen or is influenced by their sickle cell trait and this should be studied further on a larger set of samples of malaria negative endemic controls. The other false positive samples were obtained from healthy non-endemic controls. These non-endemic samples were obtained from healthy donors of the Dutch blood bank who have not traveled to a malaria endemic country within the last five years before their donation. The false positivity of this specific group of samples is concerning but is possibly attributable to contaminant structures introduced during the hand assembly of the sample cells which is currently conducted without quality control. Cells are fabricated from two components a thin glass window (7 mm in diameter) and a carbon injection moulded cylinder. The single use disposable cell is formed by using pre-cut adhesive inserts to cement the glass window to the cylinder. Although all sample cells were only used once and no contaminants form other samples could explain the false positivity, other contaminants introduced during assembly process, for example particles from the environment, which are free and able to respond to the application of a magnetic field will generate a false signal. Problems associated with sample cells can ultimately be easily addressed by employing an automated assembly and quality control procedure whilst further study on the response of various lysis buffers to magnetic field will fully characterize and possibly reduce their magneto-optical contribution such that changes to the measurement algorithm may be implemented to significantly reduce false positivity.
A substantial number (n = 19) of malaria confirmed cases are being missed by the MOT test. These samples all had a parasitaemia above 1,000 parasites/μl and should be readily detectable by the MOT instrument, which has an estimated analytical sensitivity of between 50 and 100 parasites/μl. There are several possible explanations for these false negatives; the most obvious being associated with the fact that the MOT diagnostic process was developed and calibrated using fresh blood samples spiked with β-haematin or live cultured parasitized red blood cells. The samples used in the present study had been stored at -20°C before testing and some had been freeze thawed several times. This may have caused agglutination of haemozoin crystals resulting in a non-homogenous sample and thus not representative anymore for the original sample. Furthermore, if the agglutinated crystals are not fully sonicated the mobility of the haemozoin under action of the magnetic field will be impaired. Either or both these effects could result in the Cotton-Mouton signal massively under representing the mass of haemozoin present and thus might result in a false negative signal. A second factor that currently further complicates the relationship between parasitaemia and haemozoin and which might also lead to false positivity or false negativity is the wide variation of haematocrit levels between patients. These can result in patients sampled at the same point in the parasites life cycle and found to have identical levels of parasitaemia registering vastly different levels of haemozoin. Variations in haematocrit also impact adversely on the measurement procedure by producing corresponding variations in sample transmittance and hence in the signal level and dynamic range recorded at the optical detector. None of the above issues are currently allowed for by the decision-making algorithms of the MOT instrumentation. Attention is drawn however to the point that although presented as a screening device, with a positive or negative diagnostic output, the MOT technique in returning a magneto-optic signal proportional to the haemozoin concentration (as evidenced by calibration data) together with an optical signal proportional to the haematocrit, offers a means of studying the complex inter-relationship between haemozoin, parasitaemia and haematocrit in blood samples. This may allow correlating haemozoin concentration against parasitaemia for the widest range of haematocrit levels experienced in practice. If necessary this process can be further extended to include the impact of other disease states such as anaemia on diagnostic sensitivity. These clinical parameters could be programmed into the decision-making algorithms of future MOT instrumentation and may substantially improve the performance of the instrument with respect to false reporting.
A commercially viable product must be able to compete with RDT and microscopy and the current sensitivity/specificity and predictive value of MOT is not yet at an appropriate level.
The principle limitations of the current study are the lack of fresh samples, lack of information on haemozoin and haemoglobin levels that may influence the outcome of the result, the limited amount of endemic controls and the influence of hand assembly of the sample cells making it difficult to asses the true potential of the device. These issues can however easily be addressed in a future trail. Having a large range of samples from the same setting with known malaria prevalence could give a better indication on its positive and negative predictive value which is not possible with the current sample set.
It is however very promising that the device has been designed and assembled in less than 3 years after the initial idea with still potential for substantial improvement in the design of the hard- and software. The simplicity of the device, low costs (a sample cell will only cost 25 euro cents), the straightforward operation with a limited number of handling steps and the possibility to operate the instrument without a constant supply of network electricity (i.e. it can operate on a battery) combined with the short assay time of 1 minute creates a technology with great potential for simple malaria screening in malaria endemic as well as non endemic countries.
This paper describes the evaluation of a novel and very rapid diagnostic device based Magneto Optical Technology (MOT) for the diagnosis of malaria by detecting haemozoin in a small patient blood sample. The MOT technology has been evaluated on a large panel of stored blood samples. Although the sensitivity and specificity are not yet at a competing level compared to other diagnostic test, such as microscopy and RDTs, it has a potential to rapidly screen patients for malaria in endemic as well as non-endemic countries. Therefore, the technique should be evaluated on a panel of fresh blood samples after the necessary adaptations of the device's algorithm.
Rowe AK, de León GF, Mihigo J, Santelli AC, Miller NP, Van-Dúnem P: Quality of malaria case management at outpatient health facilities in Angola. Malar J. 2009, 8: 275-10.1186/1475-2875-8-275.
Mens PF, Spieker N, Omar SA, Heijnen M, Schallig HDFH, Kager PA: Molecular biology the best alternative for diagnosis of malaria to microscopy? A comparison between microscopy, antigen detection and molecular tests in rural Kenya and urban Tanzania. Trop Med Int Health. 2007, 12: 238-244.
Reyburn H, Mbita R, Drakely C, Carneiro I, Mwakasungula E, Mwerinde O, Saganda K, Shao J, Kitua A, Olomi R, Greenwood BM, Whitty CJ: Overdiagnosis of malaria patients with severe febrile illness in Tanzania: a prospective study. BMJ. 2004, 329: 2121-10.1136/bmj.38251.658229.55.
World Health Organization/FIND: Malaria rapid diagnostic test performance: results of WHO product testing of malaria RDTs: round 1. 2008, WHO, Geneva
Mboera L, Fanello C, Malima R Talbert A, Fogliati P, Bobbio F, Molteni F: Comparison of the Paracheck-Pf® rest with microscopy, for the confirmation of Plasmodium falciparum malaria in Tanzania. Ann Trop Med Parasitol. 2006, 100: 115-122. 10.1179/136485906X78571.
Murray CK, Bell D, Gasser RA, Wongsrichanali C: Rapid diagnostic testing for malaria. Trop Med Int Health. 2003, 8: 876-883. 10.1046/j.1365-3156.2003.01115.x.
Murray CK, Bennett JW: Rapid diagnosis of malaria. Interdiscip Perspect Infect Dis. 2009, 1: 415953-
Ashley EA, Touabi M, Ahrer M, Hutagalung R, Htun K, Luchavez J, Dureza C, Proux S, Leimanis M, Lwin MM, Koscalova A, Comte E, Hamade P, Page AL, Nosten F, Guerin PJ: Evaluation of three parasite lactate dehydrogenase-based rapid diagnostic tests for the diagnosis of falciparum and vivax malaria. Malar J. 2009, 8: 241-10.1186/1475-2875-8-241.
Newman DM, Heptinstall J, Matelon RJ, Savage L, Wears ML, Beddow J, Cox M, Schallig HDFH, Mens PF: A magnetic-optic route towards the in-vivo diagnosis of malaria: preliminary results and pre-clinical trail data. Biophys J. 2008, 95: 994-1000. 10.1529/biophysj.107.128140.
Hackett S, Hamzah J, Davis TM, St Pierre TG: Magnetic susceptibility of iron in malaria-infected red blood cells. Biochim Biophys Acta. 2009, 1792: 93-99.
Fairlamb AH, Paul F, Warhurst DC: A simple magnetic method for the purification of malarial pigment. Mol Biochem Parasitol. 1984, 12: 307-312. 10.1016/0166-6851(84)90087-2.
Karl S, David M, Moore L, Grimberg BT, Michon P, Mueller I, Zborowski M, Zimmerman PA: Enhanced detection of gametocytes by magnetic deposition microscopy predicts higher potential for Plasmodium falciparum transmission. Malar J. 2008, 7: 66-10.1186/1475-2875-7-66.
World Health Organization WHO/CDS/RBM/2000.14: Malaria Diagnosis New Perspectives. In WHO/MAL/2000.1091-WHO. Basic malaria microscopy - part 1. 1991, WHO, Geneva, Switzerland
Mens PF, van Amerongen A, Sawa P, Kager PA, Schallig HDFH: Molecular diagnosis of malaria in the field: development of a novel, one-step nucleic acid lateral flow immuno-assay for the detection of all 4 human Plasmodium species and its evaluation in Mbita, Kenya. DMID. 2008, 61: 421-427.
Altman DG: Practical statistics for medical research. 1991, Chapman & Hall, London, 611-
Hänscheid T, Längin M, Lell B, Pötschke M, Oyakhirome S, Kremsner PG, Grobusch MP: Full blood count and haemozoin-containing leukocytes in children with malaria: diagnostic value and association with disease severity. Malar J. 2008, 7: 109-10.1186/1475-2875-7-109.
Hänscheid T, Frita R, Längin M, Kremsner PG, Grobusch MP: Is flow cytometry better in counting malaria pigment-containing leukocytes compared to microscopy?. Malar J. 2009, 8: 255-10.1186/1475-2875-8-255.
Hanscheid T, Valadas E, Grobusch MP: Automated malaria diagnosis using pigment detection. Parasitol Today. 2000, 16: 549-551. 10.1016/S0169-4758(00)01742-7.
Hänscheid T, Längin M, Codices V, Luty AJF, Adegnika AA, Kremsner PG, Grobusch MP: Automated detection of haemozoin-containing monocytes for the diagnosis of malaria in microscopically negative cases during pregnancy. Acta Trop. 2009, 109: 245-246. 10.1016/j.actatropica.2008.12.002.
Shapiro HM, Ulrich H: Cytometry in Malaria: From Research Tool to Practical Diagnostic Approach?. Cytometry. 2010, 77A: 500-501. 10.1002/cyto.a.20903.
We would like to thank all patients, blood donors and their families for their donation of blood for this study. We also thank our collaborators in Sudan, Nigeria, Tanzania, Vietnam and the Netherlands for their support in obtaining clinical material. We thank G. Schoone and I. Versteeg (KIT) for their assistance in the laboratory.
We would like to acknowledge all partners from the MOT consortium for their individual contributions and in particular Philips who built the instrument tested. This work has been performed under "Novel Magneto-Optical Biosensors for Malaria Diagnosis" of the European Commission Framework 6 Program http://www.mottest.org.
The authors declare that they have no competing interests.
PM designed the study, conducted PCR analysis, was involved in sample collection, performed data analysis and wrote the manuscript; RM participated in study design, assisted in designing and building the prototype, performed MOT tests and helped to draft the manuscript; BN supervised sample collection and performed microscopical analysis of clinical samples, commenting on the manuscript; HS study design, RDT analysis, mediated in sample collection and performed statistical analysis and helped in drafting the manuscript; DN conceived the MOT principle, supervision of MOT prototype design and production, writing of manuscript. All authors read and approved the final manuscript.
About this article
Cite this article
Mens, P.F., Matelon, R.J., Nour, B.Y. et al. Laboratory evaluation on the sensitivity and specificity of a novel and rapid detection method for malaria diagnosis based on magneto-optical technology (MOT). Malar J 9, 207 (2010). https://doi.org/10.1186/1475-2875-9-207
- Rapid Diagnostic Test
- Malaria Endemic Country
- Plasmodium Malariae
- Sickle Cell Patient