Skip to main content

Ethical considerations in malaria research proposal review: empirical evidence from 114 proposals submitted to an Ethics Committee in Thailand

Abstract

Background

Malaria research is typically conducted in developing countries in areas of endemic disease. This raises specific ethical issues, including those related to local cultural concepts of health and disease, the educational background of study subjects, and principles of justice at the community and country level. Research Ethics Committees (RECs) are responsible for regulating the ethical conduct of research, but questions have been raised whether RECs facilitate or impede research, and about the quality of REC review itself. This study examines the review process for malaria research proposals submitted to the Ethics Committee of the Faculty of Tropical Medicine at Mahidol University, Thailand.

Methods

Proposals for all studies submitted for review from January 2010 to December 2014 were included. Individual REC members’ reviewing forms were evaluated. Ethical issues (e.g., scientific merit, risk–benefit, sample size, or informed-consent) raised in the forms were counted and analysed according to characteristics, including study classification/design, use of specimens, study site, and study population.

Results

All 114 proposals submitted during the study period were analysed, comprising biomedical studies (17 %), drug trials (13 %), laboratory studies (24 %) and epidemiological studies (46 %). They included multi-site (13 %) and international studies (4 %), and those involving minority populations (28 %), children (17 %) and pregnant women (7 %). Drug trials had the highest proportion of questions raised for most ethical issues, while issues concerning privacy and confidentiality tended to be highest for laboratory and epidemiology studies. Clarifications on ethical issues were requested by the ethics committee more for proposals involving new specimen collection. Studies involving stored data and specimens tended to attract more issues around privacy and confidentiality. Proposals involving minority populations were more likely to raise issues than those that did not. Those involving vulnerable populations were more likely to attract concerns related to study rationale and design.

Conclusions

This study stratified ethical issues raised in a broad spectrum of research proposals. The Faculty of Tropical Medicine at Mahidol University is a significant contributor to global malaria research output. The findings shed light on the ethical review process that may be useful for stakeholders, including researchers, RECs and sponsors, conducting malaria research in other endemic settings.

Background

Malaria research is predominantly conducted in developing countries, corresponding to endemic areas of the disease. Over the past few decades, there have been ongoing concerns and arguments on research ethics. These issues are related to the over- or under-protection of human subjects in drug and vaccine clinical trials, as well as non-clinical studies carried out in disease burden areas [16]. Concerns raised include the balance between ethics and science, patient risks and benefits, individuals’ educational background and local concepts of health and disease, ethical justice principles at the community and country level, and even arguments around the Hippocratic dictum ‘primum non nocere’ [1, 2, 5]. Regarding research ethics in developing countries, it is a reasonable notion that regardless of where the research is conducted, not only should the quality be the same, but also that study participants are equally valued and respected [7]. Despite the generic ethical principles that can be applied to healthcare-related research, there has been debate about the application of such principles in different research settings because socio-cultural and economic contexts vary considerably around the world [2, 7].

In attempting to prohibit malpractice of human experiments in the medical community, the “Declaration of Helsinki” was initially adopted in 1964 and has undergone several revisions since. The Declaration introduced the concept of an independent committee; it stated explicitly that the research protocol must be submitted to the concerned research ethics committee for consideration, comment, guidance, and approval before the study begins [8]. The research ethics committee (REC) must be qualified, independent, and have no conflict of interest when reviewing the research protocol. This evolved into the term “institutional review board” (IRB) used in the US. The IRB concept was established after the U.S. National Research Act (1974), and the Belmont Report (1979), stating its purpose to protect human subjects involved in both clinical and behavioural research [9]. The IRB Guidebook [10] was developed by the US Office for Human Research Protections (OHRP) and is one of the resources that ethics committees across the globe adopt for their own operations. It includes issues of IRB administration, regulation and policies, protocol review mechanisms and other ethical principles. Similarly, the European Union Clinical Trials Directive regards the research ethics committee as an independent body with responsibility to protect the rights, safety, and well-being of human subjects involved in a research study [11]. The terms IRB and REC are often used interchangeably, but arguably have somewhat different meanings; according to the ICH Guideline [12]: IRB could be a subsection of REC (a review board or a committee, institutional, regional, national, or supranational), but the IRB or REC plays a major role in regulating the ethical conduct of research by reviewing research proposals before the research is carried out. While judging whether the proposal is worthwhile and ethical, part of the committee’s role may also be to provide constructive recommendations to researchers in an attempt to maintain high-quality, ethical research [8, 1012].

With its role in ethical review of research proposals, questions have been raised about whether the REC is facilitating or impeding the advancement of scientific research, and there have been comments from researchers regarding the quality of the REC review itself [13]. Some investigators in international or multicentre studies have complained of substantial inefficiencies in REC review, and have requested that RECs pay more attention to scientific integrity alongside the protection of human subjects involved in the study [14]. Investigators have also raised concerns that REC review burdens have grown to include studies involving interviews, secondary use of public-use data and similar activities, most of which involve minimal risks [9]. Criticism has also been raised regarding the REC requirement for paperwork and mechanical monitoring, which may undermine the main goal of the protection of human subjects [9]. With the emergence of new fields in biomedical research and technology, particularly in genetics and genomics, a range of views exist within and between RECs and the research groups in these evolving fields [15]. This reflects the complexity and diversity and lack of common ground surrounding many ethical issues related to this type of research [15, 16].

In assessing ethical quality in protocol review—particularly the oversight of human subject research—RECs and other stakeholders, including sponsors, regulators and the public, need to have evidence-based information [17, 18]. Several proxy indicators of ethical quality assessment have been proposed. Some suggest using measurement parameters and/or quality metrics including objective and subjective quality assessment, which can be used to improve REC review and deliberation processes, and strengthen relationships between the REC and researchers [13, 19]. It has been suggested that ethnographic studies on REC meetings and minutes could help identify the critical ethical issues that the REC considers when reviewing proposals, thus determining whether ethical principles have been thoroughly considered [14].

An analysis of malaria publication data (2010–2014) in the SciVal database, to which Mahidol University subscribes, found that Mahidol University (Thailand) ranked #4 (with 450 papers) for number of research studies. Of these, the Faculty of Tropical Medicine, Mahidol University contributed 87 % (with 391 papers), correlating to a ranking of #6 if counted as an independent institute. To promote the conduct of research at FTM, the Office of Research Services (ORS) provides administrative services to the faculty’s research community. One of its major functions is as the Secretariat to the FTM Ethics Committee (FTM-EC), managing the operations of Ethics Committee meetings. The FTM-EC has been continuously registered with the Federal-wide Assurance (FWA) of the US OHRP since 2002. The FTM-EC comprises one clinical and one non-clinical panel, which convene at monthly meetings.

Given the level of malaria research output and ethics committee activity at the FTM, it is an ideal location to examine the REC review process for malaria research. Therefore, this study attempts to reveal how malaria research studies conducted in Southeast Asia (along the Thai borders) were reviewed by the local REC, the FTM-EC. In particular, the purpose of this study was to identify the ethical considerations for different types of malaria research proposals submitted to the FTM-EC during the period 2010–2014.

Methods

Dimensions of ethical consideration

In reviewing research proposals, REC members should base their judgment on international standards of ethical concerns pertaining to moral values including dignity, bodily integrity, autonomy, and privacy. Such ethical concerns are listed in several guidelines for REC review, and although they might be expressed differently in varying circumstances, similar principles are often cited [11, 2024]. The World Health Organization (WHO) [22] states in its standards for ethical review that the approval or disapproval of the protocol should be based on the ethical acceptability of the research while accounting for its social value, scientific validity, and applicable laws. As stated in the guidelines of the Council for International Organizations of Medical Sciences (CIOMS) [21], all research involving human subjects should be in accordance with the moral weight of the three basic ethical principles: respect for persons, beneficence, and justice. The European guidelines [11] suggest four main components of a research ethics committee: dignity, bodily integrity, autonomy, and privacy. The European Commission [23] even suggests that researchers pre-check their proposal to ensure that it follows the principles of human dignity, fair distribution of research benefits and burden, and protection of the values, rights, and interests of the research participants. The UK Health Department [24] provides guidance in governance arrangements for RECs in reviewing research proposals to act as part of an efficient, accountable, and independent body in protecting the dignity, rights, safety, and well-being of people who take part in research. The US IRB Guideline on basic IRB review [25] discusses issues of human subject research, in particular for risk–benefit analysis, monitoring and observation, informed consent and additional safeguards, selection of subjects, incentives for participation, and privacy and confidentiality.

Ethics is not about prescribing a specific set of rules or policies, rather it is about providing a framework for evaluating problems and determining an appropriate course of action [26]. According to the WHO manual for capacity training for RECs [26], the ethical analysis is to identify a set of governing principles reflecting both internationally accepted norms and locally relevant cultural values, and then apply such principles to evaluate the research. Several frameworks for ethical research conducted in developing countries have been proposed, focusing on collaborative partnerships and sharing responsibilities with researchers, policy-makers and the community [2, 21, 26, 27]. The framework should be based on the notation set forth in the Declaration of Helsinki so that ethical principles could be effectively identified and applied, particularly in developing countries in regards to each country’s socioeconomic circumstances, laws and regulations, and executive and administrative arrangements [21]. Proposed basic ethical principles include: (1) considering social value by specifying the beneficiaries of the research, (2) ensuring scientific validity through the scientific design and research objectives, (3) fair study population selection to ensure scientific validity, (4) assessment of the risk–benefit ratio by comparing the net risks of the research project with the potential benefits, (5) ensuring public accountability through independent reviews mandated by laws and regulations, (6) ensuring informed consent while involving the community in establishing recruitment procedures and incentives, and (7) respecting study participants and communities [2, 26, 27].

In particular, ethical issues that should be considered as part of malaria field studies in developing countries have been discussed as lessons learned in a community-based clinical trial of rectal artesunate conducted in a few developing countries [28]. Issues to consider include the ethical review process, standard of care, incentives and reimbursement, and insurance and indemnity. It has also been suggested that local ethical review should consider the vulnerability of patients with no or poor access to healthcare, specific cultural attitudes, literacy, and both local written and oral languages [28]. A study on convergent ethical issues in HIV/AIDS, TB, and malaria vaccine trials in Africa revealed that sharing simple and effective consent form templates and procedures across diseases was achievable [29]. Comprehension testing of subjects prior to and during study participation, to ensure understanding of the important study concepts, has also been proposed [28]. Moreover, it has been suggested that the REC should also examine the suitability of the investigators and the adequacy of facilities and the methods and documentation to be used in the study [11].

At the FTM-EC, individual REC members are provided with a review form prior to every convened meeting. The review form outlines certain ethical issues similar to those described above. Each member uses this form as a guide to ethical issues to consider when reading the proposal. They then complete each part that he/she considers relevant and requires explanations from the researchers. The form also has an open-ended component, where the REC can note other ethical considerations. The review form used during the study period (currently the form has been revised) guiding the REC members in reviewing each protocol was composed of 19 check boxes for close-ended items on being a human research subject study: types of study (clinical, epidemiological, social science, or behavioural); reasonable scientific questions/objectives; proper sampling techniques/data collection methods; quality of investigators/facilities; project budget; compensation; justification of the involvement of vulnerable populations; rationale for use of human specimen; adequate toxicological/pharmaceutical information; sufficient provision of information and proper informed consent process and forms; rating on level of risk and benefit of the study; and the overall ethical acceptability of the proposal. The review form also consists of 9 open-ended comment items regarding project summary (to be filled in by two primary reviewers) and other ethical issues (to be filled by all REC members) including major points of concern, levels of risk, comments on the title, proposal content (objectives, research methodology, protection of privacy and confidentiality), participation information sheet, informed consent/assent form, questionnaire/advertisement/case record form, attached document (investigator’s brochure, material transfer, etc.), and other comments/suggestions. For the purpose of this study, the ethical issues were divided into six dimensions, as follows: (1) study rationale and validity; (2) study design; (3) study participants; (4) informed consent process; (5) data collection and analysis; and (6) facility and support. Each dimension thus covers its related ethical considerations in the review form (as presented in the “Results” section).

Classification of malaria research studies

Research protocols reviewed by RECs can be categorized according to different schemes [22, 30, 31]. The European Science Foundation [31] reviews health research classification systems in different countries across continents. The UK Health Research Classification System (HRCS) for classifying and analyzing biomedical and health research funding applies a two-dimensional framework. Codes on health categories are used to classify the type of health or disease being studied, covering 21 categories encompassing all diseases, conditions and areas of health. Research activity codes are used to classify the type of research activity being undertaken (from basic to applied), covering 48 codes of eight subgroups: (1) Underpinning, (2) Aetiology, (3) Prevention, (4) Detection and Diagnosis, (5) Treatment Development, (6) Treatment Evaluation, (7) Disease Management, and (8) Health Services. The Australian and New Zealand research classification scheme has been developed and updated over the years. The three constituent classifications in use are: (1) Type of Activity (ToA)—pure basic research, strategic basic research, applied research and experimental development; (2) Field of Research (FoR)—methodology used in research and development (R&D) fields of the research investigated by institutions and organizations as well as emerging areas of study; and (3) Socio-economic objective (SEO) consisting of discrete economic, social, technological or scientific domains for identifying the principal purposes of R&D.

On the other hand, the WHO [22] simply classifies different types of research studies to be reviewed by RECs, including, but not limited to, the following: (1) clinical trials, (2) epidemiological research, (3) social science research, (4) research on medical records or other personal information, (5) research on stored samples, (6) health systems research, and (7) implementation research. The US Office for Human Research Protections [30] categorized research reviewed by IRBs as either biomedical or behavioural studies. Biomedical research covers two types of studies: (1) those designed primarily to generate scientific knowledge about the natural history of the disease and normal or abnormal physiology, and (2) studies designed primarily to evaluate the development of medical products and the efficacy, effectiveness, efficiency and safety of a medical intervention. Behavioural research includes studies of the epidemiology and social science of individual or group behaviour. As part of the biomedical research study, clinical trials, which often originate in the laboratory to develop new therapies or procedures, are tested in animal studies, then subsequently on human subjects [32]. The US National Institutes of Health (NIH) distinguishes between different types of clinical trials including, for example, natural history studies, prevention, screening, diagnostic, treatment, or quality of life trials [32]. Biomedical research can be sub-classified as basic/pre-clinical research or clinical research [33].

Many RECs face challenges in the protocol review of studies in the fields of molecular and genetic or genomic research. Lack of clarity on how researchers should respond to RECs has been reported, particularly concerning issues of informed consent and the use of archived specimens [20, 34]. Confusion and debate remains within and across RECs around studies involving the collection and use of non-identifiable stored tissue specimens. There is disharmony among regulatory requirements in different countries and REC bodies within countries, but there is a growing international agreement on the provision and access to research data and bio-specimen collections in order to optimize their long-term value and potential for health discovery and validation [3537]. The UK Medical Research Council [35] proposed operational and ethical guidelines for the use of human tissue and biological samples, such that samples of human biological material should be treated as donations, and research involving these should be conducted with respect and transparency. The research study should be planned with respect to the trust of the potential donors with individual, cultural, or religious differences in the meaning and significance attached to samples for use.

With contradictory legal and ethical frameworks across national borders, there has been an attempt to set up an international charter of principles for sharing bio-specimens and data [36]. The following five principles include major ethical considerations: (1) respect for privacy and autonomy, (2) reciprocity, (3) freedom of scientific enquiry, (4) attribution, and (5) respect for intellectual property. In the US, the Food and Drug Administration has set rules and regulations regarding the use of identifiable and unidentifiable specimens for clinical investigators, sponsors, and RECs. The US Health Insurance Portability and Accountability Act privacy rule has set less restrictive rules for the use of stored specimens and tissue repositories (such as biobanks), when released data have been de-identified [20]. The UK Medical Research Council [35] emphasizes custodianship as the responsibility of researchers for safe keeping of samples and control of their use and eventual disposal, defining “anonymized samples or data” where all identifying information is removed, either as linked or unlinked anonymous data and samples; and “coded samples or data” where a code is used in place of identifiers to protect the confidentiality of the individual during routine use. The American Society of Human Genetics distinguishes between retrospective and prospective studies, such that the “retrospective research studies” utilise previously obtained samples collected for a purpose that is different from that of the current proposal and the “prospective research studies” are those in which the collection of the new samples is part of the current study design [37]. Similarly, four types of sample identification were defined: (1) anonymous, no identifiers and impossible to link with their sources, (2) anonymised, originally with identified information but irreversibly stripped off and are impossible to link to their sources, (3) identifiable, unidentified for the current research purposes, but can be linked to their sources, and (4) identified, with identifiers and are attached and available to the researchers [37]. In Thailand, however, the use of specimens or medical records, either identifiable or unidentifiable, is considered to be human subject research. Studies involving such material commonly require REC review, either full-board or expedited, and very few receive exemption.

The two panels of the FTM-EC comprise different sets of members. The “clinical panel” reviews clinical research studies involving the application of any clinical interventions in human research subjects, while the “non-clinical panel” reviews other types of biomedical study, including research conducted in clinical settings but where no clinical intervention was applied, epidemiological studies, and studies that use stored specimen or secondary data. Malaria study proposals submitted to the FTM-EC fall into either of the categories and are reviewed by the relevant panel. Because these two broad categories of research might be subject to different constraint levels of ethical consideration, reviewed studies were classified for the purposes of this study in two ways. For classification based on research study design, there are four categories: (1) clinical (drug) trials; (2) biomedical studies; (3) laboratory studies, and (4) epidemiological/social science studies. For classification based on the use and non-use of specimens, there are four categories: (1) new specimen collection; (2) use of archived un-identifiable/un-linked specimens; (3) use of archived/identifiable/linked specimens; and (4) use of medical records and new data collection.

Sources of information and statistical analysis

This study adopts the process of internal audits on quality systems of independent ethics committees in Europe [38], by conducting documentation reviews. The reviewed documentation included minutes of meetings and agendas, each individual REC member’s reviewing form, and the notifications to researchers informing them of the review outcome for the submitted proposal. This study was conducted by the office managing the submitted proposals and the REC members at the FTM-EC. Information was extracted by personnel authorized to access these documents. To avoid bias, three office employees (non-voting members of the FTM-EC), were assigned to identify the main ethical considerations noted by each REC member on his/her review form, while cross-checking with each other. Ethical considerations raised were counted quantitatively whether the ethical issues (e.g. scientific merit, risk and benefit, sample size, or informed-consent process) were noted/discussed, both in the pre-specified and open-ended items, on each individual REC member’s review form as well as all other documents related to the submitted proposal. It should be noted that for the open-ended items, very little subjective judgment was required by the person extracting the data, because most of the major ethical issues raised by the reviewers could be obviously categorized. All proposals related to malaria research submitted to FTM-EC over a period of 5 years, from January 2010 to December 2014, were reviewed. Analyses of ethical considerations were presented according to study classification, study design and specimen uses; Chi square tests were performed on each ethical issue separately. In addition, analyses were performed according to study location (multi-site, international, approval together with other REC study) and study population (minority or vulnerable population involved). To further investigate the relationship between ethical considerations and different study types, additional statistical analyses were performed using simple crude odds ratios (ORs). Logistic regression was performed for each ethical issue by different type of study separately.

Results

Types of malaria research studies

During the study period, 114 research proposals on different malaria species were submitted to the FTM-EC for review. These comprised 19 (17 %) biomedical studies, 15 (13 %) drug trials, 28 (24 %) laboratory studies and 52 (46 %) epidemiological/social science studies. Drug trials adopted atypical phase classification of the drug development process including 12 studies on investigational new drug ranging from Phase I to Phase III, and 3 Phase IV drug safety studies. No malaria vaccine trial proposals were submitted to the FTM-EC during the study period. Biomedical studies included eight studies comparing different malaria treatments/regimens and/or with different indications in clinical settings, and 11 bioequivalence or pharmacokinetic studies. Laboratory studies covered pure basic science and genetic studies. Epidemiology/social science studies included retrospective study using medical records and social/behavioural research. Approximately one-third of studies required FTM-EC approval together with that of other RECs, within Thailand and/or internationally. Approximately 13 % were multi-site and 4 % were international studies. Most malaria studies were conducted at malaria-endemic areas along the Thai borders; therefore, 28 % involved minority (hill tribe and cross-border) populations. Seventeen percent involved children and 7 % involved pregnant women (Table 1).

Table 1 Malaria study proposals submitted to the FTM-EC during the study period

Overall ethical considerations on malaria proposals

Of the 114 proposals, the ethical issues raised by REC members on “study rationale and significance of the study” included 12 % on research questions and 17 % on research objectives. As shown in Fig. 1, regarding the “study design and methodology” dimension, approximately 30 % were related to study schedule and activities, and 37 % to risk–benefit balance. For the ethical considerations concerning “research study participant”, 52 % were related to inclusion and exclusion criteria, 26 % to sample size, 27 % to recruitment procedures, and 23 % to participant compensation. Higher percentages were shown for the “informed consent process” dimension, with 57 % on the participation information sheet, 50 % on the informed consent form/process, and 24 % on the privacy and confidentiality of the information. Regarding the “data collection and analysis” dimension, approximately 61 % related to the specimen and data collection procedure, 17 % to case record form (CRF) design and use and 13 % to data analysis methods. For “study facility and supporting information”, 4 % were on study site location, 2 % on study budget, and 15 % on supporting documentation (e.g. material transfer agreement, and approval of authorities in the community where the study was taking place).

Fig. 1
figure 1

Overall ethical considerations on malaria research proposals (n = 114)

Comparisons of ethical considerations by proposal type

When comparing ethical considerations according to study design, almost all ethical issues were statistically significantly different across the four study designs. Proposals for drug trials had higher percentages for most ethical issues, followed by proposals of for biomedical/clinical research then laboratory or basic science research (Table 2). Proposals for epidemiology studies had fewer ethical issues raised by the FTM-EC. Interestingly, ethical issues for “privacy and confidentiality” specifically showed an opposite but non-statistically significant trend, being higher for laboratory and epidemiology studies than biomedical studies or drug trials. Other non-statistically significant differences among different study designs were for CRFs, data analysis, study budget and supporting documents.

Table 2 Comparisons of ethical considerations by study design

When comparing ethical considerations by different types of specimen/data collection and use, again almost all ethical issues were statistically significantly different across the four types of study proposal. Proposals involving new specimen collection had higher percentages for most ethical issues, followed by proposals using medical records or collecting new data using CRFs or questionnaires (Table 3). The proposals involving the use of stored specimens, either linked (identifiable) or unlinked (un-identifiable) had a smaller percentage of ethical issues raised by the FTM-EC. Again, ethical issues for “privacy and confidentiality” showed an opposite but non-statistically significant trend, with the percentage higher for studies involving stored specimens. Other non-statistically significant differences among different study designs were study rationale, data analysis, and study facility and supporting documents.

Table 3 Comparisons of ethical considerations by type of specimen/data use

Strength of relationship between ethical considerations and different types of malaria proposals

Regarding study location, proposals that required other REC review had higher ORs compared with proposals that required only FTM-EC review for the following ethical issues: study design and methodology; study participants; the informed consent process; and study facility and supporting documents. For comparisons between international vs. local studies, and between multi- vs. single-site studies, higher ORs were found for the dimension study facility and supporting documents (Table 4).

Table 4 Comparisons of ethical considerations by different study characteristics

Regarding study populations, proposals involving minority populations had higher ORs than proposals that did not involve such populations, for all ethical issues apart from study rationale and significance. In contrast, proposals involving vulnerable populations had higher ORs than proposals that did not, for study rationale/significance and study design/methodology.

When comparing the four study designs using epidemiology studies as a reference group, higher ORs were reported for biomedical/clinical research for all ethical issues except study facility and supporting documents. For drug trials, higher ORs were reported for all ethical issues except study participants and informed consent process. This was because 100 % of drug trial researchers were asked for clarifications on these two ethical issues. For laboratory studies, higher ORs were reported for three ethical issues: study design and methodology, study participants, and the informed consent process.

When comparing the four types of specimen/data use using proposals with medical records/CRFs as the reference group, higher ORs were reported for studies that collected new specimens for all ethical issues except study rationale, data collection and analysis, and research facility and supporting documents. Interestingly, when comparing proposals for studies using medical records/CRFs with those using identifiable or unidentifiable stored specimens, no statistically significant differences were reported.

Discussion

The roles and responsibilities of an REC are to ensure protection of the safety, well-being and basic rights of potential participants and participants of a research study. The REC should review the protocol and associated documents and provide opinions on three different ethical considerations, i.e. science, ethics, and data quality [33]. The classical view of research ethics is governed by four ethical principles: respect for persons, beneficence, justice, and respect for communities [39, 40]. Ethical foundations to be considered and addressed include issues on research subjects, the informed consent process, study design concept, risk–benefit ratio, vulnerable group protection and research gatekeepers [10, 41]. In this study, the ethical issues raised in malaria research proposals fell within these common principles. Approximately half of the proposals required revision and clarification on the informed consent process and study participant protection; and, for those studies that required specimen collection, the process to obtain the specimen from the study participants. Approximately one-third required information about risk–benefit and study schedule-activities. Less than one-fifth required explanation of the research objectives and a few proposals required clarification or revision of research questions and supporting documents.

Although only approximately 12 % of the proposals in the present study needed elaboration or provision of more robust information about the research questions (study rationale and significance), debate remains whether the FTM-EC has gone beyond its designated roles. The highest percentage of ethical issues raised by the FTM-EC regarding the malaria research proposals in the study related to the specimen and data collection schedule and activities. At times, some investigators have also questioned whether the ethics committee should comment on research methodology. These scientific merit and research procedure issues remain controversial internationally. It has been reported that REC members are pressured to review a wide range of issues in research proposals, needing to provide opinions ranging from research design to patient privacy and budgeting matters [9, 33]. Some research investigators believe that these are beyond the scope of research protection [9]. Others have suggested that researchers should have already thought carefully about the nature of how the study results can be generated and how they are aligned with the aims of the research. Heterogeneity of bioethics ought to be welcomed, but those involved should engage meaningfully and explicitly with questions concerning normative justification and the methodological process and about the coherence of components of their study [42]. The OHRP also notes that REC members very often ask to what degree it is his/her responsibility to review the underlying science of the proposal [43]. It has long been argued that “if it is not good science, it is not ethical” and the US federal regulations do not clearly call for REC review of the scientific validity of the research design. However, if the underlying science is inadequate, then it follows that the study is unlikely to yield important knowledge [43]. To mitigate this controversial ethical consideration made by RECs, the ORHP guideline suggests that if the REC lacks expertise in the scientific matter of the particular proposal, the REC should recognise its limits. Although REC members are not required to be experts in scientific methodology or statistics, they should have certain basic knowledge about study design, and they should consult experts if they have concerns about the research rationale and methodology that seem to pose a significant problem [43]. At the FTM, besides some FTM-EC members who have been working in malaria research over decades, there is a pool of expertise in malaria research, ranging from molecular to field studies, and several of them have been consulted for advice for any unclear or controversial matter before issuing the letter to investigators or making a final decision on the submitted proposals.

The REC has a responsibility to consider the balance between the risks and benefits of the research proposal. International standards clearly state that the REC must safeguard the rights, safety and well-being of all study participants [10, 33, 44]. Based on the classic ethics principle of beneficence, researchers have an obligation not to harm needlessly and to promote the good of the study participants where possible. Regarding justice, researchers have an obligation to ensure that study procedures for the selection of research subjects are equitable [44]. It is also agreed that researchers neither exploit the vulnerable nor exclude unreasonably those who could be receive benefit from the study. This means that eligibility criteria listed in the proposal must be clearly justified [45]. Among all 114 malaria proposals submitted for FTM-EC review, about 28 % involved minority populations along the country borders, and 27 % involved other vulnerable groups (pregnant women, children, the elderly or unconscious patients). Thus, the finding that over one-third of proposals required clarification on the risk–benefit balance is not surprising.

As clearly stated in international standards on ethical review of research protocols [12, 2325, 46], the informed consent process is one of the main ethical considerations that must be observed by RECs. Indeed, it could be said that the informed consent process is a legal, ethical, and regulatory requirement for most research and healthcare transactions [20, 47]. The informed consent process is based on the classic ethical principle of respect for persons, such that researchers must ensure that potential study participants make their own decisions whether or not to take part [44]. It should also be noted that, by signing informed consent documents, the study participants have agreed to a controlled breach of their privacy/confidential information for a specific purpose mentioned in the study protocol, and for use over a specific period of time [14]. It is thus important that participants are clearly informed about the methods of handling and use of their personal data, the justification for requesting or obtaining their data from different sources, and the duration of data use and storage, while maintaining their right to withdraw their consent at any time [14]. All guidelines suggest that special attention should be paid to studies involving vulnerable participants who may be unable or have limited capacity to make a decision [10, 21, 48, 49]. In a study on ethical dilemmas in malaria drug and vaccine trials [1], it was stated that, in most cases, obtaining informed consent was problematic because the studies were usually conducted with patients or surrogates with limited educational attainment levels in developing countries, and thus were not able to fully understand the study protocol. Potential participants may not understand the science underlying the study and therefore be able to make proper informed decisions. The finding in that study suggests the need for a better consent processes. As suggested elsewhere in the literature, a consent process considered valid or truly informed should have the following characteristics: (1) provision of adequate information, (2) capacity to understand that information, (3) decision making voluntarily, (4) understanding of information provided, and (5) agreement to the proposed treatment or procedure [50]. It has also been suggested that the informed consent forms are usually too long and complex for a layperson to read and comprehend, but there are various methods to simplify such forms [51]. Researchers are obliged to ensure that they plan their informed consent process with care, even the complicated aspects of research, by having the information explained simply and comprehensibly to the potential study participants. In the present study, over half the malaria research proposals and all malaria drug trial proposals submitted to FTM-EC required revision of the informed consent process to meet such requirements.

When examining different research designs, it was found that proposals on laboratory-based (usually using archived specimens) and epidemiological studies had fewer ethical issues raised by the FTM-EC than clinical research and drug trials. However, “privacy and confidentiality” showed an opposite, albeit non-statistically significant, trend. This concurs with one of the main ethical considerations in all international guidelines, that possible invasions of privacy of individuals and breaches of confidentiality may arise in biomedical and behavioural/social research [22, 24, 25, 27, 46]. As suggested in the guideline on ethics of research related to healthcare in developing countries, one of the RECs’ primary tasks is to review the ethical acceptability of research proposals with special attention to the provisions for protecting the security and confidentiality of data about patients [7]. From a data protection and privacy issues point of view, all study participants must be informed about not only what they have to do in the research, if they decide to participate, but also what and how the research plans to use the data that they provide [46]. There were reports of potential improper use or misuse of the collected data; even in case studies showing that what seems to be unlinked information can sometimes be taken for use out of context and lead to a personal data breach [46]. This could be because study procedures in clinical and drug trial proposals tended to be stated clearly by the study investigators in protecting participants’ personal information, whereas proposals of laboratory (predominantly using stored specimens) and epidemiology studies (predominantly using medical records and CRFs in healthcare settings) were generally not as clear. As suggested in the literature about ethical and legal issues of research using human specimens and clinical data, materials should be provided to the investigator with the minimal clinical information needed for the study and specimens should not be individually identifiable where applicable [15, 16, 20].

The malaria proposals that required additional review by other RECs, whether international or local, appeared to raise more ethical issues regarding study design and methodology, study participants, informed consent processes and study facility and supporting documents. This might be because such proposals are likely to be developed by non-local investigators and thus there might be certain local sensitive issues that were overseen by the proposal developers. As suggested in the literature regarding ethical principles in conducting clinical research in developing countries, investigators should consider the principle of collaboration by developing partnerships with local researchers, policy makers and the community [2]. It is recommended that the study should respect the community’s values, culture, traditions, and social practices. Even regarding scientific validity, the research team should ensure that the scientific design and methodology has recognized social value for the primary beneficiaries of the research, and is feasible within the social, political, and cultural context, or provides sustainable improvements in the local healthcare and physical infrastructure [2].

Ethical issues that should be considered, as part of field studies of malaria in developing countries, were also discussed in terms of practical problems that arise in the course of research. These include differing circumstances in developing countries, such as standards of care, incentives and reimbursement, insurance and indemnity [28]. The local REC should ensure that local context is adequately addressed and convey their knowledge of local factors that affect human subject protection [52]. The issues raised by the FTM-EC for these international studies confirm the notion that local ethical review should consider the vulnerability of study participants, particularly in remote border areas with no or poor access to healthcare services, alongside cultural beliefs and attitudes, literacy and language [25, 28]. As has also been suggested by others, the REC should provide public assurance of such protection by ensuring that investigator(s) are suitable to conduct the study, facilities are adequate, and that the methods and materials and informed consent process are appropriate [33].

Malaria research studies conducted along the Thai borders generally involved minority populations in endemic areas. These populations are considered vulnerable, with poor/limited educational attainment and cross-border/migrant status. Therefore, it is not surprising to observe that all ethical issues (except study rationale) were raised for such proposals by FTM-EC. The principle of fair selection of study population is important to minimize risks while enhancing other critical principles of collaborative partnership and social value when the research study is taking place in local communities [2]. Balancing risk–benefit considerations, informed consent processes and having respect for recruited participants and study communities, especially among vulnerable populations, remain the major concerns of all RECs [2, 25].

There were more ethical considerations in almost all aspects for drug trials and clinical studies compared with proposals for epidemiological studies. Clinical research studies usually directly involve human subjects, either with preventive, therapeutic, or non-therapeutic procedures. In general, the study procedures in such study designs put human subjects at higher risks, thus there are more ethical concerns. The primary ethical considerations of clinical studies are competent medical treatment and care, alongside an acceptable risk–benefit balance [40, 41, 44]. However, many laboratory research studies use stored specimens, with less invasive procedures, and epidemiology studies usually employ data collection through medical records, CRFs or questionnaires. Ethical issues for the latter, therefore, mainly concern confidentiality and privacy of the study participants [25]. However, it was found that studies that collect new specimens received more comments on ethical issues. There remains debate among RECs about solutions for issues around sample export, storage, and reuse [15, 16, 34]. However, it is recommended that in order to ensure adequate protection of human research subjects participating in scientific research, RECs bear the responsibility of guaranteeing that participants are provided with sufficient detail to be able to provide informed consent as well as to understand the reality of genetic research as it is practiced [53].

Limitations of the study

The main limitation of this study is that it is based on information from only one institution, the Faculty of Tropical Medicine, Mahidol University. It may, therefore, not be representative of RECs elsewhere in Thailand or around the world where malaria proposals are submitted. However, the top five institutions publishing malaria research papers during 2010–2014 were the London School of Hygiene and Tropical Medicine (882), the University of Oxford (766), the University of Liverpool (485), Mahidol University (450, including 391 from the FTM), and Johns Hopkins University (409). The proposals under the FTM affiliation were all reviewed by the FTM-EC. This study examined all 114 malaria research proposals submitted to an REC in Thailand during a five-year period. Overall, the FTM makes a considerable contribution to malaria research globally. Identifying the ethical issues considered during the protocol review process at the FTM may inform the planning of future malaria research studies in endemic countries in Southeast Asia and/or beyond.

Conclusions

Regardless of study design and setting, the REC focus is on the science, ethics and quality assurance of each study protocol. Several important ethical issues were identified for protocol approval, ranging from study design to supporting documents. Ethical considerations, particularly for clinical research and drug trials appeared to be mainly focused on the risk–benefit balance, vulnerable participants, and informed consent process, whereas the main considerations for laboratory and epidemiology studies were the confidentiality and privacy of data and use of specimens. As with studies subject to review by any REC, generic ethical principles are applied to malaria research, such that research validity and quality must be maintained while respecting study participants within the social, cultural and economic contexts where the research is conducted. Ethics and bioethics represent large domains of their own in balancing both theoretical and practical aspects of human research study conduct. While stakeholders, including researchers, sponsors and RECs, have to consider the practicability of research conduct within malaria-endemic settings, which are commonly populated with those who are poor and vulnerable, they cannot violate the classic ethical principles of autonomy, beneficence, and justice.

Abbreviations

CRF:

Case record form

FTM:

Faculty of Tropical Medicine

FTM-EC:

Faculty of Tropical Medicine Ethics Committee

FWA:

Federal-wide Assurance

IRB:

Institutional Review Board

NIH:

National Institutes of Health

OHRP:

Office for Human Research Protections

OR:

Odds ratio

REC:

Research Ethics Committee

References

  1. Barry M, Molyneux M. Ethical dilemmas in malaria drug and vaccine trials: a bioethical perspective. J Med Ethics. 1992;18:189–92.

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  2. Emanuel EJ, Wendler D, Killen J, Grady C. What makes clinical research in developing countries ethical? The benchmarks of ethical research. J Infect Dis. 2004;189:930–7.

    Article  PubMed  Google Scholar 

  3. Kilama WL. Health research ethics in malaria vector trials in Africa. Malar J. 2010;9:S3.

    Article  PubMed Central  PubMed  Google Scholar 

  4. Das D, Cheah PY, Akter F, Paul D, Islam A, Sayeed AA, et al. Participants’ perceptions and understanding of a malaria clinical trial in Bangladesh. Malar J. 2014;13:217.

    Article  PubMed Central  PubMed  Google Scholar 

  5. Nyika A, Chilengi R, Ishengoma D, Mtenga S, Thera MA, Sissoko MS, et al. Engaging diverse communities participating in clinical trials: case examples from across Africa. Malar J. 2010;9:86.

    Article  PubMed Central  PubMed  Google Scholar 

  6. Marshall JM, Tour MB, Traore MM, Famenini S, Taylor CE. Perspectives of people in Mali toward genetically-modified mosquitoes for malaria control. Malar J. 2010;9:128.

    Article  PubMed Central  PubMed  Google Scholar 

  7. Nuffield Council on Bioethics. The ethics of research related to healthcare in developing countries. Nuffield Council on Bioethics. http://nuffieldbioethics.org/wp-content/uploads/2014/07/Ethics-of-research-related-to-healthcare-in-developing-countries-I.pdf (2002). Accessed 4 May 2015.

  8. World Medical Association. World Medical Association Declaration of Helsinki. Ethical Principles for Medical Research Involving Human Subjects. JAMA. 2013;310:2191–4.

  9. Gunsalus CK, Bruner EM, Burbules NC, Dash L, Finkin M, Goldberg JP, et al. Mission creep in the IRB world. Science. 2006;312:1441.

    Article  CAS  PubMed  Google Scholar 

  10. Office for Human Research Protections. IRB guidebook. http://www.hhs.gov/ohrp/archive/irb/irb_guidebook.htm (1999). Accessed 4 May 2015.

  11. European Commission EUR 24452. European textbook on ethics in research. Luxembourg: Office of the European Union; 2010.

    Google Scholar 

  12. International Conference on Harmonisation of Technical Requirements for Registration of Pharmaceuticals for Human Use. Guideline for Good Clinical Practice, E6(R1). 1996. Available at: http://www.ich.org/fileadmin/Public_Web_Site/ICH_Products/Guidelines/Efficacy/E6/E6_R1_Guideline.pdf.

  13. Adams P, Kaewkungwal J, Limphattharacharoen C, Prakobtham S, Pengsaa K, Khusmith S. Is your ethics committee efficient? Using ‘‘IRB Metrics’’ as a self-assessment tool for continuous improvement at the Faculty of Tropical Medicine, Mahidol University, Thailand. PLoS ONE. 2014;9:11.

    Google Scholar 

  14. Abbott L, Grady C. A systematic review of the empirical literature evaluating IRBs: What we know and what we still need to Learn. J Empir Res Hum Res Ethics. 2011;6:3–19.

    Article  PubMed Central  PubMed  Google Scholar 

  15. Edwards KL, Lemke AA, Trinidad SB, Lewis SM, Starks H, Snapinn KW, et al. Genetics researchers’ and iRB professionals’ attitudes toward genetic research review: a comparative analysis. Genet Med. 2012;14:236–42.

    Article  PubMed Central  PubMed  Google Scholar 

  16. Tindana P, Molyneux CS, Bull S, Parker M. Ethical issues in the export, storage and reuse of human biological samples in biomedical research: perspectives of key stakeholders in Ghana and Kenya. BMC Med Ethics. 2014;15:76.

    Article  PubMed Central  PubMed  Google Scholar 

  17. Taylor HA. Moving beyond compliance: measuring ethical quality to enhance the oversight of human subjects research. IRB. 2007;29:9–14.

    PubMed  Google Scholar 

  18. Sugarman J. The future of empirical research in bioethics. J Law Med Ethics. 2004;32:226–31.

    Article  PubMed  Google Scholar 

  19. Young M, Drachenberg J, Underwood R, Schreiner M. Put ‘metrics’ in the lexicon after IRB, before quality improvement. IRB Advisor. 2013;13:13–24.

    Google Scholar 

  20. Kapp MB. Ethical and legal issues in research involving human subjects: do you want a piece of me? J Clin Pathol. 2006;59:335–9.

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  21. Council for International Organizations of Medical Sciences and the World Health Organization. International Ethical Guidelines for Biomedical Research Involving Human Subjects, Guideline 13. http://www.cioms.ch/frame_guidelines_nov_2002.htm (2002). Accessed 4 May 2015.

  22. World Health Organization. Standards and operational guidance for ethics review of health-related research with human participants. Geneva: WHO Document Production Services; 2011.

    Google Scholar 

  23. European Commission. Horizon 2020, How to complete your ethics self-assessment. The EU Framework Programme for Research and Innovation, Version 1.0. 2014. Available at: http://ec.europa.eu/research/participants/portal/doc/call/h2020/h2020-msca-if-2015/1645175-h2020_-_guidance_ethics_self_assess_en.pdf.

  24. Department of Health. Governance arrangements for research ethics committees; a harmonised edition. 2011. UK: Published to DH website, in electronic PDF format only. http://www.dh.gov.uk.

  25. Office for Human Research Protections. IRB Guidebook Chapter III: basic IRB review. http://www.hhs.gov/ohrp/archive/irb/irb_chapter3.htm (1993). Accessed 4 May 2015.

  26. World Health Organization. Research ethics committees: basic concepts for capacity-building. Geneva: WHO Document Production Services; 2009.

    Google Scholar 

  27. The Economic and Social Research Council. ESRC Framework for research ethics (Updated January 2015). Available at: http://www.esrc.ac.uk/_images/framework-for-research-ethics_tcm8-33470.pdf.

  28. Ribeiro I. Presentation from ‘Obligations to participants in research trials in developing countries’, a symposium held at the American Society of Tropical Medicine and Hygiene (ASTMH) 56th annual meeting, Philadelphia, USA; 2007. http://r4d.dfid.gov.uk/PDF/Outputs/DNDI/ribeiroI_astmh_ethics_symposium.pdf. Accessed 4 May 2015.

  29. Mamotte N, Wassenaar D, Koen J, Essack Z. Convergent ethical issues in HIV/AIDS, tuberculosis and malaria vaccine trials in Africa: Report from the WHO/UNAIDS African AIDS Vaccine Programme’s Ethics, Law and Human Rights Collaborating Centre consultation, 10–11 February 2009, Durban, South Africa. BMC Med Ethics. 2010;11:3.

    Article  PubMed Central  PubMed  Google Scholar 

  30. Office for Human Research Protections. Biomedical and behavioral research: an overview. http://www.hhs.gov/ohrp/archive/irb/irb_chapter5.htm (1993). Accessed 4 May 2015.

  31. European Science Foundation. Health research classification systems—Current approaches and future recommendations.2011. Available at: http://www.esf.org/fileadmin/Public_documents/Publications/spb43_Health_Research_Classification.pdf.

  32. National Institutes of Health. NIH Clinical Research Trials and You. http://www.nih.gov/health/clinicaltrials/basics.htm. Accessed 4 May 2015.

  33. Karlberg JPE, Speers MA. Reviewing clinical trials: a guide for the ethics committee. Washington: Association for the Accreditation of Human Research Protection Programs, Inc; 2010.

    Google Scholar 

  34. Simon C, Shinkunas LA, Brandt D, Williams JK. Individual genetic and genomic research results and the tradition of informed consent: exploring US review board guidance. J Med Ethics. 2012;38:417–22.

    Article  PubMed Central  PubMed  Google Scholar 

  35. Medical Research Council. MRC ethics series Human Tissue and Biological Samples for Use in Research: Operational and Ethical Guidelines. 2014. Available at: http://www.mrc.ac.uk/news-events/publications/human-tissue-and-biological-samples-for-use-in-research/.

  36. Mascalzoni D, Dove ES, Rubinstein Y, Dawkins HJS, McCormack P, Woods S, et al. International charter of principles for sharing bio-specimens and data. Eur J Hum Genet. 2015;23:721–8.

    Article  PubMed  Google Scholar 

  37. Godard B, Schmidtke J, Cassiman JJ, Ayme S. Data storage and DNA banking for biomedical research: informed consent, confidentiality, quality issues, ownership, return of benefits. A professional perspective. Eur J Hum Genet. 2003;11:S88–122.

    Article  PubMed  Google Scholar 

  38. Dodsworth N, O’Flaherty M, Wilsher C. Guidance for auditing quality systems of Independent Ethics Committees in Europe. http://www.efgcp.be/downloads/EFGCP%20IEC%20Audit%20Guidance%2014%20October2008.pdf (2008). Accessed 4 May 2015.

  39. Levine RJ. Ethics and regulations of clinical research. 2nd ed. New Haven: Yale University Press; 1988.

    Google Scholar 

  40. Weijer C, Lanata CF, Plowe CV: Ethical considerations in the conduct of vaccine trials in developing countries. In: Levine MM, Dougan G, Good MF, Liu MA, Nabel GJ, Nataro JP, et al, editors. New Generation Vaccines. 4th edition. New York: Informa Health Care, Inc; 2010. pp. 59–65.

  41. Weijer C, Grimshaw JW, Taljaard M, Binik A, Boruch R, Brehaut JC, et al. Ethical issues posed by cluster randomized trials in health research. Trials. 2011;12:100.

    Article  PubMed Central  PubMed  Google Scholar 

  42. Davies R, Ives J, Dunn M. A systematic review of empirical bioethics methodologies. BMC Med Ethics. 2015;16:15.

    Article  PubMed Central  PubMed  Google Scholar 

  43. Office for Human Research Protections (OHRP). Considerations of research design. http://www.hhs.gov/ohrp/archive/irb/irb_chapter4.htm (1993). Accessed 4 May 2015.

  44. Weijer C, Miller PB. When are research risks reasonable in relation to anticipated benefits? Nat Med. 2004;10:570–3.

    Article  CAS  PubMed  Google Scholar 

  45. Fuks A, Weijer C, Freedman B, Shapiro S, Skrutkowska M, Riaz A. A study in contrasts: eligibility criteria in a twenty-year sample of NSABP and POG clinical trials. J Clin Epidemiol. 1998;51:69–79.

    Article  CAS  PubMed  Google Scholar 

  46. European Commission. Data protection and privacy issues ethical guidelines. Ethical Review in FP7. 2009. Available at: http://ec.europa.eu/research/participants/data/ref/fp7/89827/privacy_en.pdf.

  47. Caldwell P, Murphy S, Butow P, Craig J. Clinical trials in children. Lancet. 2004;364:803–11.

    Article  PubMed  Google Scholar 

  48. Grady C. Enduring and emerging challenges of informed consent. N Engl J Med. 2015;372:855–62.

    Article  CAS  PubMed  Google Scholar 

  49. Connolly P. Ethical principles for researching vulnerable groups. 2003. http://www.ed.ac.uk/polopoly_fs/1.71235!/fileManager/EthicsPr-Vulnerable.pdf.

  50. Chima SC. Evaluating the quality of informed consent and contemporary clinical practices by medical doctors in South Africa: an empirical study. BMC Med Ethics. 2013;14:S3.

    Article  PubMed Central  PubMed  Google Scholar 

  51. Pandiya A. Readability and comprehensibility of informed consent forms for clinical trials. Perspect Clin Res. 2010;1:98–100.

    PubMed Central  PubMed  Google Scholar 

  52. National Institutes of Health (NIH). National Conference on Alternative IRB Models: Optimizing human subject protection. Washington DC; 2006.

  53. Groisman IJ, Egalite N, Godard B. Consenting for current genetic research: is Canadian practice adequate? BMC Med Ethics. 2014;15:80.

    Article  Google Scholar 

Download references

Authors’ contributions

All authors discussed and agreed upon the content, contributed to the development and revision of the draft manuscripts. PA, JK drafted the initial version. PW, SK, KP contributed useful criticism and suggestions. CL, SP, PV extracted unlinked study data from the secured documents of the FTM-EC. All authors read and approved the final manuscript.

Acknowledgements

The authors would like to thank the FTM-EC members in both panels for their kind support for this study.

Compliance with ethical guidelines

Competing interests The authors declare that they have no competing interests.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jaranit Kaewkungwal.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Adams, P., Prakobtham, S., Limphattharacharoen, C. et al. Ethical considerations in malaria research proposal review: empirical evidence from 114 proposals submitted to an Ethics Committee in Thailand. Malar J 14, 342 (2015). https://doi.org/10.1186/s12936-015-0854-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12936-015-0854-5

Keywords