Robust regulation depends on good data. Evidence relating to the toxicological effects, or lack of such effects, of compounds or products subject to regulation comes from two main sources:
1.4.1 Proprietary Data Versus Studies in the Peer-reviewed Literature
Some take the view that proprietary data should be ignored and only studies in the peer-reviewed literature evaluated; others consider that only Good Laboratory Practice (GLP)-compliant studies, conducted according to regulatory guidelines, should be evaluated. Both types of study have potential strengths and weaknesses,15,16 but the present authors are strongly of the opinion that both types of data should be evaluated if of sufficient quality. Failure to do so could result in the ludicrous situation where, if one insisted only on data from GLP-compliant facilities, data on human poisonings would have to be ignored, as would many animal studies from reputable university departments or other research institutes. Conversely, poorly conducted studies in the peer-reviewed literature would be taken as valid, but a proprietary study, which was GLP-compliant and undertaken to internationally-agreed guidelines, looking at the same endpoint would have to be ignored. Science is a search for the truth, difficult enough in all circumstances, but particularly difficult when an absolutist view is taken of particular sorts of data. As Charles Darwin said, “scientific man ought to have no wishes, no affections, a mere heart of stone”.17 In fact, the greatest enemy of prejudice in science is facts from well-conducted studies.
Attempts have been made to grade scientific information by quality; for example, that of Klimisch and colleagues.18
An EU Regulation that takes an absolutist approach is regulation 1107/2009, which firmly states that “In relation to human health, no collected data on humans should be used to lower the safety margins resulting from tests or studies on animals.” This regulation concerns pesticides, an area where the use of human experimental data has been particularly controversial (see below).19
Although studies in the peer-reviewed literature are usually not paid for by industry, journals increasingly require declarations of conflicts of interest; those declared are generally financial. But other, non-financial, conflicts of interest may occur (see discussion by Purchase20). Moreover, non-governmental organisations (NGOs) that take the view that only studies in the peer-reviewed literature can be trusted may have their own interests, which they may wish to protect. Leonard21 points out that many NGOs, which purport to represent the general population, are highly dependent on national government or EU money – though, of course, this no more implies an inability take a detached and disinterested view of issues than it does in the case of research workers (see also Pigeon22). Moreover, NGOs may have agendas other than public health – for example, anti-globalisation, anti-capitalism, opposition to intensive farming, dislike for certain companies etc. – but tend to project their concerns as concerns for public health. The habit of certain NGOs of attacking authors ad hominem and/or their source of funding, rather than addressing the science, is to be deplored.
In fact, few people are truly disinterested, and we all have our prejudices. Thus, with publications in the peer-reviewed literature, it should be reflected that benefits, including recognition and promotion, might accrue to the workers as a result of publication. It should also be recalled that peer-review is not a fool-proof, error-free, process in that reviewers are, to a large extent, dependent on the honesty of those submitting work for review. If such honesty is lacking, then peer-reviewers can be misled and the process of quality assurance fails (instances of retraction of papers in the peer-reviewed literature are discussed below). The glaring problem with peer-review, as used by scientific journals, is the general inability of reviewers to access raw data. Further, when comparing the two sources of data, it should be remembered that the producers of compounds stand to lose a great deal, in terms of reputation and finance, should their submissions turn out to be flawed. No ethical producer stands to gain by marketing a compound which has not been rigorously tested or for which the results of such tests have been falsified. Quite apart from anything else, clearance of regulatory hurdles using false data would be unlikely to protect producers against lawsuits, at least in common-law countries.
1.4.2 Proprietary Data
As discussed above, the value of work published in the peer-review literature is sometimes stressed, to the disadvantage of the work provided to regulators in the proprietary literature. Such comparisons are based on the perception that the proprietary literature is likely to be biased in favour of the products studied in that industry, which in turn, is paying for the study; however, many studies are carried out by contract toxicology houses, who have no financial interest in the regulatory consequences of the results of their studies (as long as they get paid!). Whether such criticism of the proprietary literature is justified is thus open to question. It is also perceived, perhaps wrongly, that proprietary data are more difficult to access than those published in the open literature. This has led to data being described as being within the grey literature, although such data can often be accessed through national and international regulatory bodies.
1.4.2.1 Good Laboratory Practice
In the 1970s, there were scandals involving scientific misdeeds and fraud at toxicology laboratories, the best known case involving the firm Industrial Bio-Test (IBT), and a result was the establishment of GLP regulations by the US Food and Drug Administration (FDA), finalized in 1979. In 1983, the US Environmental Protection Agency (EPA) established similar guidelines for pesticide toxicology studies and, in 1989, extended them to cover all research data submitted for the purposes of pesticide registration. Because studies are designed to support marketing in multiple jurisdictions, GLP was widely adopted throughout the world. GLP makes falsification of data very difficult and provides a paper-trail, as do other requirements of GLP such as the retention of data, samples and specimens. However, the efficacy of GLP depends crucially on a good quality incorruptible GLP inspectorate. See also Marshall23 and Seiler.24
1.4.2.2 Guidelines
In addition to the requirement for GLP, with many regulatory regimes, unless there is a good scientific justification for deviation, there is an obligation that studies be carried out in accordance with guidelines such as those produced by the Organisation for Economic Co-operation and Development (OECD) or, for pharmaceutical toxicology, the International Council on Harmonisation of Technical Requirements for Registration of Pharmaceuticals for Human Use (ICH). In addition to the latter, there is a veterinary equivalent, the International Cooperation on Harmonisation of Technical Requirements for Registration of Veterinary Medicinal Products (VICH). Also, most EU regulatory bodies have their own test guidelines. The OECD is based in Paris, whereas ICH and VICH are nomadic, although they have permanent secretariats. ICH is located in Switzerland; VICH is based at Health for Animals, Brussels.
At t...