Hostname: page-component-797576ffbb-gvrqt Total loading time: 0 Render date: 2023-12-10T17:16:50.440Z Has data issue: false Feature Flags: { "corePageComponentGetUserInfoFromSharedSession": true, "coreDisableEcommerce": false, "useRatesEcommerce": true } hasContentIssue false

Commentary: Statistical aspects of environmental risk assessment of GM plants for effects on non-target organisms

Published online by Cambridge University Press:  22 October 2009

Joe N. Perry
Oaklands Barn, Lug's Lane, Broome, Norfolk NR35 2HT, UK
Cajo J.F. ter Braak
Biometris, Plant Research International, Wageningen University and Research Centre, P.O. Box 100, 6700 AC Wageningen, The Netherlands
Philip M. Dixon
Department of Statistics, 120 Snedecor Hall, Ames IA, 50011-1210, USA
Jian J. Duan
USDA ARS Beneficial Insects Introduction Laboratory, Newark, Delaware 19713, USA
Rosie S. Hails
Centre for Ecology and Hydrology, Mansfield Rd, Oxford OX1 3SR, UK
Alexandra Huesken
Julius Kuehn Institute, Federal Research Centre for Cultivated Plants (JKI), Institute for Biosafety of Genetically Modified Plants, Messeweg 11/12, 38104 Braunschweig, Germany
Marc Lavielle
INRIA Saclay, Université Paris-Sud, Bât. 425, 91405 Orsay Cedex, France
Michelle Marvier
Dept. of Biology & Environmental Studies Institute, Santa Clara University, Santa Clara, CA 95053, USA
Michele Scardi
Department of Biology, “Tor Vergata” University, Via della Ricerca Scientifica, 00133 Rome, Italy
Kerstin Schmidt
BioOK GmbH, Schnickmannstrasse 4, 18055 Rostock, Germany
Bela Tothmeresz
Department of Ecology, University of Debrecen; Debrecen, P.O. Box 71, 4010, Hungary
Frank Schaarschmidt
Leibniz Universität Hannover, Fakultät Naturwissenschaften, Institut für Biostatistik, Herrenhaeuser Str. 2, 30419 Hannover, Germany
Hilko van der Voet
Biometris, Wageningen University and Research Centre, P.O. Box 100, 6700 AC Wageningen, The Netherlands


Core share and HTML view are not possible as this article does not have html content. However, as you have access to this content, a full PDF is available via the ‘Save PDF’ action button.

Previous European guidance for environmental risk assessment of genetically modified plants emphasized the concepts of statistical power but provided no explicit requirements for the provision of statistical power analyses. Similarly, whilst the need for good experimental designs was stressed, no minimum guidelines were set for replication or sample sizes. Furthermore, although substantial equivalence was stressed as central to risk assessment, no means of quantification of this concept was given. This paper suggests several ways in which existing guidance might be revised to address these problems. One approach explored is the `bioequivalence' test, which has the advantage that the error of most concern to the consumer may be set relatively easily. Also, since the burden of proof is placed on the experimenter, the test promotes high-quality, well-replicated experiments with sufficient statistical power. Other recommendations cover the specification of effect sizes, the choice of appropriate comparators, the use of positive controls, meta-analyses, multivariate analysis and diversity indices. Specific guidance is suggested for experimental designs of field trials and their statistical analyses. A checklist for experimental design is proposed to accompany all environmental risk assessments.

Research Article
© ISBR, EDP Sciences, 2009


Andow, DA (2003) Negative and positive data, statistical power, and confidence intervals. Environ. Biosafety Res. 2: 7580 CrossRef
Champion, GT, May, MJ, Bennett, S, Brooks, DR, Clark, SJ, Daniels, RE, Firbank, LG, Haughton, AJ, Hawes, C, Heard, MS, Perry, JN, Randle, Z, Rothery, P, Skellern, MP, Scott, RJ, Squire, GR, Thomas, MR (2003) Crop management and agronomic context of the Farm Scale Evaluations of genetically modified herbicide-tolerant crops. Phil. Trans. R. Soc. Lond. B 358: 18011818
Clark, SJ, Rothery, P, Perry, JN, Heard, MS (2007) Farm Scale Evaluations of herbicide-tolerant crops: assessment of within-field variation and sampling methodology for arable weeds. Weed Res. 47: 157163 CrossRef
EFSA (2006) Guidance Document of the Scientific Panel on Genetically Modified Organisms for the risk assessment of genetically modified plants and derived food and feed (Question No EFSA-Q-2003-005). The EFSA Journal 99: 1100
EFSA (2009a) Updated guidance document of the Scientific Panel on Genetically Modified Organisms (GMO) for the risk assessment of genetically modified plants and derived food and feed.
EFSA (2009b) Scientific Opinion on Statistical considerations for the safety evaluation of GMOs, on request of EFSA. EFSA Journal 1250, 62 p.
EFSA (2009c) General mandate – aspects of the environmental risk assessment (ERA) and the ERA guidance. Question EFSA-Q-2008-262.
FIFRA SAP (2000) Report of the Federal Insecticide, Fungicide, and Rodenticide Act.
Hill, RA, Sendashonga, C (2003) General principles for risk assessment of living modified organisms: Lessons from chemical risk assessment. Environ. Biosafety Res. 2: 8188 CrossRef
Hoenig, JM, Heisley, DM (2001) The abuse of power: The pervasive fallacy of power calculations for data analysis. Am. Stat. 55: 1924. CrossRef
ICH Harmonised Tripartite Guideline. Statistical principles for clinical trials E9. Current Step 4 version dated 5 February 1998
Laster, LL, Johnson, MF (2003) Non-inferiority trials: the `at least as good as' criterion. Stat. Med. 22: 187200 CrossRef
Marvier, M (2002) Improving risk assessment for nontarget safety of transgenic crops. Ecol. Appl. 12: 11191124 CrossRef
Marvier, M, McCreedy, C, Regetz, J, Kareiva, P (2007) A meta-analysis of effects of Bt cotton and maize on nontarget invertebrates. Science 316: 14751477 CrossRef
Niazi S (2007) Handbook of Bioequivalence Testing. CRC Press, ISBN: 0849303958, 569 p
Perry, JN (1986) Multiple-comparison procedures: a dissenting view. J. Econ. Entomol. 79: 11491155 CrossRef
Perry, JN (1989) Review: population variation in Entomology: 1935–1950. I. Sampling. The Entomologist 108: 184198
Perry, JN, Rothery, P, Clark, SJ, Heard, MS, Hawes, C (2003) Design, analysis and power of the Farm-Scale Evaluations of Genetically-Modified Herbicide-Tolerant crops. J. Appl. Ecol. 40: 1731 CrossRef
Prasifka, JR, Hellmich, RL II, Dively, GP, Lewis, LC (2005) Assessing the effects of pest management on non-target arthropods: the influence of plot size and isolation. Environ. Ent. 34: 11811192 CrossRef
Schuirmann, DJ (1987) A comparison of the two one-sided tests procedure and the power approach for assessing the equivalence of average bioavailability. J. Pharmacokinet. Biop. 15: 657680 CrossRef
Tempelman, RJ (2004) Experimental design and statistical methods for classical and bioequivalence hypothesis testing with an application to dairy nutrition studies. J. Anim. Sci. 82: E162E172
US EPA (2006) Guidance for the Data Quality Objectives Process. EPA QA/G-4.
van den Brink, PJ, ter Braak, CJF (1999) Principal response curves: Analysis of time-dependent multivariate responses of biological community to stress. Environ. Toxicol. Chem. 18: 138148 CrossRef
Walters SJ (2008). Consultants' forum: should post hoc sample size calculations be done? Pharm. Stat. 8: 163–169
Wellek S (2002) Testing Statistical Hypotheses of Equivalence. CRC Press, ISBN: 1584881607, 284 p
Winder, L, Perry, JN, Holland, JM (1999) The spatial and temporal distribution of the grain aphid Sitobion avenae in winter wheat. Entomol. Exp. Appl. 93: 277290 CrossRef
Yata, K (2008) Two-stage equivalence tests that control both size and power. Seq. Anal. 27: 185200 CrossRef