Part IV - Model evaluation and implementation
Published online by Cambridge University Press: 05 August 2012
Summary
Essentially, all models are wrong, but some are useful.
George E. P. BoxThis section outlines methods for the evaluation of species distribution models (Chapter 9) and presents a summary and framework for their implementation (Chapter 10). Evaluation of species distribution models (SDM) has tended to focus on predictive performance as the most important measure of model validity. But predictive performance is really only one aspect of model evaluation. Ecological realism and acceptability to the user community (model credibility) are also important evaluation criteria. Very broadly defined, a valid model is one that meets performance requirements that have been specified. Performance requirements for SDMs may be difficult to specify or quantify in some cases, and all models simplify reality and have prediction errors. SDMs are used to make spatial predictions of species distributions and therefore the spatial nature of the predictions and errors should be explicitly considered when the models are subsequently used to address a question.
In the model evaluation step, many criteria could be used for validating the output of a model of species–habitat relations (Chapter 10 in Morrison et al., 1998). Evaluation is distinct from calibration when the model is used to make predictions based on new or different data. If a strictly independent dataset with suitable attributes is not available, it is common to divide the dataset into “training” and “testing” data prior to modeling, or to use some kind of resampling method (such as bootstrapping) to estimate, from the training data, what the prediction accuracy of the model would be if it were applied to new data.
- Type
- Chapter
- Information
- Mapping Species DistributionsSpatial Inference and Prediction, pp. 207 - 208Publisher: Cambridge University PressPrint publication year: 2010