Skip to main content Accessibility help
×
Hostname: page-component-848d4c4894-wg55d Total loading time: 0 Render date: 2024-05-06T17:32:09.060Z Has data issue: false hasContentIssue false

Chapter 9 - Predictability past, predictability present

Published online by Cambridge University Press:  03 December 2009

Leonard A. Smith
Affiliation:
Centre for the Analysis of Time Series, London School of Economics and Pembroke College, Oxford
Tim Palmer
Affiliation:
European Centre for Medium-Range Weather Forecasts
Renate Hagedorn
Affiliation:
European Centre for Medium-Range Weather Forecasts
Get access

Summary

Maybe we oughta help him see,

The future ain't what it used to be.

Tom Petty

Introduction

Predictability evolves. The relation between our models and reality is one of similarity, not identity, and predictability takes form only within the context of our models. Thus predictability is a function of our understanding, our technology and our dedication to the task. The imperfection of our models implies that theoretical limits to predictability in the present may be surpassed; they need not limit predictability in the future. How then are we to exploit probabilistic forecasts extracted from our models, along with observations of the single realisation corresponding to each forecast, to improve the structure and formulation of our models? Can we exploit observations as one agent of a natural selection and happily allow our understanding to evolve without any ultimate goal, giving up the common vision of slowly approaching the Perfect Model? This chapter addresses these questions in a rather applied manner, and it adds a fourth: Might the mirage of a Perfect Model actually impede model improvement?

Given a mathematical dynamical system, a measurement function that translates between states of this system and observations, and knowledge of the statistical characteristics of any observational noise, then in principle we can quantify predictability quite accurately. But this situation describes the perfect model scenario (PMS), not the real world. In the real world we define the predictability of physical systems through our mathematical theories and our in silico models.

Type
Chapter
Information
Publisher: Cambridge University Press
Print publication year: 2006

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Allen, M. R. (1999). Do-it-yourself climate modelling. Nature, 401, 642CrossRefGoogle Scholar
Altalo, M. G. and Smith, L. A. (2004). Using ensemble weather forecasts to manage utilities risk. Environ. Finance, 20, 8–9Google Scholar
Angstrom, A. K. (1919). Probability and practical weather forecasting. Centraltryckeriet Tecknologforeningens ForlagGoogle Scholar
Beven, K. J. (2002). Towards an alternative blueprint for a physically-based digitally simulated hydrologic response modelling system. Hydrol. Process., 16(2), 189–206CrossRefGoogle Scholar
Bishop, R. (2003). On separating prediction from determinism. Erkenntnis, 58, 169–88Google Scholar
Borel, E. (1950). Probability and Certainty. New York: WalkerGoogle Scholar
Buizza, R., Miller, M. J. and Palmer, T. N. (1999). Stochastic simulation of model uncertainties in the ECMWF Ensemble Prediction System. Quart. J. Roy Meteor. Soc., 125, 2887–908CrossRefGoogle Scholar
Earman, J. (1986). A Primer on Determinism. D. ReidelCrossRefGoogle Scholar
Epstein, R. A. (1977). The Theory of Gambling and Statistical Logic. Academic Press.Google Scholar
Fraassen, B. C. (2002). The Empirical Stance. Yale University PressGoogle Scholar
Gillies, D. (2000). Philosophical Theories of Probability. RoutledgeGoogle Scholar
Gilmour, I., Smith, L. A. and Buizza, R. (2001). Linear regime duration: is 24 hours a long time in synoptic weather forecasting?J. Atmos. Sci., 22, 3525–392.0.CO;2>CrossRefGoogle Scholar
Good, I. (1952). Rational decisions. J. Roy. Stat. Soc. B, 14Google Scholar
, Gordon N. and , L. A. Smith (2005). Weather forecasting for combined Cycle Gas Turbine (CCGT). Proceedings of the First THORPEX Science Symposium (in press). American Meteorological SocietyGoogle Scholar
Hansen, J. A. and Smith, L. A. (2000). The role of operational constraints in selecting supplementary observations. J. Atmos. Sci. 57(17), 2859–712.0.CO;2>CrossRefGoogle Scholar
Hansen, J. A. and Smith, L. A. (2001). Probabilistic noise reduction. Tellus, 5, 585–98CrossRefGoogle Scholar
Janssen, P. A. E. M., Hansen, B. and Bidlot, J. R. (1997). Verification of the ECMWF wave forecasting system buoy and altimeter data. Weather Forecast., 12, 763–842.0.CO;2>CrossRefGoogle Scholar
Judd, K. (2003). Nonlinear state estimation, indistinguishable states and the extended Kalman filter, Physica D, 183, 273–81CrossRefGoogle Scholar
Judd, K. and Smith, L. A. (2001). Indistinguishable states. I: The perfect model scenario. Physica D, 125–41Google Scholar
Judd, K. and Smith, L. A. (2004). Indistinguishable states. II: Imperfect model scenario. Physica D, 196, 224–42Google Scholar
Kelly, J. L. Jr. (1956). A new interpretation of information rate. Bell System Technical J., 35(4), 917–26CrossRefGoogle Scholar
Kennedy, M. and Hagan, A. O. (2001). Bayesian calibration of computer codes. J. Roy. Stat. Soc. B, 63, 425–64CrossRefGoogle Scholar
Kleeman, R. (2002). Measuring dynamical prediction utility using relative entropy. J. Atmos. Sci., 50, 2057–722.0.CO;2>CrossRefGoogle Scholar
Krishnamurti, T. N., et al. (1999). Improved skills for weather and seasonal climate forecasts from multimodel superensemble. Science, Sept 3Google Scholar
Lorenz, E. N. (1985). The growth of errors in prediction. In Turbulence and Predictability in Geophysical Fluid Dynamics and Climate Dynamics, ed. Ghil, M., pp. 243–65. North HollandGoogle Scholar
Lorenz, E. N. and Emanuel, K. (1998). Optimal sites for supplementary weather observations. J. Atmos. Sci., 55, 399–4142.0.CO;2>CrossRefGoogle Scholar
Murphy, A. H. (1977). The value of climatological, categorical and probabilistic forecasts in the cost-loss ratio situation. Mon. Weather Rev., 105, 803–162.0.CO;2>CrossRefGoogle Scholar
Nagel, E. (1961). The Structure of Science. Harcourt, Brace and WorldGoogle Scholar
Orrell, D., Smith, L. A., Palmer, T. and Barkmeijer, J. (2001). Model error and operational weather forecasts. Nonlinear Proc. Geoph., 8, 357–71CrossRefGoogle Scholar
Palmer, T. N. (2001). A nonlinear perspective on model error. Quart. J. Roy. Meteor. Soc., 127, 279–304Google Scholar
Palmer, T. N. (2002). The economic value of ensemble forecasts as a tool for risk assessment: from days to decades. Quart. J. Roy. Meteor. Soc., 128, 747–74CrossRefGoogle Scholar
Popper, K. (1956). The Open Universe. Routledge. Reprinted 1982Google Scholar
Richardson, D. S. (2000). Skill and relative economic value of the ECMWF ensemble prediction system. Quart. J. Roy. Meteor. Soc., 126, 649–68CrossRefGoogle Scholar
Roulston, M. S. and Smith, L. A. (2002). Evaluating probabilistic forecasts using information theory. Mon. Weather Rev., 130(6), 1653–602.0.CO;2>CrossRefGoogle Scholar
Roulston, M. S. and Smith, L. A. (2003). Combining dynamical and statistical ensembles. Tellus, 55A, 16–30CrossRefGoogle Scholar
Roulston, M. S. and Smith, L. A. (2004). The boy who cried wolf revisited: the impact of false alarm intolerance on cost-loss scenarios. Weather Forecast., 19(2), 391–72.0.CO;2>CrossRefGoogle Scholar
Roulston, M. S., Ziehmann, C. and Smith, L. A. (2001). A Forecast Reliability Index from Ensembles: A Comparison of Methods. Report. Deutscher WetterdienstGoogle Scholar
Roulston, M. S., Kaplan, D. T., Hardenberg, J. and Smith, L. A. (2003). Using medium range weather forecasts to improve the value of wind energy production. Renewable Energy, 28(4), 585–602CrossRefGoogle Scholar
Roulston, M. S., Ellepola, J., J. von Hardenberg and Smith, L. A. (2005). Forecasting wave height probabilities with numerical weather prediction models. Ocean Eng., 32, 1841–63CrossRefGoogle Scholar
Smith, L. A. (1996). Accountability and error in forecasts. In Proceedings of the 1995 Predictability Seminar, ECMWF
Smith, L. A. (1997). The Maintenance of Uncertainty. In Proceedings of the International School of Physics (Enrico Fermi), Course ⅭXXXIII, ed. G. Cini (Societa Italiana di Fisica, Bologna), pp. 177–368Google Scholar
Smith, L. A. (2001). Disentangling uncertainty and error: on the predictability of nonlinear systems. In Nonlinear Dynamics and Statistics, ed. Mees, A. I., pp. 31–64, Boston: BirkhauserGoogle Scholar
Smith, L. A. (2002). What might we learn from climate forecasts?Proc. Nat. Acad. Sci., 99, 2487–92CrossRefGoogle ScholarPubMed
Smith, L. A., Roulston, M. and Hardenberg, J. (2001). End to End Ensemble Forecasting: Towards Evaluating the Economic Value of the Ensemble Prediction System. Technical Memorandum 336. ECMWFGoogle Scholar
Smith, L. A., Altalo, M. and Ziehmann, C. (2005). Predictive distributions from an ensemble of weather forecasts: extracting California electricity demand from imperfect weather models. Physica D (in press)Google Scholar
Stainforth, D. A., Aina, T., Christensen, C., et al. (2005). Evaluating uncertainty in the climate response to changing levels of greenhouse gases. Nature 433(7024), 403–6CrossRefGoogle Scholar
Weisheimer, A., L. A. Smith and K. Judd (2005). A new view of seasonal forecast skill: bounding boxes from the DEMETER ensemble forecasts. Tellus, 57A, 265–79CrossRef

Save book to Kindle

To save this book to your Kindle, first ensure coreplatform@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about saving to your Kindle.

Note you can select to save to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

Available formats
×

Save book to Dropbox

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Dropbox.

Available formats
×

Save book to Google Drive

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Google Drive.

Available formats
×