Skip to main content Accessibility help
×
Home

Using Meta-Analysis for Large-Scale Ecosystem Service Valuation: Progress, Prospects, and Challenges

  • Robert J. Johnston and Dana Marie Bauer

Abstract

This article discusses prospects and challenges related to the use of meta-regression models (MRMs) for ecosystem service benefit transfer, with an emphasis on validity criteria and post-estimation procedures given sparse attention in the ecosystem services literature. We illustrate these topics using a meta-analysis of willingness to pay for water quality changes that support aquatic ecosystem services and the application of this model to estimate water quality benefits under alternative riparian buffer restoration scenarios in New Hampshire's Great Bay Watershed. These illustrations highlight the advantages of MRM benefit transfers, together with the challenges and data needs encountered when quantifying ecosystem service values.

  • View HTML
    • Send article to Kindle

      To send this article to your Kindle, first ensure no-reply@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about sending to your Kindle. Find out more about sending to your Kindle.

      Note you can select to send to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be sent to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

      Find out more about the Kindle Personal Document Service.

      Using Meta-Analysis for Large-Scale Ecosystem Service Valuation: Progress, Prospects, and Challenges
      Available formats
      ×

      Send article to Dropbox

      To send this article to your Dropbox account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your <service> account. Find out more about sending content to Dropbox.

      Using Meta-Analysis for Large-Scale Ecosystem Service Valuation: Progress, Prospects, and Challenges
      Available formats
      ×

      Send article to Google Drive

      To send this article to your Google Drive account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your <service> account. Find out more about sending content to Google Drive.

      Using Meta-Analysis for Large-Scale Ecosystem Service Valuation: Progress, Prospects, and Challenges
      Available formats
      ×

Copyright

This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution, and reproduction in any medium, provided the original work is properly cited.

Corresponding author

Correspondence: Robert J. Johnston, George Perkins Marsh Institute Clark University, 950 Main St., Worcester, MA 01610, USA, Email: rjohnston@clarku.edu

Footnotes

Hide All

Submitted for the Special Issue associated with the USDA Workshop, Applications and Potential of Ecosystem Services Valuation within USDA – Advancing the Science.

Footnotes

References

Hide All
Abbasi, T. 2012. Water Quality Indices. Amsterdam: Elsevier.
Bagstad, K.J., Semmens, D.J., Waage, S., and Winthrop, R.. 2013. “A Comparative Assessment of Decision-Support Tools for Ecosystem Services Quantification and Valuation.” Ecosystem Services 5: 2739.
Barton, D.N. 2002. “The Transferability of Benefit Transfer: Contingent Valuation of Water Quality Improvements in Costa Rica.” Ecological Economics 42(1–2): 147164.
Bateman, I.J., Brouwer, R., Ferrini, S., Schaafsma, M., Barton, D.N., Dubgaard, A., Hasler, B., et al. 2011a. “Making Benefit Transfers Work: Deriving and Testing Principles for Value Transfers for Similar and Dissimilar Sites Using a Case Study of the Non-market Benefits of Water Quality Improvements across Europe.” Environmental and Resource Economics 50(3): 365387.
Bateman, I.J., Day, B.H., Georgiou, S., and Lake, I.. 2006. “The Aggregation of Environmental Benefit Values: Welfare Measures, Distance Decay and Total WTP.” Ecological Economics 60(2): 450460.
Bateman, I.J., and Jones, A.P.. 2003. “Contrasting Conventional with Multi-level Modeling Approaches to Meta-analysis: Expectation Consistency in UK Woodland Recreation Values.” Land Economics 79(2): 235258.
Bateman, I.J., Mace, G.M., Fezzi, C., Atkinson, G., and Turner, K.. 2011b. “Economic Analysis for Ecosystem Service Assessments.” Environmental and Resource Economics 48(2): 177218.
Bauer, D.M., and Johnston, R.J.. 2017. Buffer Options for the Bay: Economic Valuation of Water Quality Ecosystem Services in New Hampshire's Great Bay Watershed. Great Bay National Estuarine Research Reserve, Greenland, NH.
Bergstrom, J.C., and Taylor, L.O.. 2006. “Using Meta-analysis for Benefits Transfer: Theory and Practice.” Ecological Economics 60(2): 351360.
Bishop, R.C., and Boyle, K.J.. 2019. “Reliability and Validity in Nonmarket Valuation.” Environmental and Resource Economics 72(2): 559582.
Bockstael, N.E., Freeman, A.M., Kopp, R.J., Portney, P.R., and Smith, V.K.. 2000. “On Measuring Economic Values for Nature.” Environmental Science and Technology 34(8): 13841389.
Boyd, J., Ringold, P., Krupnick, A., Johnston, R.J., Weber, M.A., and Hall, K.. 2016. “Ecosystem Services Indicators: Improving the Linkage between Biophysical and Economic Analyses.” International Review of Environmental and Resource Economics 8(3–4): 359443.
Boyle, K.J., Kaul, S., and Parmeter, C.F.. 2015. “Meta-analysis: Econometric Advances and New Perspectives towards Data Synthesis and Robustness.” In Johnston, R.J., Rolfe, J., Rosenberger, R.S., and Brouwer, R., eds. Benefit Transfer of Environmental and Resource Values: A Guide for Researchers and Practitioners. Dordrecht, the Netherlands: Springer, pp. 383418.
Boyle, K.J., Kotchen, M.J., and Smith, V.K.. 2017. “Deciphering Dueling Analyses of Clean Water Regulations.” Science 358(6359): 4950.
Boyle, K.J., Kuminoff, N.V., Parmeter, C.F., and Pope, J.C.. 2009. “Necessary Conditions for Valid Benefit Transfers.” American Journal of Agricultural Economics 91(5): 13281334.
Boyle, K.J., Parmeter, C.F., Boehlert, B.B., and Paterson, R.W.. 2013. “Due Diligence in Meta-analyses to Support Benefit Transfers.” Environmental and Resource Economics 55(3): 357386.
Boyle, K.J., and Wooldridge, J.M.. 2018. “Understanding Error Structures and Exploiting Panel Data in Meta-analytic Benefit Transfers.” Environmental and Resource Economics 69(3): 609635.
Brander, L.M., Bräuer, I., Gerdes, H., Ghermandi, A., Kuik, O., Markandya, A., Navrud, S., et al. 2012. “Using Meta-analysis and GIS for Value Transfer and Scaling Up: Valuing Climate Change Induced Losses of European Wetlands.” Environmental and Resource Economics 52(3): 395413.
Cude, C.G. 2001. “Oregon Water Quality Index: A Tool for Evaluating Water Quality Management Effectiveness.” Journal of the American Water Resources Association 37(1):125137.
Ferrini, S., Schaafsma, M., and Bateman, I.J.. 2015. “Ecosystem Services Assessment and Benefit Transfer.” In Johnston, R.J., Rolfe, J., Rosenberger, R.S., and Brouwer, R., eds. Benefit Transfer of Environmental and Resource Values: A Guide for Researchers and Practitioners. Dordrecht, the Netherlands: Springer, pp. 275305.
Glenk, K., Johnston, R.J., Meyerhoff, J., and Sagebiel, J.. 2019. “Spatial Dimensions of Stated Preference Valuation in Environmental and Resource Economics: Methods, Trends and Challenges.” Environmental and Resource Economics. https://doi.org/10.1007/s10640-018-00311-w
Greene, W.H. 2012. Econometric Analysis (7th edition). Upper Saddle River, NJ: Prentice Hall.
Griffiths, C., Klemick, H., Massey, M., Moore, C., Newbold, S., Simpson, D., Walsh, P., and Wheeler, W.. 2012. “US Environmental Protection Agency Valuation of Surface Water Quality Improvements.” Review of Environmental Economics and Policy 6(1): 130146.
Guignet, D., Heberling, M.T., Papenfus, M., Griot, O., and Holland, B.. 2019. “Property Values and Water Quality: A Nationwide Meta-analysis and the Implications for Benefit Transfer.” National Center for Environmental Economics Working Paper, 19-05, U.S. Environmental Protection Agency, Washington, DC.
Hoehn, J.P. 2006. “Methods to Address Selection Effects in the Meta Regression and Transfer of Ecosystem Values.” Ecological Economics 60(2): 389398.
Johnston, R.J., and Besedin, E.Y.. 2009. “Estimating Willingness to Pay for Aquatic Resource Improvements Using Benefits Transfer.” In Thurston, H.W., Heberling, M.T., and Schrecongost, A., eds. Environmental Economics for Watershed Restoration. Boca Raton, FL: CRC Press, pp. 95122.
Johnston, R.J., Besedin, E.Y., and Holland, B.M.. 2018. “Modeling Distance Decay within Valuation Meta-analysis.” Environmental and Resource Economics 72(3): 657690.
Johnston, R.J., Besedin, E.Y., Iovanna, R., Miller, C.J., Wardwell, R.F., and Ranson, M.H.. 2005. “Systematic Variation in Willingness to Pay for Aquatic Resource Improvements and Implications for Benefit Transfer: A Meta-analysis.” Canadian Journal of Agricultural Economics 53(2–3): 221248.
Johnston, R.J., Besedin, E.Y., and Ranson, M.H.. 2006. “Characterizing the Effects of Valuation Methodology in Function-Based Benefits Transfer.” Ecological Economics 60(2): 407419.
Johnston, R.J., Besedin, E.Y., and Stapler, R.. 2017. “Enhanced Geospatial Validity for Meta-analysis and Environmental Benefit Transfer: An Application to Water Quality Improvements.” Environmental and Resource Economics 68(2): 343375.
Johnston, R.J., Besedin, E.Y., and Wardwell, R.F.. 2003. “Modeling Relationships between Use and Nonuse Values for Surface Water Quality: A Meta-analysis.” Water Resources Research 39(12): 13631371.
Johnston, R.J., and Duke, J.M.. 2010. “Socioeconomic Adjustments and Choice Experiment Benefit Function Transfer: Evaluating the Common Wisdom.” Resource and Energy Economics 32(3): 421438.
Johnston, R.J., Holland, B.M., and Yao, L.. 2016. “Individualized Geocoding in Stated Preference Questionnaires: Implications for Survey Design and Welfare Estimation.” Land Economics 92(4): 737759.
Johnston, R.J., and Moeltner, K.. 2014. “Meta-modeling and Benefit Transfer: The Empirical Relevance of Source-Consistency in Welfare Measures.” Environmental and Resource Economics 59(3): 337361.
Johnston, R.J., Ranson, M.H., Besedin, E.Y., and Helm, E.C.. 2006. “What Determines Willingness to Pay per Fish? A Meta-analysis of Recreational Fishing Values.” Marine Resource Economics 21(1): 132.
Johnston, R.J., Rolfe, J., Rosenberger, R.S., and Brouwer, R.. 2015a. “Introduction to Benefit Transfer Methods.” In Johnston, R.J., Rolfe, J., Rosenberger, R.S., and Brouwer, R., eds. Benefit Transfer of Environmental and Resource Values: A Guide for Researchers and Practitioners. Dordrecht, the Netherlands: Springer, pp. 1959.
Johnston, R.J., Rolfe, J., and Zawojska, E.. 2018. “Benefit Transfer of Environmental and Resource Values: Progress, Prospects and Challenges.” International Review of Environmental and Resource Economics 12(2–3): 177266.
Johnston, R.J., and Rosenberger, R.S.. 2010. “Methods, Trends and Controversies in Contemporary Benefit Transfer.” Journal of Economic Surveys 24(3): 479510.
Johnston, R.J., Rosenberger, R.S., Rolfe, J., and Brouwer, R.. 2015b. “Benefit Transfer: The Present State and Future Prospects.” In Johnston, R.J., Rolfe, J., Rosenberger, R.S., and Brouwer, R., eds. Benefit Transfer of Environmental and Resource Values: A Guide for Researchers and Practitioners. Dordrecht, the Netherlands: Springer, pp. 553574.
Johnston, R.J., Schultz, E.T., Segerson, K., Besedin, E.Y., and Ramachandran, M.. 2012. “Enhancing the Content Validity of Stated Preference Valuation: The Structure and Function of Ecological Indicators.” Land Economics 88(1): 102120.
Johnston, R.J., and Thomassin, P.J.. 2010. “Willingness to Pay for Water Quality Improvements in the United States and Canada: Considering Possibilities for International Meta-analysis and Benefit Transfer.” Agricultural and Resource Economics Review 39(1): 114131.
Johnston, R.J., and Wainger, L.A.. 2015. “Benefit Transfer for Ecosystem Service Valuation: An Introduction to Theory and Methods.” In Johnston, R.J., Rolfe, J., Rosenberger, R.S., and Brouwer, R., eds. Benefit Transfer of Environmental and Resource Values: A Guide for Researchers and Practitioners. Dordrecht, the Netherlands: Springer, pp. 237273.
Kaul, S., Boyle, K.J., Kuminoff, N.V., Parmeter, C.F., and Pope, J.C.. 2013. “What Can We Learn from Benefit Transfer Errors? Evidence from 20 Years of Research on Convergent Validity.” Journal of Environmental Economics and Management 66(1): 90104.
Klemick, H., Griffiths, C., Guignet, D., and Walsh, P.. 2018. “Improving Water Quality in an Iconic Estuary: An Internal Meta-analysis of Property Value Impacts around the Chesapeake Bay.” Environmental and Resource Economics 69(2): 265292.
Kling, C.L., and Phaneuf, D.J.. 2018. “How Are Scope and Adding Up Relevant for Benefits Transfer?Environmental and Resource Economics 69(3): 483502.
Lindhjem, H., and Navrud, S.. 2008. “How Reliable Are Meta-analyses for International Benefit Transfers?Ecological Economics 66(2–3): 425435.
Londoño, L.M., and Johnston, R.J.. 2012. “Enhancing the Reliability of Benefit Transfer over Heterogeneous Sites: A Meta-analysis of International Coral Reef Values.” Ecological Economics 78: 8089.
Loomis, J.B., and Rosenberger, R.S.. 2006. “Reducing Barriers in Future Benefit Transfers: Needed Improvements in Primary Study Design and Reporting.” Ecological Economics 60(2): 343350.
McComb, G., Lantz, V., Nash, K., and Rittmaster, R.. 2006. “International Valuation Databases: Overview, Methods and Operational Issues.” Ecological Economics 60(2): 461472.
Moeltner, K. 2015. “Optimal Scope and Bayesian Model Search in Benefit Transfer.” In Johnston, R.J., Rolfe, J., Rosenberger, R.S., and Brouwer, R., eds. Benefit Transfer of Environmental and Resource Values: A Guide for Researchers and Practitioners. Dordrecht, the Netherlands: Springer, pp. 507523.
Moeltner, K. 2019. “Bayesian Nonlinear Meta Regression for Benefit Transfer.” Journal of Environmental Economics and Management 93: 4462.
Moeltner, K., Boyle, K.J., and Paterson, R.W.. 2007. “Meta-analysis and Benefit Transfer for Resource Valuation—Addressing Classical Challenges with Bayesian Modeling.” Journal of Environmental Economics and Management 53(2): 250269.
Moeltner, K., and Rosenberger, R.S.. 2014. “Cross-Context Benefit Transfer: A Bayesian Search for Information Pools.” American Journal of Agricultural Economics 96(2): 469488.
Nelson, J.P. 2015. “Meta-analysis: Statistical Methods.” In Johnston, R.J., Rolfe, J., Rosenberger, R.S., and Brouwer, R., eds. Benefit Transfer of Environmental and Resource Values: A Guide for Researchers and Practitioners. Dordrecht, the Netherlands: Springer, pp. 329356.
Nelson, J.P., and Kennedy, P.E.. 2009. “The Use (and Abuse) of Meta-analysis in Environmental and Resource Economics: An Assessment.” Environmental and Resource Economics 42(3): 345377.
Newbold, S., Simpson, R.D., Massey, D.M., Heberling, M.T., Wheeler, W., Corona, J., and Hewitt, J.. 2018a. “Benefit Transfer Challenges: Perspectives from U.S. Practitioners.” Environmental and Resource Economics 69(3): 467482.
Newbold, S., Walsh, P.J., Massey, D.M., and Hewitt, J.. 2018b. “Using Structural Restrictions to Achieve Theoretical Consistency in Benefit Transfers.” Environmental and Resource Economics 69(3): 529554.
Olander, L.P., Johnston, R.J., Tallis, H., Kagan, J., Maguire, L.A., Polasky, S., Urban, D., Boyd, J., Wainger, L., and Palmer, M.. 2018. “Benefit Relevant Indicators: Ecosystem Services Measures That Link Ecological and Social Outcomes.” Ecological Indicators 85: 12621272.
Olander, L., Polasky, S., Kagan, J.S., Johnston, R.J., Wainger, L., Saah, D., Maguire, L., Boyd, J., and Yoskowitz, D.. 2017. “So You Want Your Research to Be Relevant? Building the Bridge between Ecosystem Services Research and Practice.” Ecosystem Services 26A: 170182.
Plummer, M.L. 2009. “Assessing Benefit Transfer for the Valuation of Ecosystem Services.” Frontiers in Ecology and the Environment 7(1): 3845.
Richardson, L., Loomis, J., Kroeger, T., and Casey, F.. 2015. “The Role of Benefit Transfer in Ecosystem Service Valuation.” Ecological Economics 115: 5158.
Rolfe, J., Brouwer, R., and Johnston, R.J.. 2015. “Meta-analysis: Rationale, Issues and Applications.” In Johnston, R.J., Rolfe, J., Rosenberger, R.S., and Brouwer, R., eds. Benefit Transfer of Environmental and Resource Values: A Guide for Researchers and Practitioners. Dordrecht, the Netherlands: Springer, pp. 357381.
Rosenberger, R.S. 2015. “Benefit Transfer Validity and Reliability.” In Johnston, R.J., Rolfe, J., Rosenberger, R.S., and Brouwer, R., eds. Benefit Transfer of Environmental and Resource Values: A Guide for Researchers and Practitioners. Dordrecht, the Netherlands: Springer, pp. 307326.
Rosenberger, R.S., and Johnston, R.J.. 2009. “Selection Effects in Meta-analysis and Benefit Transfer: Avoiding Unintended Consequences.” Land Economics 85(3): 410428.
Rosenberger, R.S., and Loomis, J.B.. 2017. “Benefit Transfer.” In Champ, P.A., Boyle, K.J., and Brown, T.C., eds. A Primer on Nonmarket Valuation (2nd edition). Dordrecht, the Netherlands: Springer, pp. 431462.
Rosenberger, R.S., and Phipps, T.T.. 2007. “Correspondence and Convergence in Benefit Transfer Accuracy: Meta-analytic Review of the Literature.” In Navrud, S. and Ready, R., eds. Environmental Value Transfer: Issues and Methods. Dordrecht, the Netherlands: Springer, pp. 2343.
Schaafsma, M. 2015. “Spatial and Geographical Aspects of Benefit Transfer.” In Johnston, R.J., Rolfe, J., Rosenberger, R.S., and Brouwer, R., eds. Benefit Transfer of Environmental and Resource Values: A Guide for Researchers and Practitioners. Dordrecht, the Netherlands: Springer, pp. 421439.
Schultz, E.T., Johnston, R.J., Segerson, K., and Besedin, E.Y.. 2012. “Integrating Ecology and Economics for Restoration: Using Ecological Indicators in Valuation of Ecosystem Services.” Restoration Ecology 20(3): 304310.
Smith, V.K. 2018. “Benefits Transfer: Current Practice and Prospects.” Environmental and Resource Economics 69(3): 449466.
Smith, V.K., Houtven, G. Van, and Pattanayak, S.K.. 2002. “Benefit Transfer via Preference Calibration: ‘Prudential Algebra’ for Policy.” Land Economics 78(1): 132152.
Smith, V.K., and Pattanayak, S.K.. 2002. “Is Meta-analysis a Noah's Ark for Non-market Valuation?Environmental and Resource Economics 22(1–2): 271296.
Smith, V.K., Pattanayak, S.K., and Houtven, G. Van. 2006. “Structural Benefit Transfer: An Example Using VSL Estimates.” Ecological Economics 60(2): 361371.
Stanley, T.D. 2005. “Beyond Publication Bias.” Journal of Economic Surveys 19(3): 309345.
Stanley, T.D., and Doucouliagos, H.. 2012. Meta-regression Analysis in Economics and Business. New York: Routledge.
Stanley, T.D., Doucouliagos, H., Giles, M., Heckemeyer, J.H., Johnston, R.J., Laroche, P., Nelson, J.P., et al. 2013. “Meta-analysis of Economics Research Reporting Guidelines.” Journal of Economic Surveys 27(2): 390394.
Stapler, R.W., and Johnston, R.J.. 2009. “Meta-analysis, Benefit Transfer, and Methodological Covariates: Implications for Transfer Error.” Environmental and Resource Economics 42(2): 227246.
Sutherland, R.J., and Walsh, R.G.. 1985. “Effect of Distance on the Preservation Value of Water Quality.” Land Economics 61(3): 282290.
U.S. Environmental Protection Agency (U.S. EPA). 2009a. Environmental Impact and Benefits Assessment for Final Effluent Guidelines and Standards for the Construction and Development Category. EPA-821-R-09-012, Office of Science and Technology, Office of Water, U.S. EPA, Washington, DC.
U.S. Environmental Protection Agency (U.S. EPA). 2009b. “Nonmarket Benefits from Water Quality Improvements.” In Environmental Impact and Benefits Assessment for Final Effluent Guidelines and Standards for the Construction and Development Category. EPA-821-R-09-012, U.S. EPA, Washington, DC, pp. 10-110-27.
U.S. Environmental Protection Agency (U.S. EPA). 2010. Economic Analysis of Final Water Quality Standards for Nutrients for Lakes and Flowing Waters in Florida. Office of Science and Technology, Office of Water, U.S. EPA, Washington, DC.
U.S. Environmental Protection Agency (U.S. EPA). 2012. Economic Analysis of Proposed Water Quality Standards for the State of Florida's Estuaries, Coastal Waters, and South Florida Inland Flowing Waters. Office of Science and Technology, Office of Water, U.S. EPA, Washington, DC.
U.S. Environmental Protection Agency (U.S. EPA). 2015. Benefit and Cost Analysis for the Proposed Effluent Limitations Guidelines and Standards for the Steam Electric Power Generating Point Source Category. EPA-821-R-15-005, Office of Science and Technology, Office of Water, U.S. EPA, Washington, DC.
Van Houtven, G., Mansfield, C., Phaneuf, D.J., von Haefen, R., Milstead, B., Kenney, M.A., and Reckhow, K.H.. 2014. “Combining Expert Elicitation and Stated Preference Methods to Value Ecosystem Services from Improved Lake Water Quality.” Ecological Economics 99: 4052
Van Houtven, G., Powers, J., and Pattanayak, S.K.. 2007. “Valuing Water Quality Improvements in the United States Using Meta-analysis: Is the Glass Half-Full or Half-Empty for National Policy Analysis?Resource and Energy Economics 29(3): 206228.
Walsh, J.P., and Wheeler, W.J.. 2013. “Water Quality Indices and Benefit-Cost Analysis.” Journal of Benefit-Cost Analysis 4(1): 81105.
Zandersen, M., and Tol, R.S.J.. 2009. “A Meta-analysis of Forest Recreation Values in Europe.” Journal of Forest Economics 15(1–2): 109130.

Keywords

Using Meta-Analysis for Large-Scale Ecosystem Service Valuation: Progress, Prospects, and Challenges

  • Robert J. Johnston and Dana Marie Bauer

Metrics

Full text views

Total number of HTML views: 0
Total number of PDF views: 0 *
Loading metrics...

Abstract views

Total abstract views: 0 *
Loading metrics...

* Views captured on Cambridge Core between <date>. This data will be updated every 24 hours.

Usage data cannot currently be displayed