Hostname: page-component-8448b6f56d-wq2xx Total loading time: 0 Render date: 2024-04-18T16:28:19.909Z Has data issue: false hasContentIssue false

Evaluating the transferability of empirical models of debris-covered glacier melt

Published online by Cambridge University Press:  08 September 2020

A. Winter-Billington*
Affiliation:
Department of Geography, University of British Columbia, Canada
R. D. Moore
Affiliation:
Department of Geography, University of British Columbia, Canada
R. Dadic
Affiliation:
Antarctic Research Centre, Victoria University of Wellington, New Zealand
*
Author for correspondence: A. Winter-Billington, E-mail: winter-billington@alumni.ubc.ca
Rights & Permissions [Opens in a new window]

Abstract

Supraglacial debris is significant in many regions and complicates modeling of glacier melt, which is required for predicting glacier change and its influences on hydrology and sea-level rise. Temperature-index models are a popular alternative to energy-balance models when forcing data are limited, but their transferability among glaciers and inherent uncertainty have not been documented in application to debris-covered glaciers. Here, melt factors were compiled directly from published studies or computed from reported melt and MERRA-2 air temperature for 27 debris-covered glaciers around the world. Linear mixed-effects models were fit to predict melt factors from debris thickness and variables including debris lithology and MERRA-2 radiative exchange. The models were tested by leave-one-site-out cross-validation based on predicted melt rates. The best model included debris thickness (fixed effect) and glacier and year (random effects). Predictions were more accurate using MERRA-2 than on-site air temperature data, and pooling MERRA-2-derived and reported melt factors improved cross-validation accuracy more than including additional predictors such as shortwave or longwave radiation. At one glacier where monthly ablation was measured over 4 years, seasonal variation of melt factors suggested that heat storage significantly affected the relation between melt and energy exchange at the debris surface.

Type
Article
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution, and reproduction in any medium, provided the original work is properly cited.
Copyright
Copyright © The Author(s) 2020

Introduction

Glacier melt contributes significantly to streamflow and is important for hydro-electric power generation and irrigation in many places around the world (IPCC, 2014). Glacier melt is also contributing to the global sea-level response to climate change (Radić and Hock, Reference Radić and Hock2014). To address the effects of ongoing and future glacier changes on water resources, glacier-related hazards and sea-level rise, managers and policy-makers depend on the output from melt models driven by climate data. Being able to quantify the uncertainties in estimated glacier melt provides decision-makers a basis for assessing risks associated with different management options.

The physical processes controlling glacier surface melt are well understood and energy-balance models are accurate at a range of scales (Hock, Reference Hock2005). However, energy-balance models are computationally demanding and require extensive input data that may not be available or reliable over large regions. Temperature-index models (TIM) only require air temperature as an input, which can often be interpolated from ground-based weather stations or extracted from reanalysis products with reasonable accuracy at the basin scale (Stahl and others, Reference Stahl, Moore, Floyer, Asplin and McKendry2006; Rienecker and others, Reference Rienecker2011; Trubilowicz and others, Reference Trubilowicz, Shea, Jost and Moore2016; Gelaro and others, Reference Gelaro2017). TIM are adequate for a wide range of applications and can even exceed the performance of energy-balance models when forcing data are limited (Gabbi and others, Reference Gabbi, Carenzo, Pellicciotti, Bauder and Funk2014; Réveillet and others, Reference Réveillet2018). However, the physical processes explicitly represented in energy-balance models are reduced to simplified, site-specific empirical parametrizations in TIM, which may limit their transferability.

Debris-covered glaciers are a relatively small but significant part of the global cryosphere. Estimates vary, but recent work found 4.39% (Scherler and others, Reference Scherler, Wulf and Gorelick2018) to 16.8% (Sasaki and others, Reference Sasaki, Noguchi, Zhang, Hirabayashi and Kanae2016) of the global glacierized area outside Greenland and Antarctica to be debris-covered – up to 47.4% by region. Theory, models and recent observations suggest the extent of supraglacial debris cover is increasing as glaciers recede (Bozhinskiy and others, Reference Bozhinskiy, Krass and Popovnin1986; Mayer and others, Reference Mayer, Lambrecht, Hagg and Narozhny2011; Scherler and others, Reference Scherler, Wulf and Gorelick2018). The accuracy of models of debris-covered glacier melt is therefore an increasingly important area of research.

The surface exchanges of mass and energy that lead to ice melting under debris are different to those of snow, firn and ice, because debris temperatures can exceed 0°C. In most conditions, sublimation is expected to be negligible under debris so that surface ablation occurs entirely by melt (Bozhinskiy and others, Reference Bozhinskiy, Krass and Popovnin1986; Conway and Rasmussen, Reference Conway and Rasmussen2000). Like melt of bare ice, sub-debris melt has been well reproduced by energy-balance models applied at point and glacier scales (Nakawo and Young, Reference Nakawo and Young1982; Haidong and others, Reference Haidong, Yongjing and Shiyin2006; Reid and Brock, Reference Reid and Brock2010; Reid and others, Reference Reid, Carenzo, Pellicciotti and Brock2012; Lejeune and others, Reference Lejeune, Bertrand, Wagnon and Morin2013; Brown and others, Reference Brown2014; Collier and others, Reference Collier, Nicholson, Brock, Maussion, Essery and Bush2014). However, the observational data to develop, calibrate and drive energy-balance models are as rare in debris-covered environments as elsewhere. As an alternative, a number of empirical models based on the temperature index approach have been developed for sub-debris melt (Booker and Dunbar, Reference Booker and Dunbar2008; Carenzo and others, Reference Carenzo, Pellicciotti, Mabillard, Reid and Brock2016; Möller and others, Reference Möller, Möller, Kukla and Schneider2016).

Observations show that melt rate and its sensitivity to meteorological forcing decreases as debris thickness (h) increases from an effective thickness (h c) of around 0.02–0.05 m (Østrem, Reference Østrem1959; Reznichenko and others, Reference Reznichenko, Davies, Shulmeister and McSaveney2010; Singh and others, Reference Singh, Banerjee, Nainwal and Shankar2019). Many debris-covered glacier TIM include a dependence on debris thickness and some include additional variables such as incident solar radiation (e.g. Zhang and others, Reference Zhang, Liu and Ding2007; Ragettli and others, Reference Ragettli, Pellicciotti, Bordoy and Immerzeel2013; Ayala and others, Reference Ayala2016; Carenzo and others, Reference Carenzo, Pellicciotti, Mabillard, Reid and Brock2016; Möller and others, Reference Möller, Möller, Kukla and Schneider2016; Hagg and others, Reference Hagg2018). Few studies have quantified the transferability of empirical sub-debris melt models, or the associated uncertainty in melt estimates.

The key parameter in TIM is the melt factor (k) that relates melt to air temperature. Melt factors have been applied to predict melt of debris-covered glaciers in at least 16 reported studies. The melt factors applied in those 16 studies, listed in Tables 1 and 2, vary over two orders of magnitude. Only three of the 16 values were calculated using measurements of melt; the remaining 13 melt factors were calculated using melt modeled with an energy-balance scheme, modeled as a function of bare ice melt, modeled using an assumed statistical distribution, or defined a priori. There is currently no statistically robust method for selecting melt factors for debris-covered glaciers where data for calibration are unavailable, and the accuracy of predictions made with transferred, assumed or modeled melt factors remains difficult to quantify.

Table 1. Classical sub-debris melt factors, k (mm°C−1δt −1), that have been applied to model sub-debris melt with time intervals (δt) of an hr = hour, d = day or m = month

Subscript i is for bare ice, snow or both. h is debris thickness (m), and k R denotes a restricted melt factor calculated with air temperature as one of a set of predictor variables.

Table 2. Restricted sub-debris melt factors, kR, calculated with air temperature as one of a set of predictors, that have been applied to model sub-debris melt

Units and notation as in Table 1.

No studies appear to have examined the effect of the provenance of air temperature data on the accuracy of transferred sub-debris melt factors, which has been shown to affect the transferability of k for bare snow and ice (Lang and Braun, Reference Lang and Braun1990; Hock and others, Reference Hock, Radić and De Woul2007; Wheler and others, Reference Wheler, MacDougall, Flowers, Petersen, Whitfield and Kohfeld2014). Consequently, it is unclear whether sub-debris melt factors calculated using air temperature data measured at an on-glacier weather station, for example, can be used to accurately predict melt using input data interpolated from a remote weather station or gridded climate data.

Gridded climate reanalysis products are increasingly used in hydrological and glaciological modeling because they provide broader spatial and temporal coverage and continuity than many traditional data sources (e.g. Koppes and others, Reference Koppes, Rupper, Asay and Winter-Billington2015; Hagg and others, Reference Hagg2018). However, if data provenance is critical to the accuracy of TIM, it would be inappropriate to use climate reanalysis data with melt factors derived from ground-based temperature observations; instead, k derived from climate reanalysis air temperature would be required.

A popular reanalysis product is The Modern-Era Retrospective analysis for Research and Applications, Version 2 (MERRA-2) from the US National Aeronautics and Space Administration (NASA). It provides surface climate fields from 1980 to present, lagging a few weeks behind real time. It has six-hourly temporal resolution and 0.5° × 0.65° spatial resolution. It has been applied successfully to model melt of debris-free glaciers over extended regions (Mernild and others, Reference Mernild, Liston and Hiemstra2014). Application of MERRA-2 to model melt of debris-covered glaciers has not yet been tested.

The objectives of this study were to (1) quantify the accuracy of classical TIM and extended TIM for debris-covered glaciers, (2) test whether air temperature data provenance affects prediction accuracy, (3) derive a generalizable relation for sub-debris melt factors that can be transferred with a known margin of error, and (4) evaluate the usefulness of MERRA-2 data for modeling sub-debris glacier melt.

Definition and calculation of melt factors

Temperature index models relate surface ablation to air temperature as follows:

(1)$$A = k \cdot {\rm \it{PDD}} $$

where A is cumulative ablation (mm w.e.) over an observation period, k is the melt factor and PDD is the sum of positive degree-days (°C Δt). Thorough reviews of temperature index modeling of debris-free glaciers were given by Ohmura (Reference Ohmura2001) and Hock (Reference Hock2003). Time steps (δt) vary between studies (e.g. hours, days or months), which makes it difficult to directly compare values of k. In practice, δt = 1 day is most common, so the units of k are mm w.e. °C−1 d−1. For simplicity and to permit direct comparison, only data and models for δt = 1 day are included in this analysis. The following relation is used to calculate PDD:

(2)$$\eqalign{& {\rm \it{PDD}} = \delta d\sum\limits_{i = 1}^{n_{\rm d}} {\rm (} T_i-T_b{\rm )}\cdot \delta {\rm (}T_i{\rm )} \cr & {\rm with}\;\;\;\;\delta {\rm (}T_i{\rm )} = \left\{ {\matrix{ {1,} & {{\rm if }\;T_i \ge T_b} \cr {0,} & {{\rm if }\;T_i < T_b} \cr } } \right.}$$

where T is mean air temperature for each day, subscript i is one day in the observation period of n d days, T b is a threshold air temperature below which ablation ceases and δ(T) is a binary variable that sets ablation to zero below the temperature threshold. T b is often set to 0°C, but non-zero values have been found in some studies (Pellicciotti and others, Reference Pellicciotti, Buergi, Immerzeel, Konz and Shrestha2012). In this work, ablation was standardized as a mean rate, a (mm w.e. d−1):

(3)$$a = {A\over n_{\rm d}}$$

and mean positive degree-days, D (°C), were used to enable comparison, calculated as

(4)$$D = {{\rm \it{PDD}}\over n_{\rm d}}$$

In this paper, the term ‘classical’ is used to distinguish melt factors calculated with only air temperature and debris thickness as the predictors (k), as in Table 1. Extended models with one or more predictors in addition to air temperature, such as incident shortwave radiation or surface slope, have been developed with a range of different formulations (e.g. Hock, Reference Hock1999; Pellicciotti and others, Reference Pellicciotti, Brock, Strasser, Burlando, Funk and Corripio2005; Carenzo and others, Reference Carenzo, Pellicciotti, Mabillard, Reid and Brock2016; Möller and others, Reference Möller, Möller, Kukla and Schneider2016). When air temperature is one of a larger set of predictor variables, as in Table 2, the coefficient associated with air temperature is called a ‘restricted’ melt factor (k R) (Kustas and others, Reference Kustas, Rango and Uijlenhoet1994). Restricted melt factors are not directly comparable to classical melt factors. Models with restricted melt factors, including predictors in addition to air temperature and debris thickness (such as solar radiation or surface characteristics), are called ‘extended TIM’.

Data collection and preparation

Overview

Data for this study were gathered from free digital archives. Observed cumulative melt, A, melt rates, a, and melt factors, k o, were compiled from existing publications. A literature search was conducted through the University of British Columbia library databases and Google Scholar using combinations of the keywords ‘glacier’, ‘ice’, ‘debris’, ‘rock’, ‘ablation’, ‘melt’, ‘melt factor’, ‘temperature index’, ‘empirical’ and ‘model’. Metadata in the publications were also collected, including geographic coordinates and site elevation, observation date and period, observational set-up, debris thickness, lithology and texture and observed air temperature. If the resolution of the geographic coordinates was low, Google Earth Pro was used to ground-truth and adjust them to a rough mid-point within the debris-covered area of each glacier (as it appears in the composite images in Google Earth Pro). Additional spatial data representing elements of the surface energy balance at the time and place of observation were collected to explore causes of variability in the observations. These were taken from MERRA-2 climate reanalysis and WorldClim V2, additional publications and geological maps. The data are included in the Supplementary Material. Procedures followed in data collection are detailed below.

The symbols, units and resolution of the data and variables used are listed with data sources in Table 3. Throughout this paper, data provenance is distinguished by a letter. The subscript ‘o’ stands for ‘observed’ and is used to identify variables, models and metrics associated with observational data copied directly from the literature. The letter ‘M’ is used to distinguish variables extracted from MERRA-2, or melt factors calculated using MERRA-2 air temperature data with observed melt rates. The letter ‘P’ stands for ‘pooled’, and is used for the observational and MERRA-2-derived melt factors combined as a single variable. The letter ‘d’ is used for melt factors calculated for Dokriani Glacier alone, using MERRA-2 air temperature data and observed melt rates.

Table 3. Data and variables

Continentality, C, is computed as an annual mean value. All other numeric predictor variables are daily means.

Melt rates and melt factors

The observational data are from 27 individual glaciers located in North America, Europe, Asia, Svalbard, Iceland and New Zealand, with observation points ranging from 140 to 5350 m a.s.l. and −43 ° to 78 ° latitude. The data are individual measurements of melt and were copied directly from text and tables or by digitizing plots. In the instances where corresponding values of a and k o were published together, both were used, but separately. New melt factors, k M, were computed using Eqn (1) with observed melt rates and mean positive degree-days calculated with MERRA-2 air temperature data, D. Four complete years of data from Dokriani Glacier, Central Himalaya, which were published in Pratap and others (Reference Pratap, Dobhal, Mehta and Bhambri2015), were generously contributed as a data file by those authors. As a subset of k M, melt factors calculated for Dokriani Glacier are denoted k d.

A total of seven observations from the period before 1980 were found in the literature: one from a 1956 study of Isfallsglaciären published in Østrem (Reference Østrem1959), and six from a 1979 study of Peyto Glacier published in Nakawo and Young (Reference Nakawo and Young1981). The MERRA-2 climate reanalysis project covers the period from 1980 to present. To avoid introducing uncertainty by using more than one source of climate reanalysis data, this study was limited to the period from 1980 to present and the observations from Isfallsglaciären and Peyto Glacier were excluded.

‘Thick’ debris is thought to cover more than twice the area of ‘thin’ debris globally (Sasaki and others, Reference Sasaki, Noguchi, Zhang, Hirabayashi and Kanae2016). To isolate the ‘insulation effect’ of ‘thick’ debris, only data for debris thickness exceeding the critical thickness (h > h c) were included, where h c = 0.05 m for all glaciers except Summit Crater Glacier (Richardson and Brook, Reference Richardson and Brook2010), for which h c = 0.07 m was used. To allow direct comparison among sites, only ‘classical’ values of observed melt factors (k o) and studies focused on melting ice (rather than snow or firn) were included.

Following personal communication with the authors, the values of k o reported in Richardson and Brook (Reference Richardson and Brook2010) were corrected by applying a factor of 10−1, and the units of k o stated in Table 2 of Koppes and others (Reference Koppes, Rupper, Asay and Winter-Billington2015) were confirmed to be mm w.e. °C−1 d−1, not m °C−1 a−1 as stated in the text of page 7. Of multiple units for k o reported in Hagg and others (Reference Hagg, Mayer, Lambrecht and Helm2008), mm w.e. K−1 d−1 was assumed to be correct because cm K−1 d−1 would be unusually large.

Data processing was conducted using the R programming language (R Core Team, 2017) in R Studio. To allow comparison with observed air temperature reported as daily mean values, and of observation periods ranging from days to years, melt sums were converted to melt rates using Eqn (3). In all cases where melt rates were reported in units of water equivalent, the value for ice density used in unit conversion was stated in the corresponding publications to be 890 kg m−3. Therefore, both a and k o that were not reported in water equivalent units were standardized to mm w.e. with an assumed ice density of 890 kg m−3.

Two data subsets from Dokriani Glacier (n = 24) (Pratap and others, Reference Pratap, Dobhal, Mehta and Bhambri2015) and one from Pichillancahue–Turbio Glacier (n = 3) (Brock and others, Reference Brock, Rivera, Casassa, Bown and Acuña2007) were omitted because they exhibited a positive correlation between melt rate and debris thickness, indicating the insulation signal was confounded by other processes in those instances. The final dataset included 561 individual observations, consisting of 86 melt factors (from 12 different glaciers) and 482 melt rates (from 21 different glaciers, 235 from Dokriani Glacier). The glacier locations are shown in Figure 1. Observed melt factors (k o) ranged from 0.30 to 18.40 mm w.e. °C−1 d−1, and debris thickness ranged from 0.05 to 0.65 m. Melt factors computed with MERRA-2 positive degree-days (k M) ranged from 0.06 to 16.89 mm w.e. °C−1 d−1 and h from 0.05 to 1.20 m. The number of data points from each glacier, summary statistics for k o and data references are provided in Tables 6 and 7, Appendix A.

Fig. 1. The location of debris-covered glaciers in this study (blue diamonds). Symbol size indicates the number of individual observations from each glacier, on a continuous scale. The black polygons are the Randolph Glacier Inventory (RGI) 6.0 first-order glaciological regions (RGI Consortium, 2017), labeled with their numeric IDs. The white areas are the RGI 6.0 glacier outlines, Greenland and Antarctica. The background map is based on data from naturalearthdata.com.

Air temperature, shortwave and longwave radiation, surface temperature

On-site air temperatures were provided in 17 of the source publications, either as a multi-day mean or as a time series. Daily mean air temperature for each melt observation period, T o, was assumed to be equal to the multi-day mean in the absence of a time series.

The NASA Earthdata subsetter tool (https://earthdata.nasa.gov) was used to extract meteorological data from MERRA-2 products for grid cells that contained the ground-truthed coordinates for each glacier. Four MERRA-2 data collections were used. The variable for 2 m air temperature (T2) was extracted from the collection inst1_2d_asm_Nx (2-dimensional, 1-Hourly, Instantaneous, Single-Level, Assimilation, Single-Level Diagnostics, V5.12.4; Global Modelling and Assimilation Office, (GMAO, 2015b)). Surface skin temperature (T s), incoming and net shortwave radiation (SWin, SWnet), and incoming, outgoing and net longwave radiation (LWa, LWe, LWnet) were taken from the collection tavg1_2d_rad_Nx (2-dimensional, 1-Hourly, Time-Averaged, Single-Level, Assimilation, Radiation Diagnostics, V5.12.4) (GMAO, 2015c). Grid cell elevation (E M) was extracted from the constants file, const_2d_asm_Nx (2d, Constants, V5.12.4) (GMAO, 2015a).

Elevation lapse rates (Γ) were used to adjust T2 to the elevation of observations (E o, in m a.s.l.) that was reported with k o and/or a, as follows:

(5)$$T_{{\rm M}\comma j} = T2_{\,j} + \Gamma_j\lpar E_{{\rm o}\comma j} - E_{{\rm M}\comma j}\rpar $$

for each observation site j. Two approaches were used to arrive at values for Γj. First, a constant value of 6.5°C km−1 was assumed and applied uniformly for all j. Second, free-atmosphere lapse rates were calculated for each grid cell from the tavg3_3d_asm_Nv collection (3-dimensional, 3-Hourly, Time-Averaged, Model-Level, Assimilation, Assimilated Meteorological Fields, V5.12.4) model-levels 72 and 71 (respectively, surface-adjacent and second from surface) (GMAO, 2015d) and applied site by site. The elevation-adjusted MERRA-2 air temperature variables were compared to T o to evaluate which best represented on-glacier conditions. T M with ΓC = 6.5°C km−1 was found to be in closest agreement with T o and was therefore used for the remainder of the study (see Appendix B ‘Comparison of MERRA-2 and on-site air temperature data’ for details). Positive degree-days were calculated from T M following Eqn (2) and converted to daily mean positive degree-days, D, using Eqn (4), to match the period of a.

Albedo

Albedo was extracted from the tavg1_2d_rad_Nx collection and averaged over each observation period. Given the spatial mismatch of observations and the MERRA-2 grid, and given the availability of albedo products from satellite imagery, higher resolution albedo from MODIS and Landsat 5 TM (αML) was also obtained, using Google Earth Engine. To avoid bias from patches of debris-free ice, ice cliffs and supraglacial ponds, αML was collected from nearby moraine rather than the glacier surface, and the moraine was identified manually. Cloud cover prevented the record of albedo during some of the observation periods. In those cases, values reported for the day nearest the date of observation were used. Albedo taken both from MERRA-2 and from MODIS and Landsat was found to vary with time, presumably due to the change of the incidence angle of solar radiation. Correcting such effects was beyond the scope of this study.

Debris geology

Geological information about the debris was provided in few of the source publications. When not stated in the source publication, debris rock type was found in a related publication or digital geological map. The debris was assumed to have the same lithology as the dominant basin bedrock in the absence of more specific information. The distribution of k in bins of debris geology at the order of, for example, limestone, granite and pumice, was found to be significantly different, but those results are not included because the classes were not well resolved and the analysis was inconclusive (in some cases the highest resolution geological data were 1:1M). Instead, debris rock type was redefined as metamorphic, igneous or sedimentary and included in the analysis as the categorical variable L.

Continentality

Continentality (C, in °C) was calculated as follows

(6)$$C = T_{\max} - T_{\min}$$

where T max and T min are annual maximum and minimum monthly mean air temperatures (°C), respectively, extracted from WorldClim V2. WorldClim V2 is a 1 km2 resolution interpolated climate data product that is derived from ground-based and satellite observations (Fick and Hijmans, Reference Fick and Hijmans2017), which is widely cited for a variety of applications and is freely available from worldclim.org. WorldClim is a purely observational data product with structure and resolution that is appropriate for climate-scale analyses with minimal data storage and processing. The relatively high temporal and spatial resolutions of MERRA-2 reanalysis products make it appropriate for synoptic scale analyses, but require data storage and processing that were impractical for calculating climatic continentality in the current application.

Statistical analysis

Model fitting

Model fitting and analysis were performed using the R programming language (R Core Team, 2017) within R Studio. R packages used in addition to base R are listed at the end of this document and the R code is included in the Supplementary Material. The statistical models presented here are specified in R syntax rather than matrix notation, a practice that is encouraged for clarity and reproducibility (e.g. Gandrud, Reference Gandrud2015; Mair, Reference Mair2016). Readers are directed to Bates and others (Reference Bates, Mächler, Bolker and Walker2015) for mathematical expression of the R syntax.

Models were fitted separately for the two different types of melt factor, k o (observed) and k M (calculated). The melt factors calculated for Dokriani Glacier, k d, were included in the analysis of k M and also analyzed separately. This resulted in three sets of models, one for each of k o, k M and k d. Hereafter, these model sets are called KO, KM and KMd, and each individual model within a set is designated by a number (i.e. KO1, KM1, KMd1). An additional model set, KP, was generated by pooling k o and k M. The same data were not repeated in the pooled dataset. Melt factors in the KO dataset were prioritized over the KM dataset. If melt rates corresponding to the melt factors in the KO dataset were available, those melt rates were used to calculate values of k M that were included in the KM dataset but were not included in the pooled dataset.

A range of logarithmic and exponential transformations of the response and predictor variables were tested to meet the linear modeling assumption of normally distributed error terms. Models with base-10 logarithmic transformation of the response variable met that requirement and were the most accurate in cross-validation. The base-10 logarithms of the melt factors are denoted y.

An attempt was made to model ablation directly as a function of the predictor variables rather than from a predicted melt factor. However, those models were consistently less accurate than those based on a predicted melt factor and are not considered further.

Both fixed-effects and mixed-effects linear models for y were fit, the latter to account for the variability of model coefficients among glaciers and among years of observation. The motivation for using mixed-effects models in this study is that they explicitly address the hierarchical structure of the dataset when observations are grouped – e.g. by repeat sampling of the subjects in a study – and the dependency of the error terms on grouping levels (e.g. sampling sites) must be accounted for (Gałecki and Burzykowski, Reference Gałecki and Burzykowski2013; Galwey, Reference Galwey2014).

Mixed-effects models include both fixed effects and random effects. Fixed effects represent the effects of predictors that are assumed to apply uniformly throughout the population of interest. When a model that only includes fixed effects is applied to data with a grouped structure (e.g. multiple observations within multiple sites), the residuals from the model often exhibit within-group correlations; for example, some sites may have dominantly positive residuals while other sites may have dominantly negative residuals. Such within-group correlation violates the assumption of independence that underlies fixed-effects models. The inclusion of site as a random effect in this case is one way to account for such within-group correlation.

The fundamental assumption underlying a mixed-effects model is that the model coefficients can vary randomly from group to group, and are drawn from a normal distribution. When predictions are made for a new group that was not in the dataset used to fit the model, the prediction is made using the fixed-effects coefficients, which are assumed to apply through the entire population. The calculated prediction limits include the uncertainty associated with the among-site variability of the random effects. Multiple random effects and fixed effects can be included in a single mixed-effects model.

Data with a grouped structure are common to many areas of earth science (e.g. Booker and Dunbar, Reference Booker and Dunbar2008; Kasurak and others, Reference Kasurak, Kelly and Brenning2011; Azócar and others, Reference Azócar, Brenning and Bodin2017), making mixed-effects modeling especially useful. To illustrate the application of mixed-effects models, consider the case of a linear relation between a response variable y and a single predictor variable x, with multiple sites and multiple observations at each site. In this case, the model could be represented as

(7)$$y_{ik} = B_0 + b_{0k} + \lpar B_1 + b_{1k}\rpar \cdot x_{ik} + \epsilon_{ik}$$

where y ik and x ik are the ith observations of y and x at site k, B 0 and B 1 are fixed effects that are assumed to apply to the entire population of sites, b 0k and b 1k are deviations from the fixed-effects coefficients for site k, and ɛ ik is a random error term. If the model is applied to new observations at one of the sites used to fit the model, then both the fixed effects and the random effects for that site are included. However, if the model is applied to observations at a new site, then only the fixed-effects coefficients are used. With a nested data structure, such as the present case with multiple sites, multiple years of observation at each site and multiple observations in each year, the model would be

(8)$$y_{ijk} = B_0 + b_{0k} + b_{0jk} + \lpar B_1 + b_{1k} + b_{1jk}\rpar \cdot x_{ijk} + \epsilon_{ijk}$$

where j is the year of observation at a given site, and the index jk indicates a deviation from the relation at site k in year j. The random effects b 0k and b 1k are included when the model is applied to new observations from a site that was used to fit the model; the random effects b 0jk and b 1jk are also included if the new observations were taken in one of the site-years used to fit the model. Otherwise, for a new site, only the fixed effects are applied, as for the simpler case of Eqn (7).

The prediction limits computed for a mixed-effects model include not only uncertainty in the fixed-effects coefficients and the random error term, as is the case for fixed-effects models, but also the uncertainty associated with the variability of coefficients among sites as represented by the variances of the mixed-effects coefficients. An important advantage of using mixed-effects models is that the values of B 0 and B 1 are not biased by individual sites with large numbers of observations, as would be the case for a fixed-effects model. Fixed-effects versions of all the models tested in this study were significantly out-performed by the mixed-effects models and are not considered further.

The mixed-effects models were fit using the lmer function from the lme4 R package using maximum likelihood estimation (Bates and others, Reference Bates, Mächler, Bolker and Walker2015). Model fitting was carried out in two stages, starting with a base model including debris thickness. In R syntax, the base mixed-effects model was defined as:

(9)$$\hat{y} \sim h + \lpar 1\vert G\rpar $$

where $\hat {y}$ is the base-10 logarithm of the predicted melt factor ($\hat {k_{\rm o}}$, $\hat {k_{\rm M}}$ or $\hat {k_{\rm d}}$), h is debris thickness and G is the name of each glacier as a categorical variable. Equation (9) contains two fixed-effects coefficients, B 0 and B 1, which are the intercept and a slope coefficient for h, and the (1|G) term indicates a set of random-effects coefficients representing a random deviation from the fixed-effects intercept for each glacier (b 0j). Base models were also tested that allowed the slope coefficient for debris thickness to vary randomly among glaciers in addition to the intercept (b 1j):

(10)$$\hat{y} \sim h + \lpar h\vert G\rpar $$

Because multiple years of data were available for a number of glaciers, the year of observation, yr, was included as an additional random effect, nested within each glacier. The following model, for example, allows both the intercept and the slope coefficient for debris thickness to vary randomly among glaciers and years (b 0jk and b 1jk):

(11)$$\hat{y} \sim h + \lpar h\vert G\rpar + \lpar h\vert G\colon { yr}\rpar $$

The candidate mixed-effects base models in Eqns (9)–(11) were evaluated with the Akaike Information Criterion (AIC). The AIC is a metric that weighs model performance against parsimony, penalizing unnecessary complexity. The base model with the lowest AIC was advanced to the second stage of model development, where additional fixed-effects predictors and interaction terms were tested. Variables tested were T s, D s, SWnet, SWin, LWnet, LWa, LWe as well as rock type (L), continentality (C), albedo (αM and αML) and RGI 6.0 glaciological region (R). To minimize issues with collinearity, pairs of predictors with a Pearson's correlation coefficient > 0.5 were not included in a model together. Otherwise, combinations of the fixed-effects variables and interaction terms, such as h · SWnet, h + SWnet + C and h + SWnet · C, and so on, were tested exhaustively. Calculated melt factors for Dokriani Glacier varied through the ablation seasons of 2010–2014. In the models for Dokriani Glacier (model set KMd), month was included as a fixed effect, and yr as a random effect.

The fitted coefficients and 95% prediction limits calculated by the lmer function are the average of the maximum likelihood estimates from a user-defined number of simulations. Here, the number of simulations per iteration was set to 10,000. Models were discarded if any individual predictor was not significant at the 0.95 confidence level or if any fitted coefficient was physically unrealistic. Valid models for each response variable were ranked by AIC. Up to five of the top-ranked models were selected for cross-validation. Only the fixed-effects coefficients were used in model validation, when fitted models were used to make predictions for glaciers not included in the model fitting.

Model validation

Leave-one-out cross-validation was used to evaluate the candidate models’ ability to reproduce observed melt rates. At each iteration, the input values for one glacier were withheld and the model fit using data from the other glaciers. The newly fitted model was then applied to predict the values for the withheld glacier. For model set KMd, 150 m elevation bins were used in place of glaciers.

Smearing estimates (s) were calculated to avoid the introduction of bias during back-transformation of the predicted values from base-10 logarithms (i.e. $\hat {k} = 10^{\lpar \hat {y} + s\rpar }$) (Duan, Reference Duan1983). Predicted melt rates, $\hat {a}$, were calculated using Eqn (1) and the back-transformed melt factors (i.e. $\hat {a} = \hat {k} \cdot D$). When discussing predicted values of $\hat {y}$ and $\hat {a}$, subscripts are used to indicate which model was used (e.g. $\hat {y}_{{\rm KO}3}$, $\hat {a}_{{\rm KM}1}$).

Metrics used to evaluate the performance of the models in cross-validation were the root-mean-square error (RMSE), root-mean-square relative error (RMSRE), mean bias error (MBE) and relative mean bias error (RMBE), calculated as follows:

(12)$${\rm RMSE} = \sqrt{{1\over n}\sum_{i = 1}^{n} \lpar a_i - \hat{a}_i\rpar ^2}$$
(13)$${\rm RMSRE} = \sqrt{{1\over n}\sum_{i = 1}^{n} \left({a_i - \hat{a}_i\over a_i}\right)^2}$$
(14)$${\rm MBE} = {1\over n}\sum_{i = 1}^{n} \lpar a_i - \hat{a}_i\rpar $$
(15)$${\rm RMBE} = {1\over n}\sum_{i = 1}^{n} \left({a_i - \hat{a}_i\over a_i}\right)$$

where a i and $\hat {a}_i$ are the observed and predicted values, respectively, for each observation i, and n is the total number of observations. The percentage of points within $\pm 25\percnt$ error and the graphical linearity of the predictions also served as indicators of the models’ goodness of fit. Models that performed relatively poorly in cross-validation were discarded and a maximum of three top-performing models for each model set are presented in the Results. A range of prediction uncertainty was estimated for the strongest model in each set, where the 95% prediction limits were converted to a percentage of the predicted values and averaged over the observations.

Air temperature data provenance

To test whether melt factors calculated with air temperature data of different provenances were significantly different, k o and k M were combined as a single response variable, k P. Air temperature data provenance was included in the base model as a fixed-effects categorical predictor (i.e. observed or MERRA-2). Significance of the provenance variable was evaluated at the 0.90 confidence level. This liberal threshold was chosen to reduce the chance of incorrectly accepting the null hypothesis, that k o and k M came from the same distribution.

The importance of using air temperature data of the same provenance for both calculation and application of melt factors was also evaluated. Model set KO was tested twice, once using observed air temperature as input and again using MERRA-2 air temperature as input. If the provenance of air temperature data (i.e. MERRA-2 vs observed on-site) had a significant affect on predictive accuracy, then $\hat {a}$ calculated with $\hat {k_{\rm o}}$ and observed positive degree-days should be more accurate than $\hat {a}$ calculated with $\hat {k_{\rm o}}$ and MERRA-2 positive degree-days.

A complication in the second analysis is that values of k o were calculated with observed positive degree-days, which were not reported in the source publications and were thus unavailable for this test. Therefore, the mean observed temperature, T o, was used rather than positive degree-days, whereas the MERRA-2-based temperature statistic, D, was computed as positive degree-days. It is possible that using different statistics for the calculation and application of melt factors (i.e. positive degree-days vs daily means) could affect prediction accuracy. To evaluate that possibility, cross-validation of all the models was performed with D first, and then using daily mean MERRA-2 air temperature, T M. Differences in the RMSE and MBE of the same model but different air temperature input statistic were consistently < 0.001 mm w.e. d−1. Therefore, applying T o and D in the KO models was deemed to be a valid indicative test of the effect of input data provenance on prediction accuracy. Values of $\hat {a}_{{\rm KO}}$ predicted using T o and D are distinguished with T or D appended to the model name (i.e. $\hat {a}_{{\rm KO}2-{\rm T}}$, $\hat {a}_{{\rm KO}2-{\rm D}}$).

Once the significance of air temperature data provenance had been assessed, the full model fitting and validation procedures were carried out with the pooled melt factors, k P, as the response variable. That resulted in the additional set of models designated KP.

Results

Models were fitted for the KO, KM, KP and KMd datasets, with a total of 557 individual observations from 27 glaciers around the world. From the original 568 observations, 11 values of a from Hinarche Glacier, Dokriani Glacier and Koxkar Glacier were unusually high or low given D and were removed as outliers prior to model fitting (Fig. 2, crosses). None of the predictor variables explained those values and the results presented below are for the reduced dataset (n = 557).

Fig. 2. Observed melt rate (a) and mean daily positive degree-days based on MERRA-2 air temperatures (D), with least-squares best-fit lines through the origin for bins of debris thickness. Crosses are extreme values that were removed for model fitting.

The model coefficients presented below are in log base-10 transformed units. For example, the coefficients for the intercept, B 0, are in units of log 10 (mm w.e. °C −1 d−1), while the coefficients for debris thickness, B 1, are in units of log 10 (mm w.e. °C−1 d−1)m−1.

Dependence of ablation on degree-days and debris thickness: overview

Figure 2 illustrates the dependence of measured melt rate on positive degree-days and debris thickness. As expected, both the magnitude of melt and its sensitivity to air temperature decline as debris thickness increases. Also notable is the high degree of variability around the best-fit linear regression lines for each thickness bin.

Model set KO: melt factors for multiple glaciers extracted directly from the literature

In these models, the slope coefficient, B 1, is the direct dependence of melt factors on debris thickness, while the intercept, B 0, is the variation of melt factors that is independent of debris thickness. As seen in Table 4, the strongest models for predicted values of the log base-10 of k o are the base model with random effects in the intercept of h by glacier (G), KO1, and the extended model including SWnet, KO2. Despite the inclusion of SWnet in KO2, which results in different estimates of the intercept, the models have consistent estimates of the coefficient for debris thickness, B 1.

Table 4. Fitted coefficients with standard errors and AIC for models of $\hat {y}_{{\rm KO}}$, $\hat {y}_{{\rm KM}}$, $\hat {y}_{{\rm KP}}$ and $\hat {y}_{{\rm KM_d}}$.

G is a class variable representing individual glaciers. B 0 to B 2 are fitted fixed-effects coefficients. Also shown is the number of data points in each model set, n. Random-effects coefficients are not shown. The model in each set that was most accurate in cross-validation is highlighted with bold font

Although the AIC of model KO1 is 2.4 points lower than that for KO2, model KO2 was more accurate in cross-validation (Table 5). The models have similar biases, but the RMSE and RMSRE of $\hat {a}_{{\rm KO}2}$ are almost half the magnitude of those of $\hat {a}_{{\rm KO}1}$. The percentage of points within ± 25% error is not a strong metric of the performance of the KO models, because the influence of individual points in the small validation dataset was exaggerated. Nonetheless, those values are also favorable to model KO2, irrespective of which air temperature input was used. Differences due to the air temperature input variable are discussed with the results for air temperature data provenance, below.

Table 5. Cross-validation metrics for predicted melt rates, $\hat {a}$

The most accurate model in each set is highlighted with bold font.

There is a negative bias in $\hat {a}_{{\rm KO}2}$ that increases as a increases (Fig. 3a), as a result of the uneven distribution of observations in the lower range of h (Fig. 3b). The 95% prediction limits for $\hat {k}_{{\rm KO}2}$ (calculated with SWnet set to its mean value, 225 W m2) range from −49 to 203% of the predicted values on average.

Fig. 3. Left column: observed melt rates, a, and modeled melt rates, $\hat {a}$, using the best models for k o, k M and k P (rows 1–3, respectively). MERRA-2 positive degree-days were used as input to models KM1 and KP1. In plot a, $\hat {a}_{{\rm KO2-T}}$ and $\hat {a}_{{\rm KO2-D}}$ are represented with triangles and dots, respectively. The solid lines represent perfect agreement and the dashed lines are ± 25% error. Right column: observed melt factors, k (crosses), modeled melt factors, $\hat {k}$ (curves) and 95% prediction limits (shaded areas), against debris thickness, h.

Model set KM: melt factors for multiple glaciers calculated with observed melt rates and MERRA-2 air temperature

The best KM models are the base model with random effects in the slope and intercept by glacier and by year (KM1), the model extended with αM (KM2), and the model extended with LWnet (KM3). The estimated coefficients for h are consistent between models KM1, KM2 and KM3 and consistent with those of the KO models, within the standard errors of the estimates.

Model KM2 has the lowest AIC but performed poorly by all criteria in cross-validation, with RMSE and MBE an order of magnitude larger than those of models KM1 and KM3, as seen in Table 5. Models KM3 and KM1 performed similarly well to each other, with differences in the errors on the order of 0.1 mm w.e. d−1 and one percentage point; on the basis of fractionally more favorable metrics and parsimony, the base model is deemed to be more robust.

Like $\hat {a}_{{\rm KO}2}$, around half the values of $\hat {a}_{{\rm KM}1}$ fell within ± 25% error, but the MBE of KM1 is an order of magnitude smaller than that of KO2. The RMSE is also smaller for $\hat {a}_{{\rm KM}1}$ than $\hat {a}_{{\rm KO}2}$, but the RMSRE is around three times as large. The RMSRE was strongly influenced by the lack of observations of low melt rates in the k o dataset with which to test KO2, as seen in Figures 3a and c. It can be seen in Figure 3d that the 95% prediction limits for $\hat {k}_{{\rm KM}1}$ are also wider than those for $\hat {k}_{{\rm KO}2}$, ranging from approximately −38 to 270% of the predicted value on average. Again, that resulted from the larger number of low melt factors in the k M dataset that were not present in the k o dataset.

Of two observations of melt rate found in published literature for h > 0.65 m, one was unusually large given D and was removed as an outlier before model fitting. The value of k M calculated for the sole remaining observation at h = 1.2 m is poorly reproduced by model KM1 and lies well above the prediction limits (Fig. 3d).

Model set KP: k o and k M pooled as a single response variable

Air temperature data provenance was not found to be significant in a model of k o and k M pooled as a single response variable, k P (p = 0.23). The cross-validation metrics in Table 5 vary between models KO given different air temperature input variables, T o and D. The RMSE and RMSRE are smaller using T o in both KO1 and KO2, but the MBE is around three times as large. The difference in the percentage of points within ± 25% error varies inconsistently between inputs. The differences between $\hat {a}_{{\rm KO2-T}}$ and $\hat {a}_{{\rm KO2-D}}$ in Figure 3a are not striking.

In the absence of evidence that inconsistent air temperature data provenance reduced prediction accuracy, the model fitting and validation procedures were carried out with k P as the response variable. The strongest models set in KP are the base model with random effects in the slope and intercept of debris thickness by glacier and by year (KP1), and the model extended with LWnet (KP2) (Table 4). As with model set KM, the AIC for KP2 is lower than that for the base model but the base model was more accurate in cross-validation. The RMSE of KP1 is fractionally smaller than that of KP2, and KP1 has 3% more points within ± 25% error than KP2 (Table 5). The RMSRE and MBE for the two models are equal. On the basis of those metrics and parsimony, KP1 is deemed to be more robust.

Only around 50% of $\hat {a}_{{\rm KP}1}$ fall within ± 25% error, comparable to models KO2 and KM1. The RMSRE of KP1 falls between KO2 and KM1, the RMSE is lowest for KP1 and equal with KM1, while the MBE is lowest for KP1 of all the models. The uncertainty in $\hat {k_{\rm P}}$, ranging from −40 to 254% of the predicted value, is intermediate between KO2 and KM1.

Model set KMd: melt factors calculated for Dokriani Glacier with observed melt rates and MERRA-2 air temperature

Melt factors for the 2010–2013 ablation seasons at Dokriani Glacier, k d, were calculated using D and monthly melt measured at a network of 30 ablation stakes. In Figure 4 it can be seen that k d increased over the ablation season in all years except 2013. Figure 4 also shows that inter-site variability of k d within each month did not vary markedly from year to year. However, for May, the inter-site variability was low in 2010 and increased each year to the point that there was greater inter-site variability in May 2013 than in any other year-month. The difference between k d for June and September was found to be statistically significant in all years except 2013, while the difference between k d in July and August was not found to be significant in any year.

Fig. 4. The variation of k d among ablation stakes for each month and year of the 2010–2013 ablation seasons.

The best models for k d are the base model with random effects in the slope and intercept by year, KMd1, and the model extended with a categorical variable for month, KMd2 (Table 4). The estimated coefficients for the slope of debris thickness, B 1, are consistent between KMd1 and KMd2, but notably smaller than those estimated for KO, KM and KP. The estimated coefficients for month, B 2, reflect the pattern of increase through the ablation season described above.

In cross-validation, the RMSE of the base model and KMd2 were equal, and KMd1 had 1% more predicted values within ± 25% than KMd2 (Table 5). However, the MBE of KMd2 is an order of magnitude smaller than that of KMd1, and the RMSRE is also fractionally smaller. Model KMd2 is deemed to be more robust primarily on the basis of the MBE.

Both KMd2 and KMd1 have smaller RMSE than the strongest multi-glacier models, but RMSRE more than three times as large. That is because the distribution of k d is skewed by the low May and June values while the multi-glacier datasets are more normally distributed. The MBE of KMd2 and KP1 are equal in magnitude, but the RMBE of KMd2 is twice as large as that of KP1. The prediction limits for $\hat {k_{\rm d}}$, calculated as the mean for each month, are also wider than any of the multi-glacier models at −32 to 312% of the predicted value.

In Figure 5a, it can be seen that May melt rates were least well reproduced. It is also of note that, while k d were highest in September, a were relatively low. Figure 5b shows that the overall increase of k d between May and September, muted in July and August, is reflected in $\hat {k}_{{\rm KM_d}2}$.

Fig. 5. Left column: observed melt rates, a, and predicted melt rates, $\hat {a}$, for Dokriani Glacier and each month of the ablation season, using model KMd2 and MERRA-2 positive degree-days. The solid lines represent perfect agreement and the dashed lines are ± 25% error. Right column: observed k d (crosses), predicted values, $\hat {k_{\rm d}}$ (curves) and 95% prediction limits for each month (shaded areas), against debris thickness, h.

Discussion

The data compiled and analyzed here are from debris-covered glaciers around the world, covering a wide range of geographic and climatic settings. The analysis confirms the generality of the dependence of melt rates on positive degree-days and debris thickness that has been well documented at individual sites.

Accuracy of modeled melt factors applied to new glaciers without calibration

The best-performing models generated predictions that were within ± 25% error only around 50% of the time, while the RMSE and RMSRE of the highest performing model, 8.7 mm w.e. d−1 and 0.98 respectively, are substantial (model KP1, Table 5). This reflects the known strengths and weaknesses of empirical melt models, tending to be accurate on average but imprecise for specific times and places. The prediction limits of mixed-effects models are typically wider than those of equivalent fixed-effects models, because they explicitly consider the sample used to fit the model within the context of a broader population of glaciers to which the model might be applied (Shadish and others, Reference Shadish, Cook and Campbell2002). It is notable, therefore, that the accuracy of model KP1 is comparable to the reported accuracy of TIM transferred between neighboring debris-free glaciers (e.g. Wheler, Reference Wheler2009).

Extending classical TIM with additional predictors did not improve prediction accuracy, but increasing the size of the calibration dataset did. In cross-validation, model KO2, extended with SWnet, out-performed the base model (KO1), but the base models KM1 and KP1 out-performed the extended models KM2, KM3 and KP2. Then, KP1 predicted k o more accurately than either KO1 or KO2. This shows that increasing the size of the dataset let the underlying, common relation between k and h to be more accurately estimated, and that was more important than additional information about the surface energy exchanges.

The inability of other candidate predictors to contribute to the performance of the models suggests that positive degree-days and debris thickness are strong predictors of sub-debris melt, which is in agreement with previous findings (e.g. Möller and others, Reference Möller, Möller, Kukla and Schneider2016). It has been found that air temperature is reproduced more accurately than other variables in some climate reanalyses (e.g. Trubilowicz and others, Reference Trubilowicz, Shea, Jost and Moore2016); here, MERRA-2 air temperature was found to be in good agreement with observations (root mean squared deviation = 2.56°C, mean bias < 0.1°C, n = 32, Appendix B). The relative performance of the predictors may also have been influenced by relative accuracy of the MERRA-2 variables.

The increased volume of data used to fit models may have improved the accuracy of the distribution of melt factors as a function of debris thickness, or, with more repeat observations within the hierarchical sampling structure of the data, improved accuracy of the random-effects coefficients. The models in sets KM and KP were improved with random effects in the intercept and slope of h by glacier (G) and by year (yr), having repeat observations at multiple glaciers over multiple years. In contrast, the models in set KO were only improved by random effects in the intercept of h by G, because, despite the same sampling structure, there were not enough repeat observations for each value of G and yr to accurately estimate coefficients for the slope of h by G, or either the intercept or slope of h by yr. With more data, the fixed- and random-effects coefficients for both k M and k o were more accurately approximated.

Empirical melt models are often fit to data from a single glacier and applied to neighboring glaciers. The coefficients for debris thickness estimated in the models of Dokriani Glacier were significantly different to those estimated in the multi-glacier models sets, KO, KM and KP, while the coefficients for debris thickness estimated in the multi-glacier model sets were consistent with each other. This finding suggests that empirical models fitted using data from a single glacier are location specific, and that models fitted using data from multiple glaciers more accurately reflect the direct relation between melt, air temperature and debris thickness. Models fitted using data from multiple glaciers may, therefore, be more accurate when they are transferred between glaciers than models fitted using data from a single glacier. Indeed, the accuracy of predictions made with model KP1 for glaciers that KP1 had not been calibrated for was only fractionally lower than that of predictions made for bins of elevation on Dokriani Glacier with model KMd2, which was calibrated for Dokriani Glacier.

The fractionally higher accuracy of predictions made with model KMd2, with RMSE = 7.0 mm w.e. d−1 and MBE = 0.2 mm w.e. d−1, is likely to relate to the properties of the debris at Dokriani Glacier (e.g. rock type, porosity), which were uniform by comparison with those in the multi-glacier datasets. However, the elevations of observation sites at Dokriani Glacier were also known precisely while only a single, average or nominal value was known for most of the source data. Therefore, the accuracy of KMd2 might simply have been due to more accurate elevation adjustment of D.

Mixed-effects models are based on the assumption that the observation sites and years are sampled randomly from broader populations. In the current case, the sampled population includes only eight of 18 RGI glaciological regions and elevations < 5350 m a.s.l.; therefore, the applicability of the models and prediction limits outside that population of sites is not known.

The models could not be validated for debris thicker than 0.65 m. Model KP1 predicts k = 0.5 mm w.e. °C−1 d−1 for h = 0.65 m, decaying to 0.1 mm w.e. °C−1 d−1 for h between 1.0 and 1.2 m, which is in general agreement with empirical models of sub-debris melt in the literature (e.g. Brook and Paine, Reference Brook and Paine2012; Brook and others, Reference Brook, Hagg and Winkler2013; Hagg and others, Reference Hagg, Brook, Mayer and Winkler2014, Reference Hagg2018; Juen and others, Reference Juen, Mayer, Lambrecht, Han and Liu2014; Möller and others, Reference Möller, Möller, Kukla and Schneider2016). However, the single observation for h > 0.65 m, at h = 1.2 m from Juen and others (Reference Juen, Mayer, Lambrecht, Han and Liu2014), has a value of k M = 4 mm w.e. °C−1 d−1 that is considerably higher than the models predicted, suggesting the models might not be valid for h > 0.65 m.

Importance of air temperature data provenance

The success of TIMs relies on positive degree-days having a consistent relation to the surface energy balance. A number of studies have shown that, because air temperature data collected from different locations and/or by different methods differ (e.g. recorded at an AWS on the glacier or on a lateral moraine, or recorded at a remote weather station and lapsed to the elevation of the glacier), the accuracy of predictions can suffer if air temperature data of different provenances are used for the calculation and application of melt factors (e.g. Lang and Braun, Reference Lang and Braun1990; Shea and others, Reference Shea, Moore and Stahl2009; Shea and Moore, Reference Shea and Moore2010; Wheler and others, Reference Wheler, MacDougall, Flowers, Petersen, Whitfield and Kohfeld2014).

No clear evidence was found here that air temperature data provenance affected the magnitude of melt factors, given the considerable scatter inherent in the data. The slightly different distributions of k o and k M were not statistically significant, and differentiating between them did not improve the performance of the models. Nor did changing the provenance between model fitting and application of melt factors have a significant effect on prediction accuracy: the RMSE of the KO models was < 1 mm w.e. d−1 lower with observed air temperature input data than with MERRA-2 positive degree-days, but the MBE was more than 3 mm w.e. d−1 larger. Model KP1 was derived from melt factors calculated using data with two different provenances, yet, with input data of a single provenance (D), it was the most accurate of the multi-glacier models in cross-validation. This indicates that enlarging the imprecise dataset by combining observations from different sources was more valuable than maintaining consistent air temperature data provenance.

It is plausible that melt factors calculated with climate reanalysis air temperature data are more highly transferable than melt factors calculated with point-scale data. Micro-climates can affect air temperature recorded at point scale, while MERRA-2 air temperature variables reflect the full, integrated system of mass and energy fluxes through the modeling and assimilation process. Melt factors calculated with air temperature data that reflects the average, regional scale energy balance may more accurately predict melt under debris at new sites than melt factors calculated with point-scale air temperature data.

Variability of melt factors within the ablation season

The melt factors calculated for Dokriani Glacier, k d, were found to vary systematically through the 2010–2012 ablation seasons. Including month as a categorical variable in model KMd2 reduced the RMSRE of predictions by 0.32 and the MBE by an order of magnitude, from −1.1 to 0.2 mm w.e. d−1.

In 2010–2012, the values of k d increased significantly from June to a maximum in September, which is reflected in Figure 5b and the KMd2 coefficients for month in Table 4. Short-term observations have found that heat storage in supraglacial debris is close to zero on the order of days (Brock and others, Reference Brock, Rivera, Casassa, Bown and Acuña2007) but may be higher at seasonal scale (Nicholson and Benn, Reference Nicholson and Benn2013). The increase of values of k d between June and September at Dokriani Glacier suggests that heat accumulated in the debris layer after melting had begun, so that melt rates were increasingly sensitive to surface energy inputs. There was no significant difference between July and August values in any year. July is the first month of the monsoon in the Central Himalaya, characterized by thick cloud cover and intense rainfall. The rate of heat accumulation may have declined in response to reduced net radiation, or the increasing importance of heat advection by rainwater percolating through the debris.

The sensitivity of melt factors to debris thickness in model KMd2 was close to one-third that of the multi-glacier models, at −0.52 log10(mm w.e. °C−1 d−1)m−1. That also suggests that advection by rainwater percolation was an important mechanism of heat transfer in the debris layer. Continuous percolation of rain water at air temperature might reduce the thermal gradient in the near-surface, making the effect of debris thickness on melt energy supply less pronounced.

Very low values of k d in May 2010–2012 suggest that much of the surface heat input early in the ablation season was used to warm the debris layer and thus not immediately available to melt ice. May 2013 melt factors were higher than they were in previous years and more variable among sites than in any other month or year. Air temperature in the region of Dokriani Glacier was not significantly different in 2013 by comparison with previous years, but there were precipitation deficits in March, April and May 2013 (Kaur and Purohit, Reference Kaur and Purohit2013, Reference Kaur and Purohit2014). Further, precipitation in June 2013 was 123–191% greater than the climatic normal (Kaur and Purohit, Reference Kaur and Purohit2014, visualize.data.gov.in) indicating that macro-scale atmospheric circulation was unusual that year. With low spring snowfall, there may have been an unusual spatial distribution of heat in the debris, because warming could begin earlier at sites without snow, and that could explain the high inter-site variation of k d in May 2013. Studies of debris-free glaciers have shown that empirical models do not necessarily hold during seasonal transitions (e.g. Essery and others, Reference Essery, Morin, Lejeune and Ménard2013; Irvine-Fynn and others, Reference Irvine-Fynn, Hanna, Barrand, Porter, Kohler and Hodson2014; Litt and others, Reference Litt2019) and the same conclusion can be drawn from the poor prediction accuracy for May using model KMd2. This finding shows that antecedent conditions are sometimes important to seasonal melt at debris-covered glaciers.

More than half of the data in this analysis were from High Mountain Asia, under a climate similar to Dokriani Glacier (Fig. 1). However, no significant difference was found between melt factors or melt rates by region and there was no indication that the timing of observations systematically affected the values of k or a. Therefore, it is unclear whether the temporal variability of melt factors at Dokriani Glacier can be generalized.

Conclusions

This meta-analysis of previously published observations has demonstrated the generality of the dependence of sub-debris melt rates on positive degree-days and debris thickness. In cross-validation, empirical mixed-effects models describing melt factors as an exponential function of debris thickness have been found to predict melt rates with accuracy comparable to that reported for debris-free glacier TIMs transferred between neighboring glaciers. Predictions made for new glaciers with a model fitted with data from multiple glaciers were as accurate as those made for a single glacier with a model fitted with 4 years of data from the same glacier.

Overall, simple models were more accurate in cross-validation than models extended with additional predictors and interaction terms. There was no indication that air temperature data provenance significantly affected melt factors or prediction accuracy. Pooling melt factors calculated with observed melt rates and on-site air temperature and melt factors calculated with observed melt rates and MERRA-2 air temperature into a single large dataset improved prediction accuracy.

Melt factors calculated for Dokriani Glacier increased through the ablation season in 3 out of 4 years of observation. Low values for May in 2010–2012 suggested that energy was used to heat the debris after the spring snow pack melted, delaying the onset of the ablation season for a period on the order of days to weeks. Increasing values between June and September, as well as high inter-site variability in May 2013, suggest that heat storage in the debris layer was a significant part of the energy balance.

The models presented here can be used with MERRA-2 air temperature data to predict regional and glacier scale sub-debris melt rates with a known margin of error, which may be useful for estimating melt rates in the absence of more robust alternatives, or as a baseline for comparison with physically based models. However, the utility of the models for specific purposes may be limited by the relatively wide prediction limits. The 95% prediction limits around predicted melt factors is substantial at approximately −40 to 250% of the predicted values, which demonstrates that melt rates predicted with assumed melt factors without a margin of error may be misleading. An advantage of these models is that the uncertainty associated with predicted ablation is quantified, so this uncertainty can be considered when the output is used in further calculations (e.g. catchment water balances) or decision making.

To advance the science of sub-debris melt modeling, additional studies quantifying the transferability of empirical models would be valuable. It would be worthwhile for the models presented in this paper to be tested independently in a range of geographical settings. Only three observations of melt under debris > 0.65 m thick were found in the published literature and the models were unable to reproduce those observations. Additional observations would be valuable for testing the accuracy of predictions of melt under debris > 0.65 m thick. The importance of air temperature data provenance to predictions of sub-debris melt at higher temporal and spatial resolution should be tested. Seasonal and multi-year observational studies of debris heat storage would be useful to constrain the significance of heat storage to ice melt in different places. Finally, both empirical and physically-based modeling would benefit if the characteristics of supraglacial debris, including quantities such as porosity and grain size distribution as well as qualities such as rock type, were reported with future field-based studies.

R packages used

beepr (Bååth and Dobbyn, Reference Bååth and Dobbyn2018), bookdown (Xie, Reference Xie2018a), Cite (Schmitt, Reference Schmitt2016), compiler (R Core Team, 2017), digitize (Poisot, Reference T2011), dplyr (Wickham and others, Reference Wickham, François, Henry and Müller2018), ggplot2 (Wickham, Reference Wickham2010), ggpubr (Kassambara, Reference Kassambara2018), ggplotify (Yu, Reference Yu2019), grid (R Core Team, 2017), gridExtra (Auguie, Reference Auguie2017), here (Müller, Reference Müller2017), kableExtra (Hao and others, Reference Hao2018), knitr (Xie, Reference Xie2018b), lme4 (Bates and others, Reference Bates, Mächler, Bolker and Walker2015), lmerTest (Kuznetsova and others, Reference Kuznetsova, Brockhoff and Christensen2017), magrittr (Bache and Wickham, Reference Bache and Wickham2014), merTools (Knowles and others, Reference Knowles, Frederick and Whitworth2018), ncdf4 (Pierce, Reference Pierce2017), ncdf4.helpers (Bronaugh, Reference Bronaugh2014), ncdf.tools (Buttlar, Reference Buttlar2015), raster (Hijmans and others, Reference Hijmans2017), RColorBrewer (Neuwirth, Reference Neuwirth2014), rgdal (Bivand and others, Reference Bivand2018), rnaturalearth (South, Reference South2017a), rnaturalearthdata (South, Reference South2017b), tiff (Urbanek, Reference Urbanek2013).

Supplementary material

The supplementary material for this article can be found at https://doi.org/10.1017/jog.2020.57.

Acknowledgments

This work was partly funded by a UBC Doctoral Fellowship to AWB. Production of the manuscript was supported by a Research NSERC Grant to RDM. We thank V. Radić (University of British Columbia), A. Banerjee (Indian Institute of Science and Education and Research) and R. Shankar (The Institute of Mathematical Sciences, India) for valuable discussions and comments on draft manuscripts that improved the final product beyond measure. We thank the authors of Pratap and others (Reference Pratap, Dobhal, Mehta and Bhambri2015) for contributing their original data from Dokriani Glacier as a data file. We also thanks M. Bosilovich at NASA for prompt responses to questions and useful suggestions for working with MERRA-2, and thanks to the Scientific Editor, Joe Shea and an anonymous reviewer for comments leading to improvement of the final manuscript.

Appendix A - References for the observational data

Table 6. References and summary statistics for the reported melt factors

Table 7. References for the reported melt rates and the number of observations at each glacier

Appendix B - Comparison of MERRA-2 and on-site air temperature data

Air temperature was reported with the melt observations in 17 of the source publications. These observations were gathered (n = 45) and standardized to daily means to inform the choice of a MERRA-2 air temperature variable to use for calculating new melt factors.

MERRA-2 data products for air temperature at 2 m and 10 m above ground were tested, extracted from the 2-dimensional assimilation instantaneous hourly collection (inst1_2d_asm_Nx) (T2 and T10). The variable T2 might be expected to agree more closely with observations made in, near or lapsed to the first few meters of the glacier surface. However, MERRA-2 2-dimensional assimilation data products represent interactions between the surface and atmosphere by a classification of surface type, where the fractional areas of land, lake, ocean and/or ice compose the surface area of a grid cell. The fractional area of each surface type is based on the aggregation of a 1 km2 resolution satellite-based global surface characterization (DISCover, Loveland and others (Reference Loveland2000)). If debris-covered glaciers were misclassified as land or if glacierization were atypical of a grid cell area, T2 could be systematically warm biased. In that case T10 could be a better approximation of point scale, ice-cooled air temperature, assuming a lapse temperature profile in the modeled air temperature fields.

Two approaches were tested to arrive at lapse rates. First, an approximate global average of 6.5 °C km−1C) was assumed for all sites. Second, site-specific lapse rates were acquired as stated in the observation source publications (n = 3) and otherwise calculated from mid-layer air temperature of model-levels 72 and 71 from the MERRA-2 tavg3_3d_asm_Nv collection (GMAO, 2015d), as follows

(B1)$$\Gamma M_{\,j} = \lpar T^{72}_j-T^{71}_j\rpar /\lpar E^{72}_j-E^{71}_j\rpar $$

where E 72 and E 71 are the model level mid-layer elevations and j is the grid cell. Lapse rates were applied following Eqn (5). Four air temperature variables resulted from this procedure, T2ΓC, T10ΓC, T2ΓM and T10ΓM, where C stands for constant and M stands for mixed. The four variables are collectively denoted TM.

The root mean squared deviation, RMSD, was used to evaluate agreement between T o and TM, calculated for every observation, i, as follows:

(B2)$${\rm RMSD} = \sqrt{{1\over n}\sum_{i = 1}^{n} \lpar T_{{\rm o}\comma i} - {\rm \it{T_M}}_{\,j\comma i}\rpar ^{^2}}$$

As seen in Table 8 T10 variables were smaller than they were for T2 but the difference was on the order of just 10−4 °C. The variables adjusted with a constant lapse rate were in closer agreement with observations, with RMSD around 0.2 °C smaller for both T2 and T10. Biases were found to be < 0.01 °C in all cases. The variable T2ΓC was chosen for calculating new melt factors in the meta-analysis to be consistent with the common practice of using air temperature data from the glacier near-surface and because the difference between T2ΓC and T10ΓC was slight.

Table 8. The RMSD of observed air temperatures and MERRA-2 air temperatures adjusted for elevation with lapse rates

Air temperature data provenance has been found to affect the consistency of melt factors in some studies. The data for T o were recorded at automatic weather stations (AWS) that were located on the glacier being studied, on moraine near the melt observation sites, in a base camp in the same glacier basin, or in a local government-operated meteorological station, in which case the data were lapsed to the elevation of the glacier being studied. Figure 6 shows that AWS location did not have a clear affect on the deviation of T o from perfect agreement with T2ΓC.

Fig. 6. Variables T2ΓC and T o, with symbols distinguishing T o data provenance.

The MERRA-2 grid cell fraction of land ice (η) was nil in six instances, where the glacierized land area is small in reality (Summit Crater Glacier, Pichillancahue-Turbio Glacier, Lirung Glacier, Eliot Glacier, Miage Glacier and Ghiacciaio del Belvedere). A weak positive relationship between η and the magnitude of the deviation between T2 and T o was found, but that relationship did not remain once lapse rates had been applied. The conditions required for glacierization tend to occur at high elevation outside polar regions, and if high elevations are uncommon regionally, the difference between glacier snout elevation and mean regional elevation will be large and the glacierized area will tend to be small. A statistically significant negative linear relationship was found between η and the deviation between T2ΓC and T o (p = 0.95), as seen in Figure 7, but there is no physical reason for T2ΓC to be warm biased where η is large and cold biased where it is small. Speculatively, the pattern might reflect reduced concentration of observational air temperature data ingested to MERRA-2 with increasing ice area.

Fig. 7. The difference between T2ΓC and T o, e, plotted against MERRA-2 grid cell fraction of land ice, η.

At sites near the coast, MERRA-2 air temperature is more strongly influenced by simulated coastal processes, which might overwhelm any signal of local interactions between the air and ice, particularly if the ice area is small. The deviation between T2 and T o was found to be slightly higher for glaciers near the coast than glaciers further from the coast but again, that was corrected with the application of elevation lapse rates, because the glaciers near the coast in these data also tend to be at relatively high elevation.

Footnotes

*

Present address: Department of Geography, University of British Columbia, Canada.

ΓC = constant lapse rate, ΓM = mixed lapse rates, from observations and calculated from MERRA-2 air temperature profile.

References

Auguie, B (2017) gridExtra: Miscellaneous Functions for ‘Grid’ Graphics. R package version 2.3. Available at url: https://CRAN.R-project.org/package=gridExtraGoogle Scholar
Ayala, A and 6 others (2016) Modelling the hydrological response of debris-free and debris-covered glaciers to present climatic conditions in the semiarid Andes of central Chile. Hydrological Processes 30, 40364058. doi: 10.1002/hyp.10971.CrossRefGoogle Scholar
Azócar, GF, Brenning, A and Bodin, X (2017) Permafrost distribution modelling in the semi-arid Chilean Andes. The Cryosphere 11, 877890. doi: 10.5194/tc-11-877-2017.CrossRefGoogle Scholar
Bååth, R and Dobbyn, A (2018) beepr: easily play notification sounds on any platform. R package version 1.3. Available at url: https://CRAN.R-project.org/package=beepr.Google Scholar
Bache, SM and Wickham, H (2014) magrittr: a forward-pipe operator for R. R package version 1.5. Available at url: https://CRAN.R-project.org/package=magrittr.Google Scholar
Bates, D, Mächler, M, Bolker, B and Walker, S (2015) Fitting linear mixed-effects models using lme4. Journal of Statistical Software 67(1), 148. doi: 10.18637/jss.v067.i01.Google Scholar
Bivand, R and 10 others (2018) rgdal: bindings for the ‘geospatial’ data abstraction library. R package version 1.5–10. Available at url: https://CRAN.R-project.org/package=rgdal.Google Scholar
Bocchiola, D and 6 others (2015) An ablation model for debris-covered ice: the case study of Venerocolo Glacier (Italian Alps). Geografia Fisica e Dinamica Quaternaria 38, 113128. doi: 10.4461/GFDQ.2015.38.11.Google Scholar
Booker, DJ and Dunbar, MJ (2008) Predicting river width, depth and velocity at ungauged sites in England and Wales using multilevel models. Hydrological Processes 22, 40494057. doi: 10.1002/hyp.7007.CrossRefGoogle Scholar
Bozhinskiy, AN, Krass, MS and Popovnin, VV (1986) Role of debris cover in the thermal physics of glaciers. Journal of Glaciology 32(111), 255266. doi: 10.3189/S0022143000015598.Google Scholar
Braun, LN, Grabs, W and Rana, B (1993) Application of a conceptual precipitation–runoff model in the Langtang Khola Basin, Nepal Himalaya. Snow and Glacier Hydrology (Proceedings of the Kathmandu Symposium, November 1992). IAHS Publication 218, 221237. http://hydrologie.org/redbooks/a218/iahs_218_0221.pdf.Google Scholar
Brock, BW, Mihalcea, C, Kirkbride, MP, Diolaiuti, G, Cutler, MEJ and Smiraglia, C (2010) Meteorology and surface energy fluxes in the 2005-2007 ablation seasons at the Miage debris-covered glacier, Mont Blanc Massif, Italian Alps. Journal of Geophysical Research 115(D09106), 116. doi: 10.1029/2009JD013224.CrossRefGoogle Scholar
Brock, B, Rivera, A, Casassa, G, Bown, F and Acuña, C (2007) The surface energy balance of an active ice-covered volcano: Villarrica Volcano, Southern Chile. Annals of Glaciology 45, 104114. doi: 10.3189/172756407782282372.CrossRefGoogle Scholar
Bronaugh, D (2014) ncdf4.helpers: helper functions for use with the ncdf4 package. R package version 0.3–5. Pacific Climate Impacts Consortium. Available at https://CRAN.R-project.org/package=ncdf4.helpers.Google Scholar
Brook, MS, Hagg, W and Winkler, S (2013) Debris cover and surface melt at a temperate maritime alpine glacier: Franz Josef Glacier, New Zealand. New Zealand Journal of Geology and Geophysics 56(1), 2738. doi: 10.1080/00288306.2012.736391.CrossRefGoogle Scholar
Brook, MS and Paine, S (2012) Ablation of ice-cored moraine in a humid, maritime climate: Fox Glacier, New Zealand. Geografiska Annaler: Series A, Physical Geography 94, 339349. doi: 10.1111/j.1468-0459.2011.00442.x.CrossRefGoogle Scholar
Brown, ME and 16 others (2014) An integrated modelling system for estimating glacier and snow melt driven streamflow from remote sensing and earth system data products in the Himalayas. Journal of Hydrology 519, 18591869. doi: 10.1016/j.jhydrol.2014.09.050.CrossRefGoogle Scholar
Buttlar, JV (2015) ncdf.tools: easier ‘NetCDF’ file handling. R package version 0.7.1.295. Available at https://CRAN.R-project.org/package=ncdf.tools.Google Scholar
Carenzo, M, Pellicciotti, F, Mabillard, J, Reid, TD and Brock, BW (2016) An enhanced temperature index model for debris-covered glaciers accounting for thickness effect. Advances in Water Resources 94, 457469. doi: 10.1016/j.advwatres.2016.05.001.CrossRefGoogle ScholarPubMed
Chand, MB, Kayastha, RB, Parajuli, A and Mool, PK (2015) Seasonal variation of ice melting on varying layers of debris of Lirung Glacier, Langtang Valley, Nepal. Remote Sensing and GIS for Hydrology and Water Resources (Proceedings RSHS14 and ICGRHWE14, Guangzhou, China, August 2014). IAHS Publication 368, 2122. doi: 10.5194/piahs-368-21-2015.Google Scholar
Collier, E, Nicholson, LI, Brock, BW, Maussion, F, Essery, R and Bush, ABG (2014) Representing moisture fluxes and phase changes in glacier debris cover using a reservoir approach. The Cryosphere 8, 14291444. doi: 10.5194/tc-8-1429-2014.Google Scholar
Conway, H and Rasmussen, LA (2000) Summer temperature profiles within supraglacial debris on Khumbu Glacier, Nepal. Debris-Covered Glaciers (Proceedings of workshop held at Seattle, Washington, USA, September 2000). IAHS Publication 264, 8997. doi: https://iahs.info/uploads/dms/11685.89-97-264-Conway.pdf.Google Scholar
Dobhal, DP, Mehta, M and Srivastava, D (2013) Influence of debris cover on terminus retreat and mass changes of Chorabari Glacier, Garhwal region, central Himalaya, India. Journal of Glaciology 59(217), 961971. doi: 10.3189/2013JoG12J180.Google Scholar
Duan, N (1983) Smearing estimate: a nonparametric retransformation method. Journal of the American Statistical Association 78(383), 605610. doi: 10.1080/01621459.1983.10478017.CrossRefGoogle Scholar
Essery, R, Morin, S, Lejeune, Y and Ménard, CB (2013) A comparison of 1701 snow models using observations from an alpine site. Advances in Water Resources 55, 131148. doi: 10.1016/j.advwatres.2012.07.013.CrossRefGoogle Scholar
Fick, SE and Hijmans, RJ (2017) Worldclim 2: new 1-km spatial resolution climate surfaces for global land areas. International Journal of Climatology 37, 43024315. doi: 10.1002/joc.5086.CrossRefGoogle Scholar
Fyffe, CL and 6 others (2014) A distributed energy-balance melt model of an alpine debris-covered glacier. Journal of Glaciology 60(221), 587602. doi: 10.3189/2014JoG13J148.CrossRefGoogle Scholar
Gabbi, J, Carenzo, M, Pellicciotti, F, Bauder, A and Funk, M (2014) A comparison of empirical and physically based glacier surface melt models for long-term simulations of glacier response. Journal of Glaciology 60(224), 11401154. doi: 10.3189/2014JoG14J011.Google Scholar
Gałecki, A and Burzykowski, T (2013) Linear mixed-effects models using R; a step-by-step approach. New York: Springer Science + Business Media. doi: 10.1007/978-1-4614-3900-4_10.CrossRefGoogle Scholar
Galwey, NW (2014) Introduction to mixed modelling; beyond regression and analysis of variance (2nd ed.). West Sussex: John Wiley and Sons, Ltd. doi: 10.1002/9781118861769.Google Scholar
Gandrud, C (2015) Reproducible research with R and R Studio (2nd ed.). Boca Raton: Chapman and Hall/CRC. doi:10.1201/9781315382548.Google Scholar
Gelaro, R and 30 others (2017) The modern-era retrospective analysis for research and applications, Version 2 (MERRA-2). Journal of Climate 30(14), 54195454. doi: 10.1175/JCLI-D-16-0758.1.CrossRefGoogle Scholar
Global Modelling and Assimilation Office (GMAO) (2015a) MERRA-2 const_2d_asm_Nx: 2d, constants, V5.12.4. Goddard Space Flight Center Distributed Active Archive Center (GSFC DAAC) Greenbelt, MD, USA. Accessed 2018, doi: 10.5067/ME5QX6Q5IGGU.Google Scholar
Global Modelling and Assimilation Office (GMAO) (2015b) MERRA-2 inst1_2d_asm_Nx: 2-dimensional, 1-hourly, instantaneous, single-level, assimilation, single-level diagnostics, V5.12.4. Goddard Space Flight Center Distributed Active Archive Center (GSFC DAAC) Greenbelt, MD, USA. Accessed 2018, doi: 10.5067/3Z173KIE2TPD.CrossRefGoogle Scholar
Global Modelling and Assimilation Office (GMAO) (2015c) MERRA-2 tavg1_2d_rad_Nx: 2-dimensional, 1-hourly, time-averaged, single-level, assimilation, radiation diagnostics, V5.12.4. Goddard Space Flight Center Distributed Active Archive Center (GSFC DAAC) Greenbelt, MD, USA. Accessed 2018, doi: 10.5067/Q9QMY5PBNV1T.CrossRefGoogle Scholar
Global Modelling and Assimilation Office (GMAO) (2015d) MERRA-2 tavg3_3d_asm_Nv: 3-dimensional, 3-hourly, time-averaged, model-level, assimilation, assimilated meteorological fields, V5.12.4. Goddard Space Flight Center Distributed Active Archive Center (GSFC DAAC) Greenbelt, MD, USA. Accessed 2018, doi: 10.5067/WWQSXQ8IVFW8.Google Scholar
Hagg, W and 11 others (2018) Future climate change and its impact on runoff generation from the debris-covered Inylchek glaciers, central Tian Shan, Kyrgyzstan. Water (Switzerland) 10(1531), 126. doi: 10.3390/w10111513.Google Scholar
Hagg, W, Brook, M, Mayer, C and Winkler, S (2014) A short-term field experiment on sub-debris melt at the highly maritime Franz Josef Glacier, Southern Alps, New Zealand. Journal of Hydrology (New Zealand) 53(2), 157165.Google Scholar
Hagg, W, Mayer, C, Lambrecht, A and Helm, A (2008) Sub-debris melt rates on Southern Inylchek Glacier, central Tian Shan. Geografiska Annaler: Series A, Physical Geography 90(1), 5563. doi: 10.1111/j.1468-0459.2008.00333.x.CrossRefGoogle Scholar
Haidong, H, Yongjing, D and Shiyin, L (2006) A simple model to estimate ice ablation under a thick debris layer. Journal of Glaciology 52(179), 528536. doi: 10.3189/172756506781828395.Google Scholar
Hao, Z and 12 others (2018) kableExtra: construct complex table with `kable’ and pipe syntax. R package version 1.1.0. Available at https://CRAN.R-project.org/package=kableExtra.Google Scholar
Hijmans, RJ and 26 others (2017) raster: geographic data analysis and modelling. R package version 3.1–5. Available at https://CRAN.R-project.org/package=raster.Google Scholar
Hock, R (1999) A distributed temperature-index ice- and snowmelt model including potential direct solar radiation. Journal of Glaciology 45(149), 101111. doi: 10.3189/S0022143000003087.CrossRefGoogle Scholar
Hock, R (2003) Temperature index melt modelling in mountain areas. Journal of Hydrology 282, 104115. doi: 10.1016/S0022-1694(03)00257-9.Google Scholar
Hock, R (2005) Glacier melt: a review of processes and their modelling. Progress in Physical Geography 29(3), 362391. doi: 10.1191/0309133305pp453ra.CrossRefGoogle Scholar
Hock, R, Radić, V and De Woul, M (2007) Climate sensitivity of Storglaciären, Sweden: an intercomparison of mass-balance models using ERA-40 re-analysis and regional climate model data. Annals of Glaciology 46, 342348. doi: 10.3189/172756407782871503.Google Scholar
Immerzeel, WW, van Beek, LPH, Konz, M, Shrestha, AB and Bierkens, MFP (2012) Hydrological response to climate change in a glacierized catchment in the Himalayas. Climatic Change 110, 721736. doi: 10.1007/s10584-011-0143-4.CrossRefGoogle Scholar
Immerzeel, WW, Wanders, N, Lutz, AF, Shea, JM and Bierkens, MFP (2015) Reconciling high-altitude precipitation in the upper Indus basin with glacier mass balances and runoff. Hydrology and Earth System Sciences 19, 46734687. doi: 10.5194/hess-19-4673-2015.CrossRefGoogle Scholar
Intergovernmental Panel on Climate Change (IPCC) (2014) Key economic sectors and services. In Climate Change 2014 - Impacts, Adaptation and Vulnerability: Part A: Global and Sectoral Aspects: Working Group II Contribution to the IPCC Fifth Assessment Report. Cambridge: Cambridge University Press, 659708, doi: 10.1017/CBO9781107415379.CrossRefGoogle Scholar
Irvine-Fynn, TDL, Hanna, E, Barrand, NE, Porter, PR, Kohler, J and Hodson, AJ (2014) Examination of a physically based, high-resolution, distributed Arctic temperature-index melt model, on Midtre Lovénbreen, Svalbard. Hydrological Processes 28, 134149. doi: 10.1002/hyp.9526.CrossRefGoogle Scholar
Juen, M, Mayer, C, Lambrecht, A, Han, H and Liu, S (2014) Impact of varying debris cover thickness on ablation: a case study for Koxkar Glacier in the Tien Shan. The Cryosphere 8, 377386. doi: 10.5194/tc-8-377-2014.CrossRefGoogle Scholar
Juen, M, Mayer, C, Lambrecht, A, Wirbel, A and Kueppers, U (2013) Thermal properties of a supraglacial debris layer with respect to lithology and grain size. Geografiska Annaler, Series A: Physical Geography 95(3), 197209. doi: 10.1111/geoa.12011.CrossRefGoogle Scholar
Kassambara, A (2018) ggpubr: `ggplot2’ based publication ready plots. R package version 0.2. https://CRAN.R-project.org/package=ggpubr.Google Scholar
Kasurak, A, Kelly, R and Brenning, A (2011) Linear mixed modelling of snow distribution in the central Yukon. Hydrological Processes 25, 33323346. doi: 10.1002/hyp.8168.CrossRefGoogle Scholar
Kaur, S and Purohit, M (2013) Rainfall statistics of India - 2012. New Delhi: India Meteorological Department (Ministry of Earth Sciences). ESSE/IMD/HS/R.F.REP/02(2013)/16. Available at http://hydro.imd.gov.in/hydrometweb/(S(ca1icn55kcriad55mtvwgw45))/PRODUCTS/Publications/Rainfall Statistics of India - 2012/Rainfall Statistics of India - 2012.pdf.Google Scholar
Kaur, S and Purohit, M (2014) Rainfall statistics of India - 2013. New Delhi: India Meteorological Department (Ministry of Earth Sciences). ESSO/IMD/HS/R.F.REPORT/02(2014)/18. Available at http://hydro.imd.gov.in/hydrometweb/(S(ca1icn55kcriad55mtvwgw45))/PRODUCTS/Publications/Rainfall Statistics of India - 2013/Rainfall Statistics of India - 2013.pdf.Google Scholar
Kayastha, RB, Takeuchi, Y, Nakawo, M and Ageta, Y (2000) Practical prediction of ice melting beneath various thickness of debris cover on Khumbu Glacier, Nepal, using a positive degree-day factor. Debris-Covered Glaciers (Proceedings of workshop held at Seattle, Washington, USA, September 2000), IAHS. Publication 264, 7181. https://iahs.info/uploads/dms/11683.71-81-264-Kayastha.pdf.Google Scholar
Khan, MI (1989) Ablation on Barpu Glacier, Karakoram Himalaya, Pakistan: a study of melt processes on a faceted, debris-covered ice surface. Thesis submitted in partial completion of the requirements of a Master of Arts, Wilfrid Laurier University, Canada.Google Scholar
Knowles, JE, Frederick, C and Whitworth, A (2018) merTools: tools for analyzing mixed effect regression models. R package version 0.4.1. https://CRAN.R-project.org/package=merTools.Google Scholar
Konz, M, Uhlenbrook, S, Braun, L, Shrestha, A and Demuth, S (2007) Implementation of a process-based catchment model in a poorly gauged, highly glacierized Himalayan headwater. Hydrology and Earth System Sciences 11, 13231339. doi: 10.5194/hess-11-1323-2007.CrossRefGoogle Scholar
Koppes, M, Rupper, S and Asay, M, Winter-Billington, A (2015) Sensitivity of glacier runoff projections to baseline climate data in the Indus River basin. Frontiers in Earth Science 3(59). doi: 10.3389/feart.2015.00059.CrossRefGoogle Scholar
Kumar, R and 7 others (2016) Development of a glacio-hydrological model for discharge and mass balance reconstruction. Water Resources Management 30, 34753492. doi: 10.1007/s11269-016-1364-0.Google Scholar
Kustas, WP, Rango, A and Uijlenhoet, R (1994) A simple energy budget algorithm for the snowmelt runoff model. Water Resources Research 30(5), 15151527. doi: 10.1029/94WR00152.CrossRefGoogle Scholar
Kuznetsova, A, Brockhoff, PB and Christensen, RHB (2017) lmerTest Package: tests in linear mixed effects models. Journal of Statistical Software 82(13), 126. doi: 10.18637/jss.v082.i13.CrossRefGoogle Scholar
Lambrecht, A and 6 others (2011) A comparison of glacier melt on debris-covered glaciers in the northern and southern Caucasus. The Cryosphere 5, 525538. doi: 10.5194/tc-5-525-2011.CrossRefGoogle Scholar
Lang, H and Braun, L (1990) On the information content of air temperature in the context of snow melt estimation. Hydrology of Mountainous Areas (Proceedings of the Štrbské Pleso, Czechoslovakia, June 1988), IAHS Publication 190, 347354. http://hydrologie.org/redbooks/a190/iahs_190_0347.pdf.Google Scholar
Lejeune, Y, Bertrand, JM, Wagnon, P and Morin, S (2013) A physically based model of the year-round surface energy and mass balance of debris-covered glaciers. Journal of Glaciology 59(214), 327344. doi: 10.3189/2013JoG12J149.CrossRefGoogle Scholar
Litt, M and 6 others (2019) Glacier ablation and temperature indexed melt models in the Nepalese Himalaya. Nature Scientific Reports 9(5264), 113. doi: 10.1038/s41598-019-41657-5.Google ScholarPubMed
Loveland, TR and 6 others (2000) Development of a global land cover characteristics database and IGBP DISCover from 1 km AVHRR data. International Journal of Remote Sensing 21(6-7), 13031330. doi: 10.1080/014311600210191.CrossRefGoogle Scholar
Lundstrom, SC, McCafferty, AE and Coe, JA (1993) Photogrammetric analysis of 1984-89 surface altitude change of the partially debris-covered Eliot Glacier, Mount Hood, Oregon, USA. Annals of Glaciology 17, 167170. doi: 10.3189/S0260305500012787.CrossRefGoogle Scholar
Mair, P (2016) Thou shalt be reproducible! a technology perspective. Frontiers in Psychology 7(1079), doi: 10.3389/fpsyg.2016.01079.CrossRefGoogle ScholarPubMed
Masiokas, MH and 11 others (2016) Reconstructing the annual mass balance of the Echaurren Norte glacier (Central Andes, 33.5°S) using local and regional hydroclimatic data. The Cryosphere 10, 927940. doi: 10.5194/tc-10-927-2016.CrossRefGoogle Scholar
Mattson, LE, Gardner, JS and Young, GJ (1993) Ablation on debris covered glaciers: an example from the Rakhiot Glacier, Punjab, Himalaya. Snow and Glacier Hydrology (Proceedings of the Kathmandu Symposium, November 1992), IAHS Publication 218, 289296. https://iahs.info/uploads/dms/9559.289-296-218-Mattson.pdf.Google Scholar
Mayer, C, Lambrecht, A, Hagg, W and Narozhny, Y (2011) Glacial debris cover and melt water production for glaciers in the Altay, Russia. The Cryosphere Discussions 5(1), 401430. doi: 10.5194/tcd-5-401-2011.CrossRefGoogle Scholar
Mernild, SH, Liston, GE and Hiemstra, CA (2014) Northern Hemisphere glacier and ice cap surface mass balance and contribution to sea level rise. Journal of Climate (Boston) 27(15), 60516073. doi: 10.1175/JCLI-D-13-00669.1.Google Scholar
Mihalcea, C and 7 others (2008) Spatial distribution of debris thickness and melting from remote-sensing and meteorological data, at debris-covered Baltoro glacier, Karakoram, Pakistan. Annals of Glaciology 48, 4957. doi: 10.3189/172756408784700680.CrossRefGoogle Scholar
Mihalcea, C, Mayer, C, Diolaiuti, G, Lambrecht, A, Smiraglia, C and Tartari, G (2006) Ice ablation and meteorological conditions on the debris-covered area of Baltoro glacier, Karakoram, Pakistan. Annals of Glaciology 43, 292300. doi: 10.3189/172756406781812104.CrossRefGoogle Scholar
Möller, R, Möller, M, Kukla, PA and Schneider, C (2016) Impact of supraglacial deposits of tephra from Grímsvötn volcano, Iceland, on glacier ablation. Journal of Glaciology 62(235), 933943. doi: 10.1017/jog.2016.82.CrossRefGoogle Scholar
Müller, K (2017) here: a simpler way to find your files. R package version 0.1. Available at https://CRAN.R-project.org/package=here.Google Scholar
Nakawo, M and Young, GJ (1981) Field experiments to determine the effect of a debris layer on ablation of glacier ice. Annals of Glaciology 2, 8591. doi: 10.3189/172756481794352432.CrossRefGoogle Scholar
Nakawo, M and Young, GJ (1982) Estimate of glacier ablation under a debris layer from surface temperature and meteorological variables. Journal of Glaciology 28(98), 2934. doi: 10.3189/S002214300001176X.CrossRefGoogle Scholar
Neuwirth, E (2014) RColorBrewer: ColorBrewer palettes. R package version 1.1–2. Available at https://CRAN.R-project.org/package=RColorBrewer.Google Scholar
Nicholson, L and Benn, DI (2006) Calculating ice melt beneath a debris layer using meteorological data. Journal of Glaciology 52(178), 463470. doi: 10.3189/172756506781828584.CrossRefGoogle Scholar
Nicholson, L and Benn, DI (2013) Properties of natural supraglacial debris in relation to modelling sub-debris ice ablation. Earth Surface Processes and Landforms 38, 490501. doi: 10.1002/esp.3299.CrossRefGoogle Scholar
Ohmura, A (2001) Physical basis for the temperature-based melt-index method. Journal of Applied Meteorology 40, 753761. doi: 10.1175/1520-0450(2001)040¡0753:PBFTTB¿2.0.CO;2.2.0.CO;2>CrossRefGoogle Scholar
Østrem, G (1959) Ice melting under a thin layer of moraine, and the existence of ice cores in moraine ridges. Geografiska Annaler 41(4), 228230.CrossRefGoogle Scholar
Parajuli, A, Chand, MB and Kayastha, RB (2015) Modified temperature index model for estimating the melt water discharge from debris-covered Lirung Glacier, Nepal. Remote Sensing and GIS for Hydrology and Water Resources (Proceedings RSHS14 and ICGRHWE14, Guangzhou, China, August 2014), IAHS Publication 368, 409414. doi: 10.5194/piahs-368-409-2015.Google Scholar
Patel, LK, Sharma, P, Thamban, M, Singh, A and Ravindra, R (2016) Debris control on glacier thinning - a case study of the Batal glacier, Chandra basin, Western Himalaya. Arab Journal of Geosciences 9(309) doi: 10.1007/s12517-016-2362-5.Google Scholar
Pellicciotti, F, Brock, B, Strasser, U, Burlando, P, Funk, M and Corripio, J (2005) An enhanced temperature-index glacier melt model including the shortwave radiation balance: development and testing for Haut Glacier d'Arolla, Switzerland. Journal of Glaciology 51(175), 573587. doi: 10.3189/172756505781829124.CrossRefGoogle Scholar
Pellicciotti, F, Buergi, C, Immerzeel, WW, Konz, M and Shrestha, AB (2012) Challenges and uncertainties in hydrological modelling of remote Hindu Kush–Karakoram–Himalayan (HKH) basins: suggestions for calibration strategies. Mountain Research and Development 32(1), 3950. doi: 10.1659/MRD-JOURNAL-D-11-00092.1.CrossRefGoogle Scholar
Pierce, D (2017) ncdf4: interface to unidata netCDF (version 4 or earlier) format data files. R package version 1.16. Available at https://CRAN.R-project.org/package=ncdf4.Google Scholar
Pradhananga, NS and 6 others (2014) Estimation of discharge from Langtang River basin, Rasuwa, Nepal, using a glacio-hydrological model. Annals of Glaciology 55(66), 223230. doi: 10.3189/2014AoG66A123.CrossRefGoogle Scholar
Pratap, B, Dobhal, DP, Mehta, M and Bhambri, R (2015) Influence of debris cover and altitude on glacier surface melting: a case study on Dokriani Glacier, central Himalaya, India. Annals of Glaciology 56(70), 916. doi: 10.3189/2015AoG70A971.CrossRefGoogle Scholar
Radić, V and Hock, R (2014) Glaciers in the Earth's hydrological cycle: assessments of glacier mass and runoff changes on global and regional scales. Surveys in Geophysics 35, 813837. doi: 10.1007/s10712-013-9262-y.CrossRefGoogle Scholar
Ragettli, S and 9 others (2015) Unraveling the hydrology of a Himalayan catchment through integration of high resolution in situ data and remote sensing with an advanced simulation model. Advances in Water Resources 78, 94111. doi: 10.1016/j.advwatres.2015.01.013.CrossRefGoogle Scholar
Ragettli, S, Pellicciotti, F, Bordoy, R and Immerzeel, WW (2013) Sources of uncertainty in modelling the glaciohydrological response of a Karakoram watershed to climate change. Water Resources Research 49, 60486066. doi: 10.1002/wrcr.20450.CrossRefGoogle Scholar
Rana, B, Nakawo, M, Ageta, Y and Seko, K (1998) Glacier ablation under debris cover: field observations on Lirung Glacier, Nepal Himalayas. Ecohydrology of High Mountain Areas (Proceedings of the International Conference, Kathmandu, Nepal, March 1996). 393403.Google Scholar
R Core Team (2017) R: a language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. Available at https://www.R-project.org/.Google Scholar
Reid, TD and Brock, BW (2010) An energy-balance model for debris-covered glaciers including heat conduction through the debris layer. Journal of Glaciology 56(199), 903916. doi: 10.3189/002214310794457218.CrossRefGoogle Scholar
Reid, TD, Carenzo, M, Pellicciotti, F and Brock, BW (2012) Including debris cover effects in a distributed model of glacier ablation. Journal of Geophysical Research 117(D18105), 115. doi: 10.1029/2012JD017795.Google Scholar
Réveillet, M and 8 others (2018) Relative performance of empirical and physical models in assessing the seasonal and annual glacier surface mass balance of Saint-Sorlin Glacier (French Alps). The Cryosphere 12, 13671386. doi: 10.5194/tc-12-1367-2018.CrossRefGoogle Scholar
Reznichenko, N, Davies, T, Shulmeister, J, McSaveney, M (2010) Effects of debris on ice-surface melting rates: an experimental study. Journal of Glaciology 56(197), 384394. doi: 10.3189/002214310792447725.CrossRefGoogle Scholar
RGI Consortium (2017) Randolph Glacier Inventory (RGI) – a dataset of global glacier outlines: version 6.0, Technical Report. Colorado, USA: Global Land Ice Measurements from Space, Digital Media. doi: 10.7265/N5-RGI-60.CrossRefGoogle Scholar
Richardson, JM and Brook, MS (2010) Ablation of debris-covered ice: some effects of the 25 September 2007 Mt Ruapehu eruption. Journal of the Royal Society of New Zealand 40(2), 4555. doi: 10.1080/03036758.2010.494714.CrossRefGoogle Scholar
Rienecker, MM and 28 others (2011) MERRA: NASA's modern-era retrospective analysis for research and applications. Journal of Climate 24(14), 36243648. doi: 10.1175/JCLI-D-11-00015.1.CrossRefGoogle Scholar
Sasaki, O, Noguchi, O, Zhang, Y, Hirabayashi, Y and Kanae, S (2016) A global high-resolution map of debris on glaciers derived from multi-temporal ASTER images. The Cryosphere Discussions, doi: 10.5194/tc-2016-222.CrossRefGoogle Scholar
Scherler, D, Wulf, H and Gorelick, N (2018) Global assessment of supraglacial debris-cover extents. Geophysical Research Letters 45, 11,79811,805. doi: 10.1029/2018GL080158.CrossRefGoogle Scholar
Schmitt, S (2016) Cite: an RStudio addin to insert BibTex citation in Rmarkdown documents. R package version 0.1.0. Available at https://CRAN.R-project.org/package=Cite.Google Scholar
Shadish, WR, Cook, TD and Campbell, DT (2002) Experimental and quasi-experimental designs for general causal inference. USA: Wadsworth: Belmont.Google Scholar
Shea, JM, Immerzeel, WW, Wagnon, P, Vincent, C and Bajracharya, S (2015) Modelling glacier change in the Everest region, Nepal Himalaya. The Cryosphere 9, 11051128. doi: 10.5194/tc-9-1105-2015.CrossRefGoogle Scholar
Shea, JM and Moore, RD (2010) Prediction of spatially distributed regional-scale fields of air temperature and vapor pressure over mountain glaciers. Journal of Geophysical Research 115(D23107), 115. doi: 10.1029/2010JD014351.CrossRefGoogle Scholar
Shea, JM, Moore, RD and Stahl, K (2009) Derivation of melt factors from glacier mass-balance records in western Canada. Journal of Glaciology 55(189), 123130. doi: 10.3189/002214309788608886.CrossRefGoogle Scholar
Singh, SS, Banerjee, A, Nainwal, HC and Shankar, R (2019) Estimation of the total sub-debris ablation from point-scale ablation data on a debris-covered glacier. Journal of Glaciology 65(253), 759769. doi: 10.1017/jog.2019.48.Google Scholar
South, A (2017a) rnaturalearth: world map data from Natural Earth. R package version 0.1.0. Available at https://cran.r-project.org/web/packages/rnaturalearth/rnaturalearth.pdf.Google Scholar
South, A (2017b) rnaturalearthdata: world vector map data from Natural Earth used in `rnaturalearth’. R package version 0.1.0. Available at https://CRAN.R-project.org/package=rnaturalearthdata.Google Scholar
Stahl, K, Moore, RD, Floyer, JA, Asplin, MG and McKendry, IG (2006) Comparison of approaches for spatial interpolation of daily air temperature in a large region with complex topography and highly variable station density. Agricultural and Forest Meteorology 139, 224236. doi: 10.1016/j.agrformet.2006.07.004.CrossRefGoogle Scholar
T, Poisot (2011) The digitize package: extracting numerical data from scatterplots. The R Journal 3(1), 2526. doi: 10.32614/RJ-2011-004.Google Scholar
Trubilowicz, JW, Shea, JM, Jost, G and Moore, RD (2016) Suitability of North American Regional Reanalysis (NARR) output for hydrologic modelling and analysis in mountainous terrain. Hydrological Processes 30, 23322347. doi: 10.1002/hyp.10795.CrossRefGoogle Scholar
Urbanek, S (2013) tiff: read and write TIFF images. R package version 0.1–5. Available at https://CRAN.R-project.org/package=tiff.Google Scholar
Wang, P, Li, Z, Li, H, Wang, W, Zhou, P and Wang, L (2017) Characteristics of a partially debris-covered glacier and its response to atmospheric warming in Mt. Tomor, Tien Shan, China. Global and Planetary Change 159, 1124. doi: 10.1016/j.gloplacha.2017.10.006.Google Scholar
Wheler, BA (2009) Glacier melt modelling in the Donjek Range, St. Elias Mountains, Yukon Territory. MSc thesis, Simon Fraser University.Google Scholar
Wheler, BA, MacDougall, AH, Flowers, GE, Petersen, EI, Whitfield, LH and Kohfeld, KE (2014) Effects of temperature forcing provenance and extrapolation on the performance of an empirical glacier-melt model. Arctic, Antarctic, and Alpine Research 46(2), 379393. doi: 10.1657/1938-4246-46.2.379.CrossRefGoogle Scholar
Wickham, H (2010) ggplot2: elegant graphics for data analysis. New York: Springer-Verlag. Available from https://ebookcentral.proquest.com/lib/ubc/detail.action?docID=511468.Google Scholar
Wickham, H, François, R, Henry, L and Müller, K (2018) dplyr: a grammar of data manipulation. R package version 0.7.8. Available at https://CRAN.R-project.org/package=dplyr.Google Scholar
Xie, Y (2018a) Bookdown: authoring Books and Technical Documents with RMarkdown. New York: Chapman and Hall/CRC, doi: 10.1201/9781315204963.Google Scholar
Xie, Y (2018b) knitr: a general-purpose package for dynamic report generation in R. R package version 1.20, https://yihui.org/knitr/.Google Scholar
Yang, W, Yao, T, Xu, B and Zhou, H (2010) Influence of supraglacial debris on summer ablation and mass balance in the 24k glacier, southeast Tibetan Plateau. Geografiska Annaler: Series A, Physical Geography 92(3), 353360. doi: 10.1111/ j.1468-0459.2010.00400.x.Google Scholar
Yu, G (2019) ggplotify: convert plot to `grob’ or `ggplot’ object. R package version 0.0.4. Available at https://CRAN.R-project.org/package=ggplotify.Google Scholar
Zhang, Y, Fujita, K, Liu, S, Liu, Q and Nuimura, T (2011) Distribution of debris thickness and its effect on ice melt at Hailuogou glacier, southeastern Tibetan Plateau, using in situ surveys and ASTER imagery. Journal of Glaciology 57(206), 11471157. doi: 10.3189/002214311798843331.CrossRefGoogle Scholar
Zhang, Y, Liu, S and Ding, Y (2007) Glacier meltwater and runoff modelling, Keqicar Baqi glacier, southwestern Tien Shan, China. Journal of Glaciology 53(180), 9198. doi: 10.3189/172756507781833956.CrossRefGoogle Scholar
Figure 0

Table 1. Classical sub-debris melt factors, k (mm°C−1δt−1), that have been applied to model sub-debris melt with time intervals (δt) of an hr = hour, d = day or m = month

Figure 1

Table 2. Restricted sub-debris melt factors, kR, calculated with air temperature as one of a set of predictors, that have been applied to model sub-debris melt

Figure 2

Table 3. Data and variables

Figure 3

Fig. 1. The location of debris-covered glaciers in this study (blue diamonds). Symbol size indicates the number of individual observations from each glacier, on a continuous scale. The black polygons are the Randolph Glacier Inventory (RGI) 6.0 first-order glaciological regions (RGI Consortium, 2017), labeled with their numeric IDs. The white areas are the RGI 6.0 glacier outlines, Greenland and Antarctica. The background map is based on data from naturalearthdata.com.

Figure 4

Fig. 2. Observed melt rate (a) and mean daily positive degree-days based on MERRA-2 air temperatures (D), with least-squares best-fit lines through the origin for bins of debris thickness. Crosses are extreme values that were removed for model fitting.

Figure 5

Table 4. Fitted coefficients with standard errors and AIC for models of $\hat {y}_{{\rm KO}}$, $\hat {y}_{{\rm KM}}$, $\hat {y}_{{\rm KP}}$ and $\hat {y}_{{\rm KM_d}}$.

Figure 6

Table 5. Cross-validation metrics for predicted melt rates, $\hat {a}$

Figure 7

Fig. 3. Left column: observed melt rates, a, and modeled melt rates, $\hat {a}$, using the best models for ko, kM and kP (rows 1–3, respectively). MERRA-2 positive degree-days were used as input to models KM1 and KP1. In plot a, $\hat {a}_{{\rm KO2-T}}$ and $\hat {a}_{{\rm KO2-D}}$ are represented with triangles and dots, respectively. The solid lines represent perfect agreement and the dashed lines are ± 25% error. Right column: observed melt factors, k (crosses), modeled melt factors, $\hat {k}$ (curves) and 95% prediction limits (shaded areas), against debris thickness, h.

Figure 8

Fig. 4. The variation of kd among ablation stakes for each month and year of the 2010–2013 ablation seasons.

Figure 9

Fig. 5. Left column: observed melt rates, a, and predicted melt rates, $\hat {a}$, for Dokriani Glacier and each month of the ablation season, using model KMd2 and MERRA-2 positive degree-days. The solid lines represent perfect agreement and the dashed lines are ± 25% error. Right column: observed kd (crosses), predicted values, $\hat {k_{\rm d}}$ (curves) and 95% prediction limits for each month (shaded areas), against debris thickness, h.

Figure 10

Table 6. References and summary statistics for the reported melt factors

Figure 11

Table 7. References for the reported melt rates and the number of observations at each glacier

Figure 12

Table 8. The RMSD of observed air temperatures and MERRA-2 air temperatures adjusted for elevation with lapse rates

Figure 13

Fig. 6. Variables T2ΓC and To, with symbols distinguishing To data provenance.

Figure 14

Fig. 7. The difference between T2ΓC and To, e, plotted against MERRA-2 grid cell fraction of land ice, η.

Supplementary material: PDF

Winter-Billington et al. supplementary material

Figures S1-S18

Download Winter-Billington et al. supplementary material(PDF)
PDF 451.2 KB