Hostname: page-component-848d4c4894-5nwft Total loading time: 0 Render date: 2024-05-08T09:09:02.661Z Has data issue: false hasContentIssue false

Reproducibility of dietary intakes of macronutrients, specific food groups, and dietary patterns in 211 050 adults in the UK Biobank study

Published online by Cambridge University Press:  29 October 2019

Jennifer L. Carter*
Affiliation:
Clinical Trial Service Unit and Epidemiological Studies Unit, Nuffield Department of Population Health, University of Oxford, Oxford, UK
Sarah Lewington
Affiliation:
Clinical Trial Service Unit and Epidemiological Studies Unit, Nuffield Department of Population Health, University of Oxford, Oxford, UK Medical Research Council Population Health Research Unit, Nuffield Department of Population Health, University of Oxford, Oxford, UK
Carmen Piernas
Affiliation:
Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK
Kathryn Bradbury
Affiliation:
National Institute for Health Innovation, School of Population Health, The University of Auckland, Auckland, New Zealand
Timothy J. Key
Affiliation:
Cancer Epidemiology Unit, Nuffield Department of Population Health, University of Oxford, Oxford, UK
Susan A. Jebb
Affiliation:
Medical Research Council Population Health Research Unit, Nuffield Department of Population Health, University of Oxford, Oxford, UK Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK
Matthew Arnold
Affiliation:
Department of Public Health and Primary Care, University of Cambridge, Cambridge, Cambridgeshire, UK
Derrick Bennett
Affiliation:
Clinical Trial Service Unit and Epidemiological Studies Unit, Nuffield Department of Population Health, University of Oxford, Oxford, UK
Robert Clarke
Affiliation:
Clinical Trial Service Unit and Epidemiological Studies Unit, Nuffield Department of Population Health, University of Oxford, Oxford, UK
*
*Corresponding author: Jennifer L. Carter, fax +44 1865 743985, email jennifer.carter@ndph.ox.ac.uk

Abstract

To detect modest associations of dietary intake with disease risk, observational studies need to be large and control for moderate measurement errors. The reproducibility of dietary intakes of macronutrients, food groups and dietary patterns (vegetarian and Mediterranean) was assessed in adults in the UK Biobank study on up to five occasions using a web-based 24-h dietary assessment (n 211 050), and using short FFQ recorded at baseline (n 502 655) and after 4 years (n 20 346). When the means of two 24-h assessments were used, the intra-class correlation coefficients (ICC) for macronutrients varied from 0·63 for alcohol to 0·36 for polyunsaturated fat. The ICC for food groups also varied from 0·68 for fruit to 0·18 for fish. The ICC for the FFQ varied from 0·66 for meat and fruit to 0·48 for bread and cereals. The reproducibility was higher for vegetarian status (κ > 0·80) than for the Mediterranean dietary pattern (ICC = 0·45). Overall, the reproducibility of pairs of 24-h dietary assessments and single FFQ used in the UK Biobank were comparable with results of previous prospective studies using conventional methods. Analyses of diet–disease relationships need to correct for both measurement error and within-person variability in dietary intake in order to reliably assess any such associations with disease in the UK Biobank.

Type
Research Article
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution, and reproduction in any medium, provided the original work is properly cited.
Copyright
Copyright © The Author(s) 2019

Diet has been estimated to account for about one-third of all deaths from CVD and cancer(Reference Newton, Briggs and Murray1,Reference Forouzanfar, Alexander and Anderson2) . Recent research has continued to highlight the ongoing limitations in the methods used to reliably assess dietary intake in population studies using either 24-h dietary recalls or FFQ(Reference Trepanowski and Ioannidis3,Reference Freedman, Midthune and Arab4) . Epidemiological studies need to be large enough to detect modest differences in risk, and failure to appreciate the importance of within-person variability in dietary intake will result in underestimation of associations with disease in population studies. It is important to obtain repeat measurements in individuals of dietary intake at intervals of several months or years to control for random measurement error, within-person variability and true changes in diet, as all of these sources of variability contribute to misclassification of an individual's ‘usual’ dietary intake over a long period of time(Reference Willet, Lenart and Willet5). By controlling for these sources of variability, reliable estimates of the true associations between the ‘usual’ levels of dietary intake over a particular period and incident disease at the same or later time can be obtained(Reference Willet, Lenart and Willet5,Reference Clarke, Shipley and Lewington6) . Recent advances in technology now permit serial assessments of self-completed dietary questionnaires using web-based platforms in large-scale cohort studies. The potential for these digital technologies to improve the estimation of dietary intake, however, is ongoing and requires quantification prior to their use in population studies of diet and incident disease.

The UK Biobank is a prospective cohort study of 0·5 million adults and is one of the largest prospective studies with repeat 24-h assessments of dietary intake and FFQ. Measuring the reproducibility of these measurements, or the degree of consistency between the repeated 24-h assessments, will quantify the magnitude of within-person variability (i.e. change or variation in an individual's dietary intake and chance fluctuations in a person's recorded dietary intake that average to ‘true’ intake over repeat administrations)(Reference Willet, Lenart and Willet5,Reference Willett and Willett7,Reference Bennett, Landry and Little8) . While reproducibility does not indicate how valid these 24-h assessments are (i.e. how accurately the measurements reflect true dietary intake), the estimates of reproducibility can still be used to correct for the underestimation of relative risks arising from random measurement errors in exposures (i.e. ‘regression dilution bias’) in order to calculate more reliable associations between ‘usual’ dietary intake and incident disease outcomes in the UK Biobank(Reference Willet, Lenart and Willet5,Reference Clarke, Shipley and Lewington6) . The aims of the present report were to estimate the reproducibility of dietary intakes of macronutrients, food groups and selected dietary patterns using serial web-based 24-h dietary assessments in 211 050 participants from the UK Biobank study who completed such assessments; and to compare measurements of intakes from food groups from the mean of 24-h dietary assessments with those estimated using a single short FFQ on all 0·5 million participants.

Methods

The UK Biobank is a population-based prospective cohort study of 502 655 participants aged 40–69 years at recruitment between 2006 and 2010. Participants living within 25 miles (40·2 km) of twenty-two assessment centres across England, Wales and Scotland were identified through National Health Service (NHS) central registers (containing 98 % of the UK population). All eligible adults (about 9·2 million) were sent an invitation letter, with a response rate of about 5·5 %. Details of the study protocol have been published elsewhere(Reference Allen, Sudlow and Downey9,10) . UK Biobank participants completed two types of dietary assessments on several occasions between 2006 and 2013: a short FFQ and a 24-h dietary assessment (see Fig. 1). At baseline assessment, all participants completed a short FFQ (described below). Towards the end of the recruitment period an enhancement was added to the baseline assessment protocol so that, between April 2009 and September 2010, 70 724 participants attending their first assessment centre visit at recruitment completed a modified 24-h dietary assessment capturing the foods and beverages consumed during the previous 24 h (detailed below; see Fig. 1). Between February 2011 and April 2012, identical web-based 24-h dietary assessments were emailed on four separate occasions (cycles) over a 16-month period to 331 013 participants who provided a valid email address. Invitations were scheduled to maximise variation by season and day of the week. The response rate for the web-based assessment was 53 % (n 176 012), with a total of 211 050 participants completing at least one 24-h dietary assessment online or at the assessment centre. Of these, 84 175 (40 %) completed a single assessment; 48 129 (23 %) completed two assessments; 42 492 (20 %) completed three assessments; 30 488 (15 %) completed four assessments and 5766 (3 %) completed five assessments. The response rate varied between 26 and 33 % in each cycle, with some participants missing one cycle and then returning to complete a later cycle.

Fig. 1. Timeline of UK Biobank dietary assessment measurement 2006–2015, including the 24-h dietary assessment (24-h) and the short FFQ.

Dietary measures from the 24-h dietary assessment

Unlike standard 24-h dietary recalls that ask respondents to report everything they ate in the previous day, the 24-h dietary assessments in the UK Biobank presented participants with a list of commonly consumed foods on which they indicated their consumption in the previous 24 h(Reference Davey, Spencer and Appleby11Reference Galante, Adamska and Young13). Consumption of up to 206 widely consumed foods and thirty-two types of drinks were recorded using the 24-h dietary assessment, which took approximately 15 min to complete (median 15 (interquartile range 11–19) min). Standard categories and descriptions were used for portion sizes of each food (for example, slices of bread), and participants were asked to enter the ingredients individually for composite dishes (for example, so spaghetti bolognaise would be recorded as separate items for pasta, meat and tomato-based sauce)(Reference Liu, Young and Crowe12). An open text box was included at the end for additional items that were not included on the food list. Participants also indicated if their food consumption in the previous day was ‘typical’ or if they followed any special diets (for example, vegetarian or gluten-free). Total energy intake (kJ) and macronutrient (g) values were estimated for protein, total fat, saturated fat, polyunsaturated fat, carbohydrates, total sugars, starch, fibre and alcohol using previously validated methods(Reference Liu, Young and Crowe12). Nutrient intakes were calculated using associated portion sizes for each food/beverage item and by multiplying the amount consumed by the nutrient composition, using standard food consumption tables for the UK(Reference Holland, Welch and Unwin14Reference Holland, Unwin and Buss23). Reproducibility was also calculated for six commonly consumed food groups: (i) meat (beef, lamb, pork, bacon, ham, sausage, liver, or chicken), (ii) cheese, (iii) bread and breakfast cereals, (iv) fruit (fresh or dried), (v) vegetables (excluding potatoes) and (vi) fish (oily and not oily).

Dietary measures from the short FFQ

All 0·5 million UK Biobank participants completed a short computer touchscreen questionnaire at their initial assessment centre visit that included twenty-nine questions about their average diet over the previous 12 months, most of which asked about the frequency of consumption of the six food groups specified above. In addition, a sample of 20 346 participants completed a repeat assessment about 4 years later (Fig. 1). Typically, responses to the short FFQ included: never, less than once per week, once per week, 2–4 times per week, 5–6 times per week, or once or more daily. For fruit and vegetables, participants were asked to directly enter the average number of servings consumed each day; for bread and breakfast cereals, participants entered the average number of servings per week. Daily intake (g) for the short FFQ was calculated by multiplying the frequency of intake by standard portion size (g) in the UK (for example, eating chicken 5–6 times per week would have been (5·5/7) multiplied by 120 g)(Reference Crawley24). See Supplementary Methods for additional details.

Vegetarian and Mediterranean dietary patterns were also assessed as these dietary patterns have been more strongly associated with incident disease than individual nutrients. Participants were classified as consuming a vegetarian diet if they self-reported a vegetarian diet (24-h dietary assessment) or if they reported never eating any meat or fish (short FFQ). A Mediterranean-style diet score, as defined by previous research, was estimated for each cycle of the 24-h dietary assessment by summing the indicators for each of the following (diet score range 0–9): if participants consumed greater than the median servings per d for vegetables, legumes, fruit, nuts, fish, wholegrains and the ratio of dietary monounsaturated to saturated fat intake; less than the median intake for red and processed meat; and between 5 and 25 g per d for ethanol(Reference Fung, McCullough and Newby25,Reference Liese, Krebs-Smith and Subar26) .

Statistical methods

The mean intakes of individual macronutrients, food groups and dietary patterns were calculated across 24-h dietary assessments. The Mediterranean diet score and macronutrient intakes were normally distributed, except for alcohol, which was transformed with a rank-based inverse normal transformation; distributions of food group intakes were similarly transformed. Reproducibility was assessed using intra-class correlation coefficients (ICC; i.e. the proportion of between-subject variance to the total variance) from a one-way ANOVA for all dietary intakes, except for a vegetarian dietary pattern, which was assessed with a weighted κ statistic because it was a dichotomous variable(Reference Van Dam, Hunter and Willet27). Since variation in daily dietary intake is expected to be high, the average of an increasing number of 24-h dietary assessments should reduce random error and provide a better estimate of the true ‘usual’ intake(Reference Willett and Willett7,Reference Baranowski and Willet28) . In the main analyses, the mean of the first two cycles of the 24-h dietary assessment was compared with the mean of the subsequent two cycles of the 24-h dietary assessment for participants who completed at least four 24-h assessments (n 36 254, 17·2 % of the total sample). To assess the impact of bias due to systematically under- or over-reporting energy intake, the ICC were estimated before and after adjustment for total energy intake using the nutrient residuals method (where residuals from a regression of energy on the nutrient of interest are used when calculating reproducibility in order to determine the variation in nutrient intake due only to the composition of the diet)(Reference Willett and Willett29). Participants were excluded from analyses if they reported implausible values of total energy intake that were approximately >99 % of the sex-specific distribution (>20 000 kJ for men and >18 000 kJ for women; approximately 700 participants from each cycle). A minimum threshold of energy intake was not imposed since participants could have had a special dietary restriction prior to their 24-h dietary assessment.

Reproducibility was calculated using the 24-h dietary assessment separately for subgroups classified by season, age group, socio-economic group, BMI and if collected on weekdays or weekends. Ignoring the first cycle of the 24-h dietary assessment, which was administered over a 17-month period in the assessment centre, seasonality was analysed by comparing measurements from the online cycles 2–5 as these were each recorded over 3-month periods corresponding to different seasons. Cycle 2 was recorded in winter (February–April 2011), cycle 3 in summer (June–August 2011), cycle 4 in autumn (October–December 2011), and cycle 5 in spring (April–June 2012). Age at the first 24-h dietary assessment was classified into 5-year age bands (<45, 45–49, 50–54, 55–59, 60–64, 65+ years); and socio-economic group (assessed by the Townsend index of deprivation based on the participant's postcode at recruitment) was classified into quintiles(Reference Townsend, Phillimore and Beattie30). BMI at recruitment was classified according to WHO standard categories (<18·5 kg/m2, underweight; 18·5–24·9 kg/m2, normal weight; 25–29·9 kg/m2, overweight; 30–34·9 kg/m2, obese class I; 35 kg/m2 +, obese class II/III). Analyses of day of the week compared assessments recorded concordantly on weekdays (Monday–Friday) or weekends (Saturday/Sunday), with those recorded discordantly on both. All analyses were stratified by sex, and overall estimates were calculated as an inverse-variance weighted average of the sex-specific estimates.

In addition to comparing estimates of reproducibility for food group intake measured on the 24-h assessment and short FFQ, correlation coefficients between the FFQ and 24-h dietary assessment were estimated to compare the rankings of usual food group consumption. This was done using a method that deattenuated the coefficients for random error in the 24-h dietary assessments (by accounting for the ICC of the variable number of 24-h assessments) in the subset of those completing at least two 24-h dietary assessments(Reference Willett and Willett7,Reference Chavarro, Rosner and Sampson31) . All analyses were conducted using Stata version 13(32).

Ethics

Research in the UK Biobank study was conducted according to the Declaration of Helsinki, and was approved by the North West Multi-Centre Research Ethics Committee (reference number 06/MRE08/65). During the touchscreen assessment at baseline, all participants provided informed consent to participate in the UK Biobank and be followed up, using a signature capture device.

Results

Population characteristics and intake of macronutrients

Selected baseline characteristics of the study participants completing at least one 24-h dietary assessment and those in the overall UK Biobank study population are shown in Table 1. Similar to the overall cohort, participants who completed a 24-h dietary assessment had a mean age of 56 (sd 8) years, 55 % were women, 96 % reported having White British ancestry and 21·3 % were in the most affluent quintile of the Townsend index. BMI and blood pressure were also similar in both groups, but the participants who completed the 24-h assessment were more likely to have a university degree (43 v. 33 %) and less likely to be current smokers (8 v. 11 %) compared with those in the overall cohort.

Table 1. Selected characteristics of all UK Biobank participants and the subset who completed at least one 24-h dietary assessment*

(Numbers of participants and percentages; mean values and standard deviations)

* Number missing: Townsend index (overall n 627, 0·1 %; 24-h n 265, 0·1 %), exercise (overall n 12 227, 2·4 %; 24-h n 2083, 0·9 %), BMI (overall n 3106, 0·6 %; 24-h n 597, 0·3 %), systolic blood pressure (overall n 30135, 6·0 %; 24-h n 7845, 3·7 %).

The five cycles of the 24-h dietary assessment were recorded at intervals over a 28-month period (mean interval 5·9 (sd 2·0) months), and the absolute mean intake of macronutrients was similar across different cycles for both sexes (Supplementary Table S1). Although men consumed higher absolute amounts of energy and of each macronutrient than women, both sexes consumed similar proportions (% from energy) of macronutrients (Table 2).

Table 2. Dietary intake of macronutrients assessed by 24-h dietary assessment in the UK Biobank

(Mean values and standard deviations)

* For any participant with >1 measurement, the average over all 24-h cycles has been used.

Fibre % energy is calculated as fibre density (g/MJ).

Reproducibility of macronutrient intake

The reproducibility of single 24-h dietary assessment was modest, with ICC ranging from 0·23 for polyunsaturated fat to 0·46 for sugars (Table 3). As expected, the estimates of reproducibility were higher when the means of two cycles of 24-h assessments were compared; for most macronutrients reproducibility estimates were moderate and varied between 0·50 and 0·60 (range 0·36 for polyunsaturated fat to 0·63 for alcohol).

Table 3. Intra-class correlations of dietary intake of macronutrients estimated using single 24-h assessments and the average of two 24-h assessments, by sex*

* Cycle (1 + 2) v. (3 + 4) intra-class correlations are computed from means of cycles 1 and 2, correlated with means of cycles 3 and 4.

Reproducibility was typically slightly higher in men than in women, and in participants aged ≥65 years than in younger participants, but did not vary substantially by season, day of the week, age, or index of deprivation. The reproducibility was also unaltered by adjustment for total energy intake so the nutrient residuals method is reported in the Supplement, and the main results present the unadjusted estimates (Supplementary Tables S2–S4). The only exception was alcohol intake where reproducibility was greater if both measurements were recorded at weekends rather than on weekdays (for example, 0·60 v. 0·47 for men). The reproducibility for alcohol also increased with age (for example, from 0·38 in men <45 years to 0·52 in those aged ≥65 years). Participants who were underweight reported the highest reproducibility for macronutrient intake, with small differences seen across other groups categorised by BMI (Supplementary Table S5).

Reproducibility of selected food groups and dietary patterns

The average dietary intake of food groups and dietary patterns from the short FFQ and 24-h assessments can be seen in Supplementary Table S6. Overall, the reproducibility of consumption of food groups assessed using a single 24-h dietary assessment was modest and varied between 0·10 (fish) to 0·52 (fruit) (Table 4). Reproducibility improved when comparing the means of two 24-h dietary assessments (range 0·18 for fish to 0·68 for fruit), but was still modest for several food groups like meat, cheese and fish. The reproducibility for food groups assessed using the short FFQ was generally higher, with most ICC around 0·60, although two food groups reported higher reproducibility on the 24-h assessments (bread/cereal and fruit). Comparisons of the intakes of food groups assessed using the short FFQ and the averages of all 24-h dietary assessments (if ≥2 cycles completed) demonstrated moderate agreement, with deattenuated correlation coefficients varying from 0·38 for vegetables to 0·63 for fruit.

Table 4. Intra-class correlations of food groups and dietary patterns in UK Biobank 24-h dietary assessment (n 211 050; ‘24-h’) and short FFQ (n 502 655; ‘FFQ’)*

* n is the maximum number of participants in each column, with each food group reporting <1 % missing.

FFQ1 v. 24-h is the deattenuated correlation coefficient between baseline FFQ measurements and mean intake on 24-h assessments for those with 2+ cycles.

Greater than median intake (servings/d) for vegetables, legumes, fruit, nuts, fish, wholegrains, ratio of monounsaturated to saturated fat; less than median intake for red and processed meat; and between 5 and 25 g/d for ethanol.

§ Reproducibility coefficients for the vegetarian dietary pattern are κ statistics.

Similar to estimates for food groups, the reproducibility of the Mediterranean dietary pattern was 0·45 when the means of two pairs of 24-h dietary assessments were compared. There was very good agreement when a vegetarian dietary pattern was reported using either the short FFQ or the 24-h dietary assessment (κ > 0·80).

As a sensitivity analysis, reproducibility was estimated after omitting participants reporting an ‘atypical’ diet in the previous 24 h, and the levels of reproducibility on 24-h dietary assessments improved by 0·03–0·04 for all types of dietary intake.

Discussion

The reproducibility of the self-completed 24-h dietary assessments and the short FFQ was assessed in the large prospective UK Biobank study. The reproducibility of dietary intake assessed using the mean of two 24-h dietary assessments was moderate and generally varied between 0·50 and 0·60 for macronutrients. However, the reproducibility estimates of selected food groups using the mean of two 24-h dietary assessments were variable, and generally lower (albeit not consistently) than estimates reported using the short FFQ. The reproducibility of the vegetarian dietary pattern was high irrespective of the type of dietary assessment, although the reproducibility of the Mediterranean dietary pattern was lower and comparable with those for food groups and macronutrients.

As expected, the reproducibility estimates of all measures of dietary intake assessed solely using a pair of single 24-h dietary assessment in the UK Biobank were generally modest (between 0·30 and 0·40) due to measurement error and the day-to-day variation in dietary intake, consistent with estimates from previous studies(Reference Baranowski and Willet28,Reference Stein, Shea and Basch33Reference Beaton, Milner and McGuire39) . While a single 24-h dietary assessment does not provide an adequate indication of usual long-term dietary intake for individuals, such measurements have still been used in some observational studies of diet and disease(Reference Siri-Tarino, Sun and Hu40), despite clear evidence from previous research that the means of several 24-h dietary assessments for individuals are required for reliable estimation of absolute values for usual intake of most macronutrients(Reference Baranowski and Willet28,Reference Nelson, Black and Morris41Reference Stote, Radecki and Moshfegh43) . In the present study, the reproducibility of intake of macronutrients using the mean of two 24-h dietary assessments was higher, and approximately comparable with those reported by FFQ widely used in previous studies of diet and disease, with reproducibility estimates of around 0·50–0·60(Reference Willet, Lenart and Willet5). This suggests that averaging measurements from at least two 24-h assessments may be similar to FFQ for capturing the consistency of dietary intake over longer periods of time. The reproducibility coefficients for the mean of two 24-h dietary assessments were similar to those for blood pressure and total cholesterol, which are typically in the range 0·60–0·70(Reference Willet, Lenart and Willet5,Reference Clarke, Shipley and Lewington6) . Hence, the mean of at least two 24-h dietary assessments in the UK Biobank have a similar magnitude of random measurement error or within-person variability and will be informative for analyses of associations with disease in observational studies. However, while methods used to correct for within-person random error are well established, the sources of error in dietary intake are likely to be more complex than for biochemical measurements, and validity studies with recovery or concentration biomarkers of dietary intake may be necessary to fully correct for such errors(Reference Bennett, Landry and Little8).

While the within-person variability in a single 24-h dietary assessment was substantial in the UK Biobank, it did not appear to vary by subgroups such as age, sex, season, day of the week or index of deprivation. However, previous studies addressing these potential sources of variation reported mixed findings(Reference Palaniappan, Cue and Payette34,Reference Stote, Radecki and Moshfegh43Reference Kipnis, Subar and Midthune47) . Previous studies have also reported that reproducibility of daily intake of food groups on 24-h assessments was generally lower than for macronutrients(Reference Willet, Lenart and Willet5,Reference Palaniappan, Cue and Payette34) . Similar findings were observed in the present study for some of the food groups, although certain foods that were eaten regularly on a daily basis, like fruit, were more reproducible on the 24-h assessments than most macronutrients. Estimates of reproducibility for intake of most food groups were also slightly higher in the short FFQ than in the 24-h assessments in this study. However, only a small number of food groups (n 6) were measured in both types of assessments and could be compared, and it would be expected that, for example, fish would be better captured with a FFQ than two 24-h assessments. Overall, agreement between the two types of dietary assessment was moderate, and consistent with findings of a previous report that suggested the short FFQ adequately discriminated between high and low intakes on the 24-h dietary assessment in the UK Biobank for selected food groups(Reference Bradbury, Young and Guo48). The level of agreement reported between dietary assessments used in this study was also comparable with estimates reported between traditional 24-h recalls and FFQ reported in previous studies(Reference Ocké, Bueno-de-Mesquita and Goddijn49Reference Bohlscheid-Thomas, Hoting and Boeing51), indicating that measurements of food group intake in the non-traditional UK Biobank dietary assessments are acceptable and suitable for use in prospective analyses. However, some of the level of agreement between the FFQ and 24-h assessment may be due to correlated errors, and since the dietary assessments in the UK Biobank have not yet been compared with objective measures of dietary intake such as recovery biomarkers, the validity of these assessments has not yet been established.

Reproducibility of a vegetarian dietary pattern was high if self-identified (24-h assessment) or if indicated by non-consumption of meat and fish in the short FFQ. While no other estimates of reproducibility of the Mediterranean diet could be found, previous research using FFQ to define multifaceted ‘prudent’ or ‘Western’ dietary patterns have reported reproducibility estimates around 0·70(Reference Hu, Rimm and Smith-Warner52). However, the estimate of reproducibility for the mean of two 24-h dietary assessments of the Mediterranean dietary pattern in this study was lower, and similar to the less reproducible macronutrients with an ICC of 0·45. Components of the Mediterranean diet, like nuts, fish or olive oil, may not be consumed frequently enough in the UK for a small number of 24-h dietary assessments to record reliably, which should be considered if researchers plan to assess associations of this dietary pattern with incident disease.

The findings in the present study indicating that the 24-h dietary assessments have acceptable reproducibility, provided at least two assessments are used, have important implications for analysis of UK Biobank dietary intake data. The UK Biobank is one of the largest studies with multiple 24-h dietary assessments, with over 78 000 participants completing at least three dietary assessments on different occasions. A recent analysis suggested that use of at least three 24-h dietary recalls had the best calibration with true intakes measured by recovery biomarkers when comparing serial measurements using FFQ and 24-h recalls(Reference Freedman, Midthune and Arab4). However, the strength of the associations between usual dietary intake and disease risk in observational studies like the UK Biobank will still be underestimated if uncorrected for within-person variability in dietary assessments. Correction for such random within-person error (but not systematic error, which is likely to be still present in dietary assessments) can be done, as in the present report, using reproducibility measurements from a sample of the original cohort and does not require a validation study with a ‘gold standard’(Reference Clarke, Shipley and Lewington6). The large size of the UK Biobank substudy is an additional strength as it allows reliable estimates of these correction factors(Reference Van Dam, Hunter and Willet27).

One strength of the 24-h dietary assessments used in the UK Biobank was that measurements were recorded using a web-based platform in a short period of time, with automatic coding of nutrients. This web-based platform limited the burden to participants and researchers (and hence improved the acceptability), and therefore permitted assessments to be administered to a large number of participants(Reference Galante, Adamska and Young13). However, the web-based format may discourage or prohibit certain types of participants from completing it, particularly participants with ill health or poor computer literacy(Reference Thompson, Dixit-Joshi and Potischman53Reference Kirkpatrick, Subar and Douglass55). Previous analyses of 24-h assessments in the UK Biobank reported that participants completing multiple assessments tended to be older and more educated, but that there were small differences by sex and deprivation(Reference Galante, Adamska and Young13). Furthermore, without the assistance of trained interviewers, participants may have omitted some food items and required assistance for portion sizes(Reference Baranowski and Willet28). Collectively, this may have increased the measurement error in the 24-h dietary assessments. However, studies indicated comparable results between a web-based 24-h dietary assessment method and an interviewer-administered 24-h dietary assessment completed on the same day(Reference Liu, Young and Crowe12,Reference Kirkpatrick, Subar and Douglass55) . The web-based 24-h dietary assessment also suffers from the standard measurement issues common to many dietary assessments, all of which may have had an impact on reproducibility, such as incomplete information on ingredients in composite dishes, discrepancies in how participants reported portion sizes, and general issues with memory recall(Reference Baranowski and Willet28). Since 24-h dietary assessments in the UK Biobank differed from standard ‘24-h recalls’ that are commonly used in nutritional epidemiology, some foods may have been missed, as only 206 foods and 32 beverages were surveyed. However, total energy intake as computed from the 24-h assessments was not notably low, suggesting that few important foods were missed.

While the mean of two 24-h dietary assessments in the UK Biobank had acceptable reproducibility, this could still lead to underestimation of the strength of associations with disease by up to 50 % (as correction factors from the ICC are still around 0·50–0·60). Previous reports on the recommended methods to correct for measurement error by Willett(Reference Willett and Willett7) and Bennett et al.(Reference Bennett, Landry and Little8) include several approaches for minimising the effects of regression dilution bias that can arise from both measurement error and within-person variability assessed in the present study. Therefore, it is important that analyses of diet−disease relationships take account of both measurement error and within-person variability as diet may be an even more important determinant of chronic disease risk than has previously been realised.

Acknowledgements

This research has been conducted using the UK Biobank Resource under application number 13055.

This work was supported by core grants to CTSU (Clinical Trial Service Unit) from the Medical Research Council (J. L. C., S. L. and R. C., Clinical Trial Service Unit A310) and the British Heart Foundation (J. C., S. L. and R. C., CH/1996001/9454). Funding was received from the National Institute for Health Research (NIHR) Collaboration for Leadership in Applied Health Research (S. A. J. and C. P.) and Care Oxford at Oxford Health NHS Foundation Trust (S. A. J. and C. P.). The views expressed are those of the authors and not necessarily those of the NHS, the NIHR or the Department of Health. The funders had no role in the design, analysis or writing of this article.

J. L. C. designed and conducted all the analyses, and was responsible for preparing the initial draft report. S. L., C. P. S., K. B., T. J. K., S. A. J., M. A., D. B. and R. C. all contributed to the design of the analysis, interpretation of data and results. All authors also suggested revisions to the draft report, and approved the final manuscript prior to submission for publication.

There are no conflicts of interest.

Supplementary material

The supplementary material for this article can be found at https://doi.org/10.1017/jns.2019.31

References

1.Newton, JN, Briggs, ADM, Murray, CJL, et al. (2015) Changes in health in England, with analysis by English regions and areas of deprivation, 1990–2013: a systematic analysis for the Global Burden of Disease Study 2013. Lancet 386, 22572274.Google Scholar
2.Forouzanfar, MH, Alexander, L, Anderson, HR, et al. (2015) Global, regional, and national comparative risk assessment of 79 behavioural, environmental and occupational, and metabolic risks or clusters of risks in 188 countries, 1990–2013: a systematic analysis for the Global Burden of Disease Study 2013. Lancet 386, 22872323.Google Scholar
3.Trepanowski, JF & Ioannidis, JP (2018) Perspective: limiting dependence on nonrandomized studies and improving randomized trials in human nutrition research: why and how. Adv Nutr 9, 367377.Google Scholar
4.Freedman, LS, Midthune, D, Arab, L, et al. (2018) Combining a food frequency questionnaire with 24-hour recalls to increase the precision of estimating usual dietary intakes – evidence from the Validation Studies Pooling Project. Am J Epidemiol 187, 22272232.Google Scholar
5.Willet, W & Lenart, E (2013) Reproducibility and validity of food frequency questionnaires. In Nutritional Epidemiology, Monographs in Epidemiology and Biostatistics, 3rd ed., vol. 40, pp. 96141 [Willet, W, editor]. New York: Oxford University Press.Google Scholar
6.Clarke, R, Shipley, M, Lewington, S, et al. (1999) Underestimation of risk associations due to regression dilution in long-term follow-up of prospective studies. Am J Epidemiol 150, 341353.Google Scholar
7.Willett, W (2013) Correction for the effects of measurement error. In Nutritional Epidemiology, Monographs in Epidemiology and Biostatistics, 3rd ed., vol. 40, pp. 287304 [Willett, W, editor]. New York: Oxford University Press.Google Scholar
8.Bennett, DA, Landry, D, Little, J, et al. (2017) Systematic review of statistical approaches to quantify, or correct for, measurement error in a continuous exposure in nutritional epidemiology. BMC Med Res Methodol 17, 146.Google Scholar
9.Allen, N, Sudlow, C, Downey, P, et al. (2012) UK Biobank: current status and what it means for epidemiology. Health Policy Technol 1, 123126.Google Scholar
10.UK Biobank (2007) UK Biobank: protocol for a large-scale prospective epidemiological resource. http://www.ukbiobank.ac.uk/resources/ (accessed July 2016).Google Scholar
11.Davey, GK, Spencer, EA, Appleby, PN, et al. (2003) EPIC–Oxford: lifestyle characteristics and nutrient intakes in a cohort of 33 883 meat-eaters and 31 546 non meat-eaters in the UK. Public Health Nutr 6, 259268.Google Scholar
12.Liu, B, Young, H, Crowe, FL, et al. (2011) Development and evaluation of the Oxford WebQ, a low-cost, web-based method for assessment of previous 24 h dietary intakes in large-scale prospective studies. Public Health Nutr 14, 19982005.Google Scholar
13.Galante, J, Adamska, L, Young, A, et al. (2015) The acceptability of repeat Internet-based hybrid diet assessment of previous 24-h dietary intake: administration of the Oxford WebQ in UK Biobank. Br J Nutr 115, 681686.Google Scholar
14.Holland, B, Welch, A, Unwin, I, et al. (1991) McCance and Widdowson's The Composition of Foods. Cambridge, UK: Royal Society of Chemistry, and Ministry of Agriculture, Fisheries and Food.Google Scholar
15.Holland, B, Unwin, I & Buss, D (1988) Cereals and Cereal Products. Third Supplement to McCance and Widdowson's The Composition of Foods, 4th ed. Royal Society of Chemistry, and Ministry of Agriculture, Fisheries and Food. London: HMSO.Google Scholar
16.Holland, B, Brown, J & Buss, D (1993) Fish and Fish Products. Third Supplement to McCance and Widdowson's The Composition of Foods, 5th ed. Royal Society of Chemistry, and Ministry of Agriculture, Fisheries and Food. London: HMSO.Google Scholar
17.Holland, B, Unwin, ID & Buss, DH (1992) Fruit and Nuts. First Supplement to McCance and Widdowson's The Composition of Foods, 5th ed. Royal Society of Chemistry and Ministry of Agriculture, Fisheries and Food. London: HMSO.Google Scholar
18.Chan, W, Brown, J, Lee, SM, et al. (1995) Meat, Poultry and Game. Fifth Supplement to McCance and Widdowson's The Composition of Foods, 5th ed. Royal Society of Chemistry and Ministry of Agriculture, Fisheries and Food. London: HMSO.Google Scholar
19.Chan, W, Brown, J, Church, S, et al. (1996) Meat Products and Dishes. Sixth Supplement to McCance and Widdowson's The Composition of Foods, 5th ed. Royal Society of Chemistry and Ministry of Agriculture, Fisheries and Food. London: HMSO.Google Scholar
20.Holland, B, Unwin, I & Buss, D (1989) Milk Products and Eggs. Fourth Supplement to McCance and Widdowson's The Composition of Foods, 4th ed. Royal Society of Chemistry, and Ministry of Agriculture, Fisheries and Food. London: HMSO.Google Scholar
21.Chan, W, Brown, J & Buss, D (1994) Miscellaneous Foods. Fourth Supplement to McCance and Widdowson's The Composition of Foods. Royal Society of Chemistry and the Ministry of Agriculture, Fisheries and Food. London: HMSO.Google Scholar
22.Holland, B, Welch, AA & Buss, DH (1996) Vegetable Dishes. Second Supplement to McCance and Widdowson's The Composition of Foods, 5th ed. Royal Society of Chemistry and Ministry of Agriculture, Fisheries and Food. London: HMSO.Google Scholar
23.Holland, B, Unwin, I & Buss, D (1991) Vegetables, Herbs and Spices. Fifth Supplement to McCance and Widdowson's The Composition of Foods. Royal Society of Chemistry and Ministry of Agriculture, Fisheries and Food. London: HMSO.Google Scholar
24.Crawley, H (1993) Food Portion Sizes, 2nd ed. Ministry of Agriculture, Fisheries and Food. London: HMSO.Google Scholar
25.Fung, TT, McCullough, ML, Newby, P, et al. (2005) Diet-quality scores and plasma concentrations of markers of inflammation and endothelial dysfunction. Am J Clin Nutr 82, 163173.Google Scholar
26.Liese, AD, Krebs-Smith, SM, Subar, AF, et al. (2015) The Dietary Patterns Methods Project: synthesis of findings across cohorts and relevance to dietary guidance. J Nutr 145, 393402.Google Scholar
27.Van Dam, R & Hunter, D (2012) Biochemical indicators of dietary intake. In Nutritional Epidemiology, Monographs in Epidemiology and Biostatistics, vol. 3, pp. 150212 [Willet, W, editor]. New York: Oxford University Press.Google Scholar
28.Baranowski, T (2013) 24-h Recall and diet record methods. In Nutritional Epidemiology, Monographs in Epidemiology and Biostatistics, 3rd ed., vol. 40, pp. 4969 [Willet, W, editor]. New York: Oxford University Press.Google Scholar
29.Willett, W (2013) Implications of total energy intake for epidemiologic analyses. In Nutritional Epidemiology, Monographs in Epidemiology and Biostatistics, 3rd ed., vol. 40, pp. 260286 [Willett, W, editor]. New York: Oxford University Press.Google Scholar
30.Townsend, P, Phillimore, P & Beattie, A (1988) Health and Deprivation: Inequality and the North. London: Croom Helm.Google Scholar
31.Chavarro, JE, Rosner, BA, Sampson, L et al. (2009) Validity of adolescent diet recall 48 years later. Am J Epidemiol 170, 15631570.Google Scholar
32.StataCorp (2013) Stata Statistical Software: Release 13. College Station, TX: StataCorp LP.Google Scholar
33.Stein, AD, Shea, S, Basch, CE, et al. (1991) Variability and tracking of nutrient intakes of preschool children based on multiple administrations of the 24-hour dietary recall. Am J Epidemiol 134, 14271437.Google Scholar
34.Palaniappan, U, Cue, R, Payette, H, et al. (2003) Implications of day-to-day variability on measurements of usual food and nutrient intakes. J Nutr 133, 232235.Google Scholar
35.Rush, D & Kristal, AR (1982) Methodologic studies during pregnancy: the reliability of the 24-hour dietary recall. Am J Clin Nutr 35, 12591268.Google Scholar
36.Kubota, Y, Maruyama, K, Sato, S, et al. (2010) Reproducibility of 24-hour dietary recall for vitamin intakes by middle-aged Japanese men and women. J Nutr Health Aging 14, 196200.Google Scholar
37.Liu, T, Wilson, NP, Craig, CB, et al. (1992) Evaluation of three nutritional assessment methods in a group of women. Epidemiology 3, 496502.Google Scholar
38.Yuan, C, Spiegelman, D, Rimm, EB, et al. (2017) Validity of a dietary questionnaire assessed by comparison with multiple weighed dietary records or 24-hour recalls. Am J Epidemiol 185, 570584.Google Scholar
39.Beaton, GH, Milner, J, McGuire, V, et al. (1983) Source of variance in 24-hour dietary recall data: implications for nutrition study design and interpretation. Carbohydrate sources, vitamins, and minerals. Am J Clin Nutr 37, 986995.Google Scholar
40.Siri-Tarino, PW, Sun, Q, Hu, FB, et al. (2010) Meta-analysis of prospective cohort studies evaluating the association of saturated fat with cardiovascular disease. Am J Clin Nutr 91, 535546.Google Scholar
41.Nelson, M, Black, AE, Morris, JA, et al. (1989) Between- and within-subject variation in nutrient intake from infancy to old age: estimating the number of days required to rank dietary intakes with desired precision. Am J Clin Nutr 50, 155167.Google Scholar
42.Sempos, CT, Liu, K & Ernst, ND (1999) Food and nutrient exposures: what to consider when evaluating epidemiologic evidence. Am J Clin Nutr 69, 1330s1338s.Google Scholar
43.Stote, KS, Radecki, SV, Moshfegh, AJ, et al. (2011) The number of 24 h dietary recalls using the US Department of Agriculture's automated multiple-pass method required to estimate nutrient intake in overweight and obese adults. Public Health Nutr 14, 17361742.Google Scholar
44.Sempos, CT, Johnson, NE, Smith, EL, et al. (1985) Effects of intraindividual and interindividual variation in repeated dietary records. Am J Epidemiol 121, 120130.Google Scholar
45.Van Staveren, WA, Deurenberg, P, Burema, J, et al. (1985) Seasonal variation in food intake, pattern of physical activity and change in body weight in a group of young adult Dutch women consuming self-selected diets. Int J Obes 10, 133145.Google Scholar
46.Beaton, GH (1994) Approaches to analysis of dietary data: relationship between planned analyses and choice of methodology. Am J Clin Nutr 59, 253S261S.Google Scholar
47.Kipnis, V, Subar, AF, Midthune, D, et al. (2003) Structure of dietary measurement error: results of the OPEN biomarker study. Am J Epidemiol 158, 1421; discussion 22–26.Google Scholar
48.Bradbury, KE, Young, H, Guo, W, et al. (2017) Dietary assessment in UK Biobank: an evaluation of the performance of the touchscreen dietary questionnaire. J Nutr Sci 7, e6.Google Scholar
49.Ocké, MC, Bueno-de-Mesquita, HB, Goddijn, HE, et al. (1997) The Dutch EPIC food frequency questionnaire. I. Description of the questionnaire, and relative validity and reproducibility for food groups. Int J Epidemiol 26, S37S48.Google Scholar
50.Kaaks, R, Slimani, N & Riboli, E (1997) Pilot phase studies on the accuracy of dietary intake measurements in the EPIC project: overall evaluation of results. Int J Epidemiol 26, S26S36.Google Scholar
51.Bohlscheid-Thomas, S, Hoting, I, Boeing, H, et al. (1997) Reproducibility and relative validity of food group intake in a food frequency questionnaire developed for the German part of the EPIC project. Int J Epidemiol 26, S59S70.Google Scholar
52.Hu, FB, Rimm, E, Smith-Warner, SA, et al. (1999) Reproducibility and validity of dietary patterns assessed with a food-frequency questionnaire. Am J Clin Nutr 69, 243249.Google Scholar
53.Thompson, FE, Dixit-Joshi, S, Potischman, N, et al. (2015) Comparison of interviewer-administered and automated self-administered 24-hour dietary recalls in 3 diverse integrated health systems. Am J Epidemiol 181, 970978.Google Scholar
54.Tabacchi, G, Amodio, E, Di Pasquale, M, et al. (2014) Validation and reproducibility of dietary assessment methods in adolescents: a systematic literature review. Public Health Nutr 17, 27002714.Google Scholar
55.Kirkpatrick, SI, Subar, AF, Douglass, D, et al. (2014) Performance of the automated self-administered 24-hour recall relative to a measure of true intakes and to an interviewer-administered 24-h recall. Am J Clin Nutr 100, 233240.Google Scholar
Figure 0

Fig. 1. Timeline of UK Biobank dietary assessment measurement 2006–2015, including the 24-h dietary assessment (24-h) and the short FFQ.

Figure 1

Table 1. Selected characteristics of all UK Biobank participants and the subset who completed at least one 24-h dietary assessment*(Numbers of participants and percentages; mean values and standard deviations)

Figure 2

Table 2. Dietary intake of macronutrients assessed by 24-h dietary assessment in the UK Biobank(Mean values and standard deviations)

Figure 3

Table 3. Intra-class correlations of dietary intake of macronutrients estimated using single 24-h assessments and the average of two 24-h assessments, by sex*

Figure 4

Table 4. Intra-class correlations of food groups and dietary patterns in UK Biobank 24-h dietary assessment (n 211 050; ‘24-h’) and short FFQ (n 502 655; ‘FFQ’)*

Supplementary material: File

Carter et al. supplementary material

Carter et al. supplementary material

Download Carter et al. supplementary material(File)
File 467.5 KB