Hostname: page-component-8448b6f56d-wq2xx Total loading time: 0 Render date: 2024-04-19T03:34:48.471Z Has data issue: false hasContentIssue false

Machine learning can improve the development of evidence-based dietary guidelines

Published online by Cambridge University Press:  27 June 2022

Lisa M Bodnar*
Affiliation:
Department of Epidemiology, School of Public Health, University of Pittsburgh, 5128 Public Health, 130 DeSoto St, Pittsburgh, PA 15261, USA Department of Obstetrics, Gynecology, and Reproductive Sciences, School of Medicine, University of Pittsburgh, Pittsburgh, PA, USA
Sharon I Kirkpatrick
Affiliation:
School of Public Health and Health Systems, University of Waterloo, Waterloo, ON, Canada
Ashley I Naimi
Affiliation:
Department of Epidemiology, Rollins School of Public Health, Emory University, Atlanta, GA, USA
*
*Corresponding author: Email 15261lbodnar@pitt.edu
Rights & Permissions [Opens in a new window]

Abstract

Type
Commentary
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution, and reproduction in any medium, provided the original work is properly cited.
Copyright
© The Author(s), 2022. Published by Cambridge University Press on behalf of The Nutrition Society

The Dietary Guidelines for Americans provide dietary advice for health promotion and disease prevention and serve as the cornerstone to all other US Federal nutrition policy and education efforts(1). Defining what populations should eat to optimise health is challenging, however, owing to the complexity of the diet. A recent report by the National Academies of Science, Engineering, and Medicine(2) recommended approaches to improve the process of establishing the Dietary Guidelines to account for this complexity, including a call for more advanced analytic techniques for analysing existing dietary data. In this commentary, we highlight several analytic challenges in nutrition and how they can be addressed using a machine learning, a set of flexible algorithms and methods to model complex relations in data.

It is well recognised that foods are eaten in complex combinations with potential antagonistic and synergistic interactions that may impact long-term health(Reference Jacobs and Tapsell3,Reference Hu4) . Some research has captured this complexity by testing whole-diet interventions, such as those rich in vegetables, fruits, whole grains, fish, nuts and beans in the DASH (Dietary Approaches to Stop Hypertension) trial(Reference de Lorgeril, Renaud and Mamelle5Reference Harsha, Lin and Obarzanek7). Whole-diet interventions have suggested that the most relevant exposure is the totality of the diet(Reference Jacobs and Tapsell3), typically conceptualised as a multidimensional and dynamic construct referred to as ‘dietary patterns’(Reference Reedy, Subar and George8). Dietary patterns constitute the consumption of an array of foods and beverages in different amounts and combinations. The 2010 version of the Dietary Guidelines for Americans recognised the importance of dietary patterns(9), and its emphasis has remained in each subsequent edition(10,11) .

Unfortunately, high-quality randomised trials of whole-diet interventions are much more difficult to conduct than dietary supplement interventions(Reference Hebert, Frongillo and Adams12). Challenges include their sheer complexity, identifying suitable comparators, blinding participants and allocators, and numerous complications involving potential non-adherence to the intervention protocols(Reference Afshin, Sur and Fay13). As a result, observational studies of dietary patterns and disease risk form a majority of the evidence base for dietary recommendations(1). Consequently, the validity of inferences drawn from observational data is critical for informing evidence-based dietary guidelines. Researchers in nutritional epidemiology tend to focus on improving validity primarily by addressing problems with dietary measurement error(Reference Freedman, Schatzkin and Midthune14,Reference Bennett, Landry and Little15) . Yet, despite urging from nutrition experts(Reference Reedy, Subar and George8), less research has focused on reducing other potential biases and problems with interpretability that can arise when using conventional methods for analysing nutritional epidemiologic data.

Converting complex dietary patterns into quantitative, interpretable summaries is difficult

Nutrition researchers have predominantly used two methods for summarising diet patterns as primary exposures: a posteriori (data-driven) methods like cluster or factor analysis and a priori (researcher-driven) methods like diet indexes(Reference Reedy, Subar and George8,Reference Krebs-Smith, Subar and Reedy16,Reference Ocké17) . Cluster analysis seeks to identify groups of people with similar diets. However, clustering algorithms cannot measure how well the algorithm fits the data on the basis of measured outcomes. As a result, there is often a large degree of unrecognised uncertainty with respect to the quality of a given clustering analysis(Reference von Luxburg18). Factor and principle component analyses identify constructs that explain variability according to food groups, but results from such analyses in nutrition are often erroneously interpreted as causal effects(Reference Shmueli19). Unfortunately, translating the first principle component of a combination dietary factors into a meaningful quantity that can be used to evaluate the causal effect of a diet pattern is not straightforward(Reference Bakolis, Burney and Hooper20). Further, questions have been raised about the performance of these techniques for identifying actionable information about the effects of diet on health(Reference Bakolis, Burney and Hooper20).

Diet indexes measure adherence to a set of diet recommendations defined a priori. The Healthy Eating Index-2015 (HEI-2015) is used to evaluate adherence to the 2015–2020 Dietary Guidelines for Americans(Reference Krebs-Smith, Pannucci and Subar21) (an updated version of the HEI aligning with the 2020–2025 Dietary Guidelines has not yet been released). Like other diet indexes (e.g. the Alternative Health Eating Index, the Mediterranean Diet Score index, DASH score(Reference McCullough and Willett22Reference Fung, Chiuve and McCullough24)), the HEI-2015 score includes many dietary components, and the total is derived by summing the scores for each individual component, which are truncated at a maximum value. Although diet indexes consider multiple aspects of the diet, the richness of dietary data is reduced into a score. Further, the scoring is defined subjectively without regard to the components’ relation to a heath outcome.

Indeed, the last three editions of the Dietary Guidelines for Americans have recommended a dietary pattern with a variety of vegetables, whole fruits, low-fat or fat free dairy, a variety of protein foods and oils, and limited in added sugars, saturated fats, Na and moderate alcohol(911). The HEI-2015 scoring reflects the equal emphasis of these elements of a healthy diet recommended in the 2015–2020 Dietary Guidelines, whereby each of the thirteen components is given a maximum score of 10(Reference Krebs-Smith, Pannucci and Subar21). The Guidelines and the HEI imply that each component of the diet has equal importance to health (adequate fruit is as important as adequate dairy). Yet, studies have not provided an empirical basis for the weighting of the Dietary Guidelines or HEI-2015 score. Analytic approaches that generate weights of each nutritional component for reducing risk of adverse health outcomes are essential for ensuring systematic, objective results.

Methods typically used in diet patterns research do not formally account for synergy in the diet

Results from laboratory studies have shown that foods eaten in combinations have synergistic effects on some markers of disease risk(Reference Zafra-Stone, Yasmin and Bagchi25Reference Wang, Meckling and Marcone27), but exploring or accounting for synergy on a wide range of health outcomes in nutritional epidemiology has been limited. While the aforementioned methods for summarising dietary patterns attempt to account for the multidimensionality of diet with a focus on dietary patterns rather than specific foods or nutrients, they do not necessarily account for potential synergistic effects among dietary components.

The presence of such heterogeneity among dietary components has at least two important consequences. First, even when such synergy is not of primary scientific interest, models used to quantify the relation between diet and health outcomes must account for this heterogeneity to avoid potential bias due to the misspecification of variables in the model(Reference Yang, Yang and Zhou28Reference Garcia-Magarinos, Lopez-de-Ullibarri and Cao30). Second, the Dietary Guidelines recommend a diet pattern for the general population, with some differences according to age or life stage(10). These population-level guidelines do not account for the potential for complex varying causal effects of diet patterns in the population, as highlighted by the aforementioned National Academies of Science, Engineering, and Medicine report(2). Evaluating heterogeneity (e.g. synergy, interaction or effect modification) in the causal effects of dietary patterns on health outcomes can enable researchers to target interventions to populations with the greatest likelihood to benefit(Reference Foster, Taylor and Ruberg31). Notably, deepening our understanding of the role that dietary synergy can play in improving health outcomes extends beyond observational studies. The complexity of randomised trials to estimate the effects of dietary interventions, and the plethora of data usually collected in the context of dietary trials, provides tremendous opportunity to advance this aspect of nutrition.

Nevertheless, it is nearly impossible with conventional parametric methods to correctly code statistical interactions among dietary components in a regression model in order to avoid misspecification bias and correctly capture heterogeneity in the population. This is due to the dearth of knowledge of dietary synergy on outcomes of interest and the vast number of possible interactive associations in the diet.

Machine learning methods can help establish evidence-based dietary guidelines

One approach to address the difficulties faced when converting complex dietary patterns into quantitative, interpretable summaries is unsupervised learning, which uses machine learning algorithms to identify clusters of individuals that share unique dietary patterns. Algorithms include k-means(Reference James, Witten and Hastie32), k-medoids(Reference Hastie, Tibshirani and Friedman33), hierarchical or density-based clustering algorithms(Reference Rachka and Liu34), which can be used to evaluate patterns in diet shared across individuals in a sample. While they can sometimes suffer from stability problems(Reference von Luxburg18), these algorithms have the potential to aid nutrition researchers in better understanding how data can be used to define or inform dietary patterns causally related to health outcomes, as well as how these components should be weighted relative to one another.

Additionally, machine learning can mitigate other problems, such as underlying heterogeneity in associations of interest. For instance, researchers may be interested in the confounder adjusted causal effect of a diet pattern on the risk of adverse health outcomes. To quantify this risk contrast, one would typically adjust for several variables, including other dietary components, in a logistic regression or other parametric regression model. Misspecification bias will result if this association varies among people depending on factors like their fruit intake, their intake of added sugars or their smoking status. One machine learning approach to avoid this bias by accounting for heterogeneity is called stacked generalisation(Reference Naimi and Balzer35), which combines several machine learning algorithms into one. These algorithms can include standard regression models (i.e. generalised linear models) along with other algorithms like random forests and gradient boosting, which may better address potential synergies(Reference Conzuelo Rodriguez, Bodnar and Brooks36). Results from this stacked generalisation can be used to obtain valid statistics for causal inference (P values, CI) using advanced analytic techniques(Reference Naimi, Mishler and Kennedy37).

Lastly, when researchers are specifically interested in evaluating the presence and magnitude of synergy among dietary components or population characteristics, several newer machine learning methods can be used to this end. For example, ‘causal forests’ can be used to quantify the extent to which a causal effect of interest (e.g. a diet pattern rich in vegetables on health outcomes(Reference Bodnar, Cartus and Kirkpatrick38)) differs across a host of other variables(Reference Athey and Wager39), even when the exact variables that lead to heterogeneity in the treatment effect are unknown. This machine learning approach uses random forests to find those variables that explain the largest degree of heterogeneity in the treatment effect of interest and can estimate the precise magnitude of these differences.

An important caveat to recognise is that questions about the impact of dietary synergy on health outcomes are fundamentally causal(Reference Hernan and Robins40). This requires that a set of conditions hold, such as counterfactual consistency, positivity, no interference and exchangeability (i.e. no information bias, selection bias and confounding bias). These conditions are not guaranteed in observational or randomised trial data, whether machine learning methods are used or not.

Understanding the complex synergies in dietary patterns, their impact on health outcomes and how we can use these to create interpretable measures of dietary patterns is critical for informing national nutrition guidance. Machine learning approaches hold substantial promise in enabling researchers better use the multidimensional nature of dietary data without heavy reliance on parametric assumptions. However, nutrition researchers should be aware of the limitations of machine learning methods, which include high bias, high mean squared error and less than nominal CI coverage when appropriate techniques are not employed(Reference Naimi, Mishler and Kennedy37,Reference Li, Rosete and Coyle41) . The challenges in implementing these approaches require nutrition scientists to collaborate with a multidisciplinary team of investigators to identify policy-relevant research questions, appropriate datasets for this work and the techniques needed to address challenges when implementing machine learning. Teams should carefully consider applications of machine learning to their work on dietary patterns so as to ensure possible limitations have been mitigated and their implications for the findings fully recognised.

Acknowledgements

Acknowledgements:

None.

Financial support:

This work was supported by grant funding from the Eunice Kennedy Shriver National Institute of Child Health and Human Development (NICHD): R01 HD102313 to L.M.B. and A.I.N.

Conflict of interest:

There is no conflicts of interest.

Authorship:

L.M.B., S.I.K. and A.I.N. conceptualised the topic, L.M.B. drafted the manuscript and S.I.K. and A.I.N. reviewed and provided critical feedback. All authors approved the final version of the manuscript.

Ethics of human subject participation:

Not applicable.

References

Dietary Guidelines Advisory Committee (2020) Scientific Report of the 2020 Dietary Guidelines Advisory Committee: Advisory Report to the Secretary of Agriculture and the Secretary of Health and Human Services. Washington, DC: Dietary Guidelines Advisory Committee.Google Scholar
National Academies of Sciences E & Medicine (2017) Redesigning the Process for Establishing the Dietary Guidelines for Americans. Washington, DC: The National Academies Press.Google Scholar
Jacobs, DR & Tapsell, LC (2007) Food, not nutrients, is the fundamental unit in nutrition. Nutr Rev 65, 439450.Google Scholar
Hu, FB (2002) Dietary pattern analysis: a new direction in nutritional epidemiology. Curr Opin Lipidol 13, 39.CrossRefGoogle ScholarPubMed
de Lorgeril, M, Renaud, S, Mamelle, N et al. (1994) Mediterranean alpha-linolenic acid-rich diet in secondary prevention of coronary heart disease. Lancet 343, 14541459.CrossRefGoogle ScholarPubMed
Martinez-Gonzalez, MA, Corella, D, Salas-Salvado, J et al. (2012) Cohort profile: design and methods of the PREDIMED study. Int J Epidemiol 41, 377385.CrossRefGoogle ScholarPubMed
Harsha, DW, Lin, PH, Obarzanek, E et al. (1999) Dietary Approaches to Stop Hypertension: a summary of study results. DASH Collaborative Research Group. J Am Diet Assoc 99, S35S39.CrossRefGoogle ScholarPubMed
Reedy, J, Subar, AF, George, SM et al. (2018) Extending methods in dietary patterns research. Nutrients 10, 571.CrossRefGoogle ScholarPubMed
Dietary Guidelines Advisory Committee (2010) Report of the Dietary Guidelines Advisory Committee on the Dietary Guidelines for Americans, 2010, to the Secretary of Agriculture and the Secretary of Health and Human Services. Washington, DC: Dietary Guidelines Advisory Committee.Google Scholar
US Department of Agriculture & US Department of Health and Human Services (2020) Dietary Guidelines for Americans, 2020–2025. 9th Edition. https://www.dietaryguidelines.gov (accessed February 2022).Google Scholar
US Department of Health and Human Services & US Department of Agriculture (2015) 2015–2020 Dietary Guidelines for Americans. 8th Edition. http://health.gov/dietaryguidelines/2015/guidelines/ (accessed March 2022).Google Scholar
Hebert, JR, Frongillo, EA, Adams, SA et al. (2016) Perspective: randomized controlled trials are not a Panacea for diet-related research. Adv Nutr 7, 423432.CrossRefGoogle Scholar
Afshin, A, Sur, PJ, Fay, KA et al. (2019) Health effects of dietary risks in 195 countries, 1990–2017: a systematic analysis for the Global Burden of Disease Study 2017. Lancet 393, 19581972.CrossRefGoogle Scholar
Freedman, LS, Schatzkin, A, Midthune, D et al. (2011) Dealing with dietary measurement error in nutritional cohort studies. J Natl Cancer Inst 103, 10861092.CrossRefGoogle ScholarPubMed
Bennett, DA, Landry, D, Little, J et al. (2017) Systematic review of statistical approaches to quantify, or correct for, measurement error in a continuous exposure in nutritional epidemiology. BMC Med Res Methodol 17, 146.CrossRefGoogle ScholarPubMed
Krebs-Smith, SM, Subar, AF & Reedy, J (2015) Examining dietary patterns in relation to chronic disease: matching measures and methods to questions of interest. Circulation 132, 790793.CrossRefGoogle ScholarPubMed
Ocké, MC (2013) Evaluation of methodologies for assessing the overall diet: dietary quality scores and dietary pattern analysis. Proc Nutr Soc 72, 191199.CrossRefGoogle ScholarPubMed
von Luxburg, U (2010) Clustering stability: an overview. Foundations Trends® Mach Learn 2, 235274.Google Scholar
Shmueli, G (2010) To explain or to predict? Stat Sci 25, 289310.CrossRefGoogle Scholar
Bakolis, I, Burney, P & Hooper, R (2014) Principal components analysis of diet and alternatives for identifying the combination of foods that are associated with the risk of disease: a simulation study. Br J Nutr 112, 6169.CrossRefGoogle ScholarPubMed
Krebs-Smith, SM, Pannucci, TE, Subar, AF et al. (2018) Update of the Healthy Eating Index: HEI-2015. J Acad Nutr Diet 118, 15911602.CrossRefGoogle ScholarPubMed
McCullough, ML & Willett, WC (2006) Evaluating adherence to recommended diets in adults: the Alternate Healthy Eating Index. Public Health Nutr 9, 152157.CrossRefGoogle ScholarPubMed
Trichopoulou, A, Costacou, T, Bamia, C et al. (2003) Adherence to a Mediterranean diet and survival in a Greek population. N Engl J Med 348, 25992608.CrossRefGoogle Scholar
Fung, TT, Chiuve, SE, McCullough, ML et al. (2008) Adherence to a DASH-style diet and risk of CHD and stroke in women. Arch Intern Med 168, 713720.CrossRefGoogle ScholarPubMed
Zafra-Stone, S, Yasmin, T, Bagchi, M et al. (2007) Berry anthocyanins as novel antioxidants in human health and disease prevention. Mol Nutr Food Res 51, 675683.CrossRefGoogle ScholarPubMed
Canene-Adams, K, Lindshield, BL, Wang, S et al. (2007) Combinations of tomato and broccoli enhance antitumor activity in dunning r3327-h prostate adenocarcinomas. Cancer Res 67, 836843.CrossRefGoogle ScholarPubMed
Wang, S, Meckling, KA, Marcone, MF et al. (2011) Synergistic, additive, and antagonistic effects of food mixtures on total antioxidant capacities. J Agric Food Chem 59, 960968.CrossRefGoogle ScholarPubMed
Yang, PY, Yang, YH, Zhou, BB et al. (2010) A review of ensemble methods in bioinformatics. Curr Bioinform 5, 296308.CrossRefGoogle Scholar
Gromping, U (2009) Variable importance assessment in regression: linear regression v. random forest. Am Stat 63, 308319.CrossRefGoogle Scholar
Garcia-Magarinos, M, Lopez-de-Ullibarri, I, Cao, R et al. (2009) Evaluating the ability of tree-based methods and logistic regression for the detection of SNP-SNP interaction. Ann Hum Genet 73, 360369.CrossRefGoogle ScholarPubMed
Foster, JC, Taylor, JM & Ruberg, SJ (2011) Subgroup identification from randomized clinical trial data. Stat Med 30, 28672880.CrossRefGoogle ScholarPubMed
James, G, Witten, D, Hastie, T et al. (2013) An Introduction to Statistical Learning, 1st ed. New York: Springer.CrossRefGoogle Scholar
Hastie, T, Tibshirani, R & Friedman, JJH (2009) The Elements of Statistical Learning. New York: Springer.CrossRefGoogle Scholar
Rachka, S & Liu, Y (2022) Machine Learning with PyTorch and Scikit-Learn. Birmingham: Packt Publishing.Google Scholar
Naimi, AI & Balzer, LB (2018) Stacked generalization: an introduction to super learning. Eur J Epidemiol 33, 459464.CrossRefGoogle ScholarPubMed
Conzuelo Rodriguez, G, Bodnar, LM, Brooks, MM et al. (2022) Performance evaluation of parametric and nonparametric methods when assessing effect measure modification. Am J Epidemiol 191, 198207.CrossRefGoogle ScholarPubMed
Naimi, AI, Mishler, AE & Kennedy, EH (2021) Challenges in obtaining valid causal effect estimates with machine learning algorithms. Am J Epidemiol (In the Press).CrossRefGoogle ScholarPubMed
Bodnar, LM, Cartus, AR, Kirkpatrick, SI et al. (2020) Machine learning as a strategy to account for dietary synergy: an illustration based on dietary intake and adverse pregnancy outcomes. Am J Clin Nutr 111, 12351243.CrossRefGoogle ScholarPubMed
Athey, S & Wager, S (2019) Estimating treatment effects with causal forests: an application. Observational Studies 5, 3651.CrossRefGoogle Scholar
Hernan, MA & Robins, JM (2020) Causal Inference: What If. Boca Raton, FL: Chapman & Hall/CRC.Google Scholar
Li, H, Rosete, S, Coyle, J et al. (2022) Evaluating the robustness of targeted maximum likelihood estimators via realistic simulations in nutrition intervention trials. Stat Med 41, 21322165.CrossRefGoogle ScholarPubMed