Skip to main content Accessibility help

Using social media to assess the consumer nutrition environment: comparing Yelp reviews with a direct observation audit instrument for grocery stores

  • Ying Shen (a1), Philippa Clarke (a1) (a2), Iris N Gomez-Lopez (a2), Alex B Hill (a3), Daniel M Romero (a4), Robert Goodspeed (a5), Veronica J Berrocal (a6), VG Vinod Vydiswaran (a4) (a7) and Tiffany C Veinot (a4) (a8)...



To examine the feasibility of using social media to assess the consumer nutrition environment by comparing sentiment expressed in Yelp reviews with information obtained from a direct observation audit instrument for grocery stores.


Trained raters used the Nutrition Environment Measures Survey in Stores (NEMS-S) in 100 grocery stores from July 2015 to March 2016. Yelp reviews were available for sixty-nine of these stores and were retrieved in February 2017 using the Yelp Application Program Interface. A sentiment analysis was conducted to quantify the perceptions of the consumer nutrition environment in the review text. Pearson correlation coefficients (ρ) were used to compare NEMS-S scores with Yelp review text on food availability, quality, price and shopping experience.


Detroit, Michigan, USA.




Yelp reviews contained more comments about food availability and the overall shopping experience than food price and food quality. Negative sentiment about food prices in Yelp review text and the number of dollar signs on Yelp were positively correlated with observed food prices in stores (ρ=0·413 and 0·462, respectively). Stores with greater food availability were rated as more expensive on Yelp. Other aspects of the food store environment (e.g. overall quality and shopping experience) were captured only in Yelp.


While Yelp cannot replace in-person audits for collecting detailed information on the availability, quality and cost of specific food items, Yelp holds promise as a cost-effective means to gather information on the overall cost, quality and experience of food stores, which may be relevant for nutrition outcomes.


Corresponding author

*Corresponding author: Email


Hide All
1. Burns, C, Bentley, R, Thornton, L et al. (2015) Associations between the purchase of healthy and fast foods and restrictions to food access: a cross-sectional study in Melbourne, Australia. Public Health Nutr 18, 143150.
2. Caldwell, EM, Kobayashi, MM, DuBow, W et al. (2009) Perceived access to fruits and vegetables associated with increased consumption. Public Health Nutr 12, 17431750.
3. Morland, K, Roux, AVD & Wing, S (2006) Supermarkets, other food stores, and obesity: the atherosclerosis risk in communities study. Am J Prev Med 30, 333339.
4. Morland, K, Wing, S & Diez Roux, AV (2002) The contextual effect of the local food environment on residents’ diets. Am J Public Health 82, 17611767.
5. Booth, SL, Sallis, JF, Ritenbaugh, C et al. (2001) Environmental and societal factors affect food choice and physical activity: rationale, influences, and leverage points. Nutr Rev 59, 3 Pt 2, S21S39.
6. Liese, AD, Bell, BA, Barnes, TL et al. (2014) Environmental influences on fruit and vegetable intake: results from a path analytic model. Public Health Nutr 17, 25952604.
7. Morland, KB, Filomena, S, Granieri, E et al. (2017) Environmental disparities in the objectively and longitudinally measured local food environments of urban older adults. Med Res Arch 5, issue 7,
8. Berge, JM, MacLehose, RF, Larson, N et al. (2016) Family food preparation and its effects on adolescent dietary quality and eating patterns. J Adolesc Health 59, 530536.
9. Monsivais, P, Aggarwal, A & Drewnowski, A (2014) Time spent on home food preparation and indicators of healthy eating. Am J Prev Med 47, 796802.
10. Glanz, K, Sallis, JF, Saelens, BE et al. (2005) Healthy nutrition environments: concepts and measures. Am J Health Promot 19, 330333.
11. Barnes, TL, Bell, BA, Freedman, DA et al. (2015) Do people really know what food retailers exist in their neighborhood? Examining GIS-based and perceived presence of retail food outlets in an eight-county region of South Carolina. Spat Spatiotemporal Epidemiol 13, 3140.
12. Barnes, TL, Freedman, DA, Bell, BA et al. (2016) Geographic measures of retail food outlets and perceived availability of healthy foods in neighbourhoods. Public Health Nutr 19, 13681374.
13. Van Meter, E, Lawson, AB, Colabianchi, N et al. (2011) Spatial accessibility and availability measures and statistical properties in the food environment. Spat Spatiotemporal Epidemiol 2, 3547.
14. Wilkins, EL, Morris, MA, Radley, D et al. (2017) Using Geographic Information Systems to measure retail food environments: discussion of methodological considerations and a proposed reporting checklist (Geo-FERN). Health Place 44, 110117.
15. Chen, X (2017) Take the edge off: a hybrid geographic food access measure. Appl Geogr 87, 149159.
16. Ma, X, Liese, AD, Bell, BA et al. (2016) Perceived and geographic food access and food security status among households with children. Public Health Nutr 19, 27812788.
17. McKinnon, RA, Reedy, J, Morrissette, MA et al. (2009) Measures of the food environment: a compilation of the literature, 1990–2007. Am J Prev Med 36, 4 Suppl., S124S133.
18. Lytle, LA & Sokol, RL (2017) Measures of the food environment: a systematic review of the field, 2007–2015. Health Place 44, 1834.
19. Glanz, K, Sallis, JF, Saelens, BE et al. (2007) Nutrition Environment Measures Survey in stores (NEMS-S): development and evaluation. Am J Prev Med 32, 282289.
20. Moudon, AV, Drewnowski, A, Duncan, GE et al. (2013) Characterizing the food environment: pitfalls and future directions. Public Health Nutr 16, 12381243.
21. Gustafson, AA, Sharkey, J, Samuel-Hodge, CD et al. (2011) Perceived and objective measures of the food store environment and the association with weight and diet among low-income women in North Carolina. Public Health Nutr 14, 10321038.
22. Partington, SN, Menzies, TJ, Colburn, TA et al. (2015) Reduced-item food audits based on the Nutrition Environment Measures Surveys. Am J Prev Med 49, e23e33.
23. Ohri-Vachaspati, P & Leviton, LC (2010) Measuring food environments: a guide to available instruments. Am J Health Promot 24, 410426.
24. Honeycutt, S, Davis, E, Clawson, M et al. (2010) Training for and dissemination of the Nutrition Environment Measures Surveys (NEMS). Prev Chronic Dis 7, A126.
25. Nguyen, QC, Meng, H, Li, D et al. (2017) Social media indicators of the food environment and state health outcomes. Public Health 148, 120128.
26. Nsoesie, EO, Kluberg, SA & Brownstein, JS (2014) Online reports of foodborne illness capture foods implicated in official foodborne outbreak reports. Prev Med 67, 264269.
27. Harrison, C, Jorder, M, Stern, H et al. (2014) Using online reviews by restaurant patrons to identify unreported cases of foodborne illness – New York City, 2012–2013. MMWR Morb Mortal Wkly Rep 63, 441445.
28. Chen, X & Yang, X (2014) Does food environment influence food choices? A geographical analysis through ‘tweets’. Appl Geogr 51, 8289.
29. Nguyen, QC, Kath, S, Meng, H-W et al. (2016) Leveraging geotagged Twitter data to examine neighborhood happiness, diet, and physical activity. Appl Geogr 73, 7788.
30. Gomez-Lopez, IN, Clarke, P, Hill, AB et al. (2017) Using social media to identify sources of healthy food in urban neighborhoods. J Urban Health 94, 429436.
31. Widener, MJ & Li, W (2014) Using geolocated Twitter data to monitor the prevalence of healthy and unhealthy food references across the US. Appl Geogr 54, 189197.
32. Ghosh, D & Guha, R (2013) What are we ‘tweeting’ about obesity? Mapping tweets with topic modeling and Geographic Information System. Cartogr Geogr Inf Sci 40, 90102.
33. Nguyen, QC, McCullough, M, Meng, H-W et al. (2017) Geotagged US tweets as predictors of county-level health outcomes, 2015–2016. Am J Public Health 107, 17761782.
34. (2017) An introduction to Yelp Metrics as of September 30, 2017. (accessed February 2018).
35. Zenk, SN, Schulz, AJ, Israel, BA et al. (2005) Neighborhood racial composition, neighborhood poverty, and the spatial accessibility of supermarkets in metropolitan Detroit. Am J Public Health 95, 660667.
36. Cambria, E, Schuller, B, Xia, Y et al. (2013) New avenues in opinion mining and sentiment analysis. IEEE Intell Syst 28, 1521.
37. Michigan Department of Agriculture (2012) Michigan’s food & agriculture industry. (accessed March 2016).
38. Glanz, K, Basil, M, Maibach, E et al. (1998) Why Americans eat what they do: taste, nutrition, cost, convenience, and weight control concerns as influences on food consumption. J Am Diet Assoc 98, 11181126.
39. Krukowski, RA, Sparks, C, DiCarlo, M et al. (2013) There’s more to food store choice than proximity: a questionnaire development study. BMC Public Health 13, 586.
40. Jensen, PB, Jensen, LJ & Brunak, S (2012) Mining electronic health records: towards better research applications and clinical care. Nat Rev Genet 13, 395405.
41. Carrell, DS, Cronkite, D, Palmer, RE et al. (2015) Using natural language processing to identify problem usage of prescription opioids. Int J Med Inform 84, 10571064.
42. Grafton, JR, Yu, O, Carrell, D et al. (2016) Identifying race/ethnicity data via natural language processing among women in a uterine fibroid cohort study. J Patient Cent Res Rev 3, 226.
43. Pennebaker, JW, Chung, CK, Ireland, M et al. (n.d.) The Development and Psychometric Properties of Liwc 2007. (accessed March 2016).
44. Jones, KS, Walker, S & Robertson, SE (2000) A probabilistic model of information retrieval: development and comparative experiments – Part 1. Inf Process Manage 36, 779808.
45. Robertson, SE (1990) On term selection for query expansion. J Doc 46, 359364.
46. Rao, M, Afshin, A, Singh, G et al. (2013) Do healthier foods and diet patterns cost more than less healthy options? A systematic review and meta-analysis. BMJ Open 3, e004277.
47. Young, T, Swanson, A, Craven, , T et al. (2014) Food habits of residents who live near corner stores (132.3). FASEB J 28, 132.133.
48. Krukowski, RA, West, DS, Harvey-Berino, J et al. (2010) Neighborhood impact on healthy food availability and pricing in food stores. J Community Health 35, 315320.
49. Chang, BL, Bakken, S, Brown, SS et al. (2004) Bridging the digital divide: reaching vulnerable populations. J Am Med Inform Assoc 11, 448457.
50. Jensen, JD, King, AJ, Davis, LA et al. (2010) Utilization of internet technology by low-income adults: the role of health literacy, health numeracy, and computer assistance. J Aging Health 22, 804826.
51. Henly, S, Tuli, G, Kluberg, SA et al. (2017) Disparities in digital reporting of illness: a demographic and socioeconomic assessment. Prev Med 101, 1822.
52. Veinot, TC, Goodspeed, R, Clarke, P et al. (2017) Information and Education Environment. Neighborhood Effects: Community Characteristics and Health in Metropolitan Detroit. Ann Arbor, MI: University of Michigan Libraries; available at



Altmetric attention score

Full text views

Total number of HTML views: 0
Total number of PDF views: 0 *
Loading metrics...

Abstract views

Total abstract views: 0 *
Loading metrics...

* Views captured on Cambridge Core between <date>. This data will be updated every 24 hours.

Usage data cannot currently be displayed