Skip to main content Accessibility help

Government data v. ground observation for food-environment assessment: businesses missed and misreported by city and state inspection records

  • Sean C Lucan (a1), Andrew R Maroko (a2), Courtney Abrams (a3), Noemi Rodriguez (a3), Achint N Patel (a4), Ilirjan Gjonbalaj (a5), Clyde B Schechter (a1) and Brian Elbel (a3) (a6)...



To assess the accuracy of government inspection records, relative to ground observation, for identifying businesses offering foods/drinks.


Agreement between city and state inspection records v. ground observations at two levels: businesses and street segments. Agreement could be ‘strict’ (by business name, e.g. ‘Rizzo’s’) or ‘lenient’ (by business type, e.g. ‘pizzeria’); using sensitivity and positive predictive value (PPV) for businesses and using sensitivity, PPV, specificity and negative predictive value (NPV) for street segments.


The Bronx and the Upper East Side (UES), New York City, USA.


All food/drink-offering businesses on sampled street segments (n 154 in the Bronx, n 51 in the UES).


By ‘strict’ criteria, sensitivity and PPV of government records for food/drink-offering businesses were 0·37 and 0·57 in the Bronx; 0·58 and 0·60 in the UES. ‘Lenient’ values were 0·40 and 0·62 in the Bronx; 0·60 and 0·62 in the UES. Sensitivity, PPV, specificity and NPV of government records for street segments having food/drink-offering businesses were 0·66, 0·73, 0·84 and 0·79 in the Bronx; 0·79, 0·92, 0·67, and 0·40 in the UES. In both areas, agreement varied by business category: restaurants; ‘food stores’; and government-recognized other storefront businesses (‘gov. OSB’, i.e. dollar stores, gas stations, pharmacies). Additional business categories – ‘other OSB’ (barbers, laundromats, newsstands, etc.) and street vendors – were absent from government records; together, they represented 28·4 % of all food/drink-offering businesses in the Bronx, 22·2 % in the UES (‘other OSB’ and street vendors were sources of both healthful and less-healthful foods/drinks in both areas).


Government records frequently miss or misrepresent businesses offering foods/drinks, suggesting caveats for food-environment assessments using such records.


Corresponding author

*Corresponding author: Email


Hide All
1.Caspi, CE, Sorensen, G, Subramanian, SV et al. (2012) The local food environment and diet: a systematic review. Health Place 18, 11721187.
2.Rahmanian, E, Gasevic, D, Vukmirovich, I et al. (2014) The association between the built environment and dietary intake – a systematic review. Asia Pac J Clin Nutr 23, 183196.
3.Engler-Stringer, R, Le, H, Gerrard, A et al. (2014) The community and consumer food environment and children’s diet: a systematic review. BMC Public Health 14, 522.
4.Gamba, RJ, Schuchter, J, Rutt, C et al. (2015) Measuring the food environment and its effects on obesity in the United States: a systematic review of methods and results. J Community Health 40, 464475.
5.Cobb, LK, Appel, LJ, Franco, M et al. (2015) The relationship of the local food environment with obesity: a systematic review of methods, study quality, and results. Obesity (Silver Spring) 23, 13311344.
6.Malambo, P, Kengne, AP, De Villiers, A et al. (2016) Built environment, selected risk factors and major cardiovascular disease outcomes: a systematic review. PLoS One 11, e0166846.
7.Lucan, SC (2015) Concerning limitations of food-environment research: a narrative review and commentary framed around obesity and diet-related diseases in youth. J Acad Nutr Diet 115, 205212.
8.Fleischhacker, SE, Evenson, KR, Sharkey, J et al. (2013) Validity of secondary retail food outlet data: a systematic review. Am J Prev Med 45, 462473.
9.Wilkins, EL, Radley, D, Morris, MA et al. (2017) Examining the validity and utility of two secondary sources of food environment data against street audits in England. Nutr J 16, 82.
10.Farley, TA, Baker, ET, Futrell, L et al. (2010) The ubiquity of energy-dense snack foods: a national multicity study. Am J Public Health 100, 306311.
11.Lucan, SC, Maroko, AR, Seitchik, JL et al. (2018) Unexpected neighborhood sources of food and drink: implications for research and community health. Am J Prev Med 55, e29e38.
12.Caspi, CE, Pelletier, JE, Harnack, L et al. (2016) Differences in healthy food supply and stocking practices between small grocery stores, gas-marts, pharmacies and dollar stores. Public Health Nutr 19, 540547.
13.Wright, J, Kamp, E, White, M et al. (2015) Food at checkouts in non-food stores: a cross-sectional study of a large indoor shopping mall. Public Health Nutr 18, 27862793.
14.Lucan, SC, Maroko, AR, Seitchik, JL et al. (2018) Sources of foods that are ready-to-consume (‘grazing environments’) versus requiring additional preparation (‘grocery environments’): implications for food-environment research and community health. J Community Health 43, 886895.
15.Basch, CH, Kernan, WD & Menafro, A (2016) Presence of candy and snack food at checkout in chain stores: results of a pilot study. J Community Health 41, 10901093.
16.Lucan, SC, Maroko, AR, Patel, AN et al. (2018) Change in an urban food environment: storefront sources of food/drink increasing over time and not limited to food stores and restaurants. J Acad Nutr Diet 118, 21282134.
17.Odoms-Young, AM, Zenk, S & Mason, M (2009) Measuring food availability and access in African-American communities: implications for intervention and policy. Am J Prev Med 36, 4 Suppl., S145S150.
18.Tester, JM, Yen, IH & Laraia, B (2010) Mobile food vending and the after-school food environment. Am J Prev Med 38, 7073.
19.Lucan, SC, Maroko, AR, Bumol, J et al. (2014) Mobile food vendors in urban neighborhoods – implications for diet and diet-related health by weather and season. Health Place 27, 171175.
20.Valdez, Z, Dean, WR & Sharkey, JR (2012) Mobile and home-based vendors’ contributions to the retail food environment in rural South Texas Mexican-origin settlements. Appetite 59, 212217.
21.Lucan, SC, Maroko, A, Shanker, R et al. (2011) Green Carts (mobile produce vendors) in the Bronx – optimally positioned to meet neighborhood fruit-and-vegetable needs? J Urban Health 88, 977981.
22.Lucan, SC, Maroko, AR, Bumol, J et al. (2013) Business list vs ground observation for measuring a food environment: saving time or waste of time (or worse)? J Acad Nutr Diet 113, 13321339.
23.Manson, S, Schroeder, J, Riper, DV et al. (2017) American Community Survey 5-Year Estimates, 2011–2015 via IPUMS National Historical Geographic Information System: Version 12.0. Minneapolis, MN: University of Minnesota; available at (accessed August 2017).
24.NYC Health (2017) Community Health Survey, 2015 (age-adjusted estimates). (accessed August 2017).
25.Lucan, SC, Maroko, AR, Sanon, O et al. (2015) Urban farmers’ markets: accessibility, offerings, and produce variety, quality, and price compared to nearby stores. Appetite 90, 2330.
26.Lucan, SC, Varona, M, Maroko, AR et al. (2013) Assessing mobile food vendors (a.k.a. street food vendors) – methods, challenges, and lessons learned for future food-environment research. Public Health 127, 766776.
27.Nicklas, T, Kleinman, RE & O’Neil, CE (2012) Taking into account scientific evidence showing the benefits of 100 % fruit juice. Am J Public Health 102, e4; author reply e5.
28.Wojcicki, JM & Heyman, MB (2012) Reducing childhood obesity by eliminating 100 % fruit juice. Am J Public Health 102, 16301633.
29.Ludwig, DS (2009) Artificially sweetened beverages: cause for concern. JAMA 302, 24772478.
30.Harris, PA, Taylor, R, Thielke, R et al. (2009) Research electronic data capture (REDCap) – a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform 42, 377381.
31.NYC Business (2017) Food Service Establishment Permit. (accessed August 2017).
32.NYC OpenData (2017) DOHMH New York City Restaurant Inspection Results. (accessed August 2017).
33.New York State Department of Agriculture (2017) Agriculture and Markets Inspection. (accessed August 2017).
34.New York State Department of Agriculture and Markets (2017) Retail Food Store Inspections – Current Ratings. (accessed August 2017).
35.Rossen, LM, Pollack, KM & Curriero, FC (2012) Verification of retail food outlet location data from a local health department using ground-truthing and remote-sensing technology: assessing differences by neighborhood characteristics. Health Place 18, 956962.
36.Hosler, AS & Dharssi, A (2010) Identifying retail food stores to evaluate the food environment. Am J Prev Med 39, 4144.
37.Fleischhacker, SE, Rodriguez, DA, Evenson, KR et al. (2012) Evidence for validity of five secondary data sources for enumerating retail food outlets in seven American Indian communities in North Carolina. Int J Behav Nutr Phys Act 9, 137.
38.NYC Business (2017) Mobile Food Vending License. (accessed August 2017).
39.Rose, D, Bodor, JN, Hutchinson, PL et al. (2010) The importance of a multi-dimensional approach for studying the links between food access and consumption. J Nutr 140, 11701174.
40.New York State Department of Agriculture and Markets (2011) Community Farmers’ Markets. (accessed June 2011).
41.Gustafson, AA, Lewis, S, Wilson, C et al. (2012) Validation of food store environment secondary data source and the role of neighborhood deprivation in Appalachia, Kentucky. BMC Public Health 12, 688.


Type Description Title
Supplementary materials

Lucan et al. supplementary material
Lucan et al. supplementary material

 Unknown (534 KB)
534 KB

Government data v. ground observation for food-environment assessment: businesses missed and misreported by city and state inspection records

  • Sean C Lucan (a1), Andrew R Maroko (a2), Courtney Abrams (a3), Noemi Rodriguez (a3), Achint N Patel (a4), Ilirjan Gjonbalaj (a5), Clyde B Schechter (a1) and Brian Elbel (a3) (a6)...


Full text views

Total number of HTML views: 0
Total number of PDF views: 0 *
Loading metrics...

Abstract views

Total abstract views: 0 *
Loading metrics...

* Views captured on Cambridge Core between <date>. This data will be updated every 24 hours.

Usage data cannot currently be displayed