Hostname: page-component-76fb5796d-zzh7m Total loading time: 0 Render date: 2024-04-26T23:09:23.478Z Has data issue: false hasContentIssue false

Reliability and validity of an FFQ for South American children and adolescents from the SAYCARE study

Published online by Cambridge University Press:  12 September 2019

Tara Rendo-Urteaga*
Affiliation:
YCARE (Youth/Child cArdiovascular Risk and Environmental) Research Group, School of Medicine, University of São Paulo, São Paulo, SP, Brazil Growth, Exercise, NUtrition and Development (GENUD) Research Group, Faculty of Health Science (EUCS), Instituto Agroalimentario de Aragón (IA2), University of Zaragoza-CITA, Zaragoza, Spain
Luisa Saravia
Affiliation:
Growth, Exercise, NUtrition and Development (GENUD) Research Group, Faculty of Health Science (EUCS), Instituto Agroalimentario de Aragón (IA2), University of Zaragoza-CITA, Zaragoza, Spain School of Nutrition, University of La República, Montevideo, Uruguay
Tatiana Sadalla Collese
Affiliation:
YCARE (Youth/Child cArdiovascular Risk and Environmental) Research Group, School of Medicine, University of São Paulo, São Paulo, SP, Brazil Growth, Exercise, NUtrition and Development (GENUD) Research Group, Faculty of Health Science (EUCS), Instituto Agroalimentario de Aragón (IA2), University of Zaragoza-CITA, Zaragoza, Spain
Julia María Monsalve-Alvarez
Affiliation:
School of Nutrition and Dietetics, University of Antioquia, Medellin, Colombia
Laura Inés González-Zapata
Affiliation:
School of Nutrition and Dietetics, University of Antioquia, Medellin, Colombia
Florencia Tello
Affiliation:
Escuela de Nutrición, Facultad de Medicina, Universidad de Buenos Aires, Buenos Aires, Argentina
Beatriz Martínez-Oliván
Affiliation:
Growth, Exercise, NUtrition and Development (GENUD) Research Group, Faculty of Health Science (EUCS), Instituto Agroalimentario de Aragón (IA2), University of Zaragoza-CITA, Zaragoza, Spain
Francisco Leonardo Torres-Leal
Affiliation:
DOMEN (Metabolic Diseases, Exercise and Nutrition) Research Group, Department of Biophysical and Physiology, Federal University of Piauí, Teresina, Brazil
Luis A Moreno
Affiliation:
Instituto de Investigación Sanitaria de Aragón (IIS Aragón) y Centro de Investigación Biomédica en Red de Fisiopatología de la Obesidad y Nutrición (CIBEROBN), Instituto de Salud Carlos III, Madrid, Spain
Augusto César Ferreira De Moraes
Affiliation:
YCARE (Youth/Child cArdiovascular Risk and Environmental) Research Group, School of Medicine, University of São Paulo, São Paulo, SP, Brazil Department of Epidemiology, Bloomberg School of Public Health, Johns Hopkins University, Baltimore, MD, USA
Heráclito Barbosa Carvalho
Affiliation:
YCARE (Youth/Child cArdiovascular Risk and Environmental) Research Group, School of Medicine, University of São Paulo, São Paulo, SP, Brazil
*
*Corresponding author: Email trendo@usp.br
Rights & Permissions [Opens in a new window]

Abstract

Objective:

The purpose of this study was to analyse the reliability and validity of a semi-quantitative FFQ to assess food group consumption in South American children and adolescents.

Design:

The SAYCARE (South American Youth/Child cARdiovascular and Environmental) study is an observational, multicentre, feasibility study performed in a sample of 3- to 18-year-old children and adolescents attending private and public schools from six South American countries. Participants answered the FFQ twice with a two-week interval and three 24-h dietary recalls. Intraclass and Spearman’s correlations, weighted Cohen’s kappa (κw), percentage of agreement and energy-adjusted Pearson’s correlation coefficients were calculated.

Setting:

Seven cities in South America (Buenos Aires, Lima, Medelin, Montevideo, Santiago, Sao Paulo and Teresina).

Subjects:

A sample of 200 children and 244 adolescents for reliability analyses and 252 children and 244 adolescents for validity analyses were included.

Results:

Depending on the food group, for children and adolescents, reliability analyses resulted in Spearman’s coefficients from 0·47 to 0·73, intraclass correlation coefficients from 0·66 to 0·99, κw coefficients from 0·35 to 0·63, and percentage of agreement between 72·75 and 83·52 %. In the same way, validity analyses resulted in Spearman’s coefficients from 0·17 to 0·37, energy-adjusted Pearson’s coefficients from 0·17 to 0·61, κw coefficients from 0·09 to 0·24, and percentages of agreement between 45·79 and 67·06 %.

Conclusion:

The SAYCARE FFQ achieved reasonable reliability and slight-moderate validity for almost all food groups intakes. Accordingly, it can be used for the purpose of ranking the intake of individuals within a population.

Type
Research paper
Copyright
© The Authors 2019 

Dietary intake is an important determinant of nutritional status and health in children and adolescents. An accurate assessment of food intake is essential for monitoring nutritional status, identifying diet-related behaviours in youth, and conducting epidemiological and clinical research to optimize current and future health(Reference Livingstone, Robson and Wallace1).

The most common dietary methodologies used to assess dietary intake are diet history, food diaries (dietary records), food recalls and FFQ(Reference Willett2). FFQ are the most frequently used tool applied in large cross-sectional and cohort studies and nutritional related studies(Reference McPherson, Hoelscher and Alexander3,Reference Cade, Thompson and Burley4) , as they capture usual dietary intake over longer periods of time compared with other methods and can be collected from a large number of participants in a relatively short time frame(Reference Willett2,Reference Magarey, Watson and Golley5) . FFQ are practical, easy-to-administer and inexpensive tools that question the frequency of intake from a previously defined list of foods over a specific period of time. This method can be self- or interview administered and is a potentially valuable tool to assess habitual dietary intake among children and adolescents(Reference McPherson, Hoelscher and Alexander3,Reference Magarey, Watson and Golley5) . Despite the suggestion that overestimation may occur when the FFQ had many food items(Reference Cade, Thompson and Burley4), these questionnaires are appropriate tools to explore factors associated with changes in the dietary patterns of a population and have been demonstrated to be useful tools for investigating the association between diet and metabolic and CVD(6).

There are additional challenges concerning self-reporting while assessing food intake in youths through the use of food questionnaires. Children may have limitations regarding an adequately developed concept of time, memory and attention span and may lack knowledge of food names, preparation, and portion size(Reference McPherson, Hoelscher and Alexander3,Reference Livingstone and Robson7) . In adolescents, issues of motivation, body image and difficulty reporting portion sizes can hinder the willingness to report(Reference Livingstone and Robson7,Reference Tabacchi, Amodio and Di Pasquale8) . Although the FFQ reproducibility and validity have been assessed in children and adolescents as wells as in adults(Reference Tabacchi, Amodio and Di Pasquale8,Reference Kolodziejczyk, Merchant and Norman9) , measuring energy and food intake at an early age is particularly challenging because there are few valid tools for the younger population(Reference McPherson, Hoelscher and Alexander3). Due to these limitations, it is essential to select the appropriate method in accordance with the study design, target population and outcome of interest(Reference Rockett and Colditz10).

Several multicentre studies regarding lifestyle and cardiovascular health in European children and adolescents have used standardized reliable and valid methods to assess food intake(Reference Pigeot, Baranowski and De Henauw11Reference Manios, Androutsos and Katsarou13). To allow comparisons between countries, this appears to be the best strategy. Validation studies are necessary to indicate the effect of measurement error and to prevent incorrect estimations(Reference Cade, Thompson and Burley4). Currently, there are no validated tools to assess food intake among South American children and adolescents. Given the increasing prevalence of childhood obesity worldwide, and also in South America, it seems necessary to have a tool that can be applied in epidemiological studies to help understand the origin of the non-communicable diseases related to lifestyle in children and adolescents. Therefore, in spite of the great challenge that implies working with a young population, from different countries with different culture and language, among other aspects, this study aimed to analyse the reliability and validity of an FFQ to assess food group consumption in this population.

Methods

Study design

The SAYCARE (South American Youth/Child cARdiovascular and Environmental) study is a observational, multicentre, feasibility study performed in a convenience sample of 3- to 18-year-old children and adolescents attending private and public schools from the following seven cities in six South American countries: Buenos Aires (Argentina), Lima (Peru), Medelin (Colombia), Montevideo (Uruguay), Santiago (Chile) and Sao Paulo and Teresina (Brazil). Random sampling was conducted by using student lists and each sex was represented by 50 % of participants. All parents/guardians signed an informed consent form, and a signed assent form was obtained from children/adolescents to indicate their approval to participate in the study. The exclusion criteria were inability to complete the questionnaires and pregnancy. Data collection occurred between 2015 and 2016. A detailed description of the SAYCARE study has been published elsewhere(Reference Carvalho, Moreno and Silva14). The study was performed in accordance with the ethical standards of the Declaration of Helsinki and was approved by the Research Ethics Committee of each city involved.

Data collection

Participants were enrolled in the SAYCARE study for approximately 4 weeks. All SAYCARE questionnaires were answered by the children’s caregivers (3–10 years), while adolescents (11–18 years) answered it themselves. Participants answered the FFQ twice and three 24-h dietary recalls (24HDR) (Fig. 1). Caregivers or adolescents received verbal and written instructions on how to complete these questionnaires. The instructions incorporated standardized examples and a coloured food photo booklet, which contained photographs of commonly consumed food (including country-specific foods) and their standard portion sizes, to facilitate accurate recordings(Reference Saravia, Gonzalez-Zapata and Rendo-Urteaga15). Data for this study were analysed in March 2017. Total energy intake was calculated from FFQ1 data using the United States Department of Agriculture (USDA)(16) food composition databases and a food composition database(17) from each SAYCARE country when local foods were not found in the USDA database.

Fig. 1 Design of the reliability and validity analyses among children and adolescents of the SAYCARE study. *First 24HR with a nutritionist; included one weekend day. Referred to the last 3 months (24HDR, 24 h dietary recall; FFQ1, first FFQ application; FFQ2, second FFQ application)

Reliability and validity of the FFQ

We developed a semi-quantitative FFQ for children and adolescents from South America, as described elsewhere(Reference Saravia, Gonzalez-Zapata and Rendo-Urteaga15). Depending on the city and their country-specific foods included in the FFQ, the questionnaire had different numbers of items: for Buenos Aires, the FFQ had a total of 63 items, Lima had a total of 61 items, 63 items for Medelin, 59 items for Montevideo, 57 items for Santiago, 67 items for Sao Paulo, and 69 items for Teresina. To assess FFQ reliability, all participants answered the FFQ twice with a two-week interval between assessments (FFQ1 and FFQ2) (Fig. 1). Data from the FFQ1 and FFQ2 were entered in the SAYCARE platform(Reference Carvalho, Moreno and Silva14). This is a secured web-based system that facilitates data collection, entry, management and analysis of the SAYCARE data(Reference Carvalho, Moreno and Silva14). Our FFQ asked the frequency and portion size of each food item(Reference Saravia, Gonzalez-Zapata and Rendo-Urteaga15). Each frequency was transformed into a daily frequency with each portion recorded in grams or millilitres. Therefore, portion sizes were multiplied by their respective frequencies to obtain total intake of each food item in grams or millilitres per day. Subsequently, food items were summed into food groups according to the FAO(18) as follows: (i) Cereals; (ii) Tubers; (iii) Vegetables; (iv) Fruits; (v) Oils; (vi) Meat and Derivatives, Fish and Eggs; (vii) Milk and Dairy products; (viii) Legumes; (ix) Beverages; (x) Sugar products; and (xi) Miscellaneous. For adolescents, we assessed the ninth group, ‘Beverages’, with and without alcoholic drinks as a different group.

Additionally, in three non-consecutive 24HDR (two weekdays and one weekend day), caregivers and adolescents had to describe all foods consumed during the previous day, qualitatively and quantitatively using household measures (Fig. 1). This questionnaire was structured into six daily eating occasions. Children caregivers and adolescents answered the first 24HDR in school with a trained dietitian, and the second and third 24HDR were answered at home with the support of the food booklet used for the FFQ. In Buenos Aires and Lima, caregivers answered the three 24HDR at home (except in special situations such as non-literate caregivers who needed help to respond to the questionnaires and they did it in school with the help of a trained dietitian). Data from 24HDR were entered into computer-based food software developed to evaluate energy and nutrient intake from Ibero-American food consumption surveys. The food composition databases included in it are the Spanish Food Composition Database (Bedca); the National Nutrient Database for Standard Reference Release (USDA); and the Ibero-American Foods Database. Moreover, some typical Brazilian foods were inserted into this software, considering the Brazilian Food Composition Table (TACO). Food items from this software were exported to a Microsoft Excel spreadsheet and checked by a trained nutritionist. Recorded food items in the 24HDR were matched to the items as defined by the FFQ. An example of this was ‘bread’ or ‘rice’ from the 24HDR. This was assigned to the corresponding item in the FFQ and then to the FAO group ‘cereals’. Each ingredient in a composite dish was assigned with a proportion size of meal and then allocated to the respective food group. For instance, a ‘ham and cheese sandwich’ was proportionally recorded in the three corresponding food groups in FFQ as follows: ‘cereals’, ‘meat and derivatives’ and ‘milk and dairy products’. Data obtained from at least two 24HDR, in grams (or millilitres per day for beverages), were summed, and the mean was calculated to provide average daily intakes. Finally, food items from the 24HDR were summed into food groups according to the FAO as previously described to enable a direct comparison between FFQ1 and the 24HDR (validity analysis).

For the reliability analysis, sample size was calculated using k = 0·70, α = 5 % and β = 80 %. For the validity analysis, k = 0·40, α = 5 % and β = 80 % were used. The estimated sample size was 146 participants for the reliability analysis and 40 for the validity analysis. Anticipating potential sample losses, a 25 % greater sample size was recruited in each city, which was equally divided by sex and public/private schools. These sample sizes were considered appropriate according to our sample size calculations and according to Willett (2009) for studies validating dietary intake tools(Reference Willett2).

Statistical analysis

All statistical analyses were performed using the statistical software package Stata version 14.0, they included all countries and were performed by age group. The Shapiro-Wilk test was used to determine variable distribution. Continuous non-normally distributed variables are presented in median and 95 % CI. Categorical variables are shown as proportions (%). To assess differences between reported intakes between questionnaires (FFQ1, FFQ2 and 24HDR), the Wilcoxon test was performed. We used the Spearman rank correlation coefficients (Spearman’s rho) for continuous nonparametric data to assess FFQ reliability and validity. Pearson’s correlation coefficients were then calculated and presented before and after to adjust for total energy intake(Reference Willett, Sampson and Stampfer19), for validity analysis. For all food group intakes, data were log-transformed (log10) prior to multilevel regression analyses to improve normality. Random or fixed effect models for each food group were used according to the Housman test. The multilevel analyses were performed with ‘centre’ as the contextual variable and total energy intake as the individual variable. Furthermore, for reliability, intraclass correlation coefficients (ICC) were calculated since this analysis takes account of between- and within- subject variability in responses. Values of ICC less than 0·40 indicate poor reliability, values between 0·41 and 0·75 indicate fair to good reliability, and values greater than 0·75 indicate excellent reliability. Finally, tertiles of intake for each food group were calculated, and weighted Cohen’s kappa (κw) coefficients were used (for categorical data) to evaluate the agreement in ranking. Values of κw over 0·80 indicate very good agreement, values between 0·61 and 0·80 indicate substantial (good) agreement, values from 0·41 to 0·60 indicate moderate agreement, values from 0·21 to 0·40 indicate fair agreement and values between 0 and 0·20 indicate slight (poor) agreement(Reference Landis and Koch20). Classification into the same or an adjacent tertile was subsequently calculated. Our sample size was estimated to guarantee statistical significance for correlation coefficients r > 0·20(Reference Willett2). The significance level for all tests were set at P < 0·05.

Results

A total of 345 children and 357 adolescents answered the FFQ1, and 202 children and 247 adolescents answered the FFQ2. In addition, 86 children responded to two 24HDR and 323 children answered three 24HDR (being a total of 409 children who answered at least two 24HDR); in addition, 60 adolescents answered two 24HDR and 241 adolescents answered the three 24HDR (being a total of 301 adolescents who answered at least two 24HDR) (data not shown). Descriptive analyses are presented in Table 1 divided by reliability/validity analyses and age group. A total of 200 children (50·5 % female; median age 5·9 years) and 244 adolescents (49·6 % female; median age 15·0 years) were included in the reliability analyses, and a total of 252 children (53·2 % female; median age 5·6 years) and 244 adolescents (52·0 % female; median age 14·8 years) were included in the validity analyses.

Table 1 Main characteristics of the SAYCARE population for reliability and validity analyses

Continuous non-normally distributed variables were presented in median and 95 % CI and categorical variables were presented as proportion (%).

Reliability analyses: First v. second FFQ application (FFQ1 v. FFQ2).

Validity analyses: First FFQ application (FFQ1) v. average of at least two 24-h dietary recalls (24HDR).

Daily reported intakes from the FFQ and reliability results are shown in Table 2. When comparing intakes reported in both FFQ, FFQ1 provided higher intake estimates for cereals, vegetables and beverages in children and for cereals, milk and dairy products and both groups of beverages in adolescents. We found acceptable reliability in the food groups according to Spearman’s ρ coefficients (ranging from 0·49 to 0·73 in children and from 0·47 to 0·67 in adolescents) and good to excellent reliability (ranging from 0·87 to 0·99 in children and from 0·66 to 0·99 in adolescents) according to ICC. According to classification into tertiles of intake, the percentage of agreement (children/adolescents classified in the same or adjacent tertile) ranged from 70·75 to 83·52 % in children, and from 71·58 to 81·36 % in adolescents. Moreover, the κw coefficients demonstrated moderate agreement for all food groups except for cereals (fair agreement) and legumes (substantial agreement) in children, and tubers, sugar products and both groups of beverages in adolescents (fair agreement).

Table 2 Reliability of the SAYCARE FFQ

FFQ1, first FFQ application; FFQ2, second FFQ application; κw, weighted Cohen’s kappa coefficient for tertiles comparison; ρ, Spearman rho coefficient; ICC, Intraclass correlation coefficient.

* Beverages in ml/d.

Percentage of children/adolescents classified in the same or an adjacent tertiles.

P < 0·05 for the comparison between FFQ1 and FFQ2 intakes (Wilcoxon test). Spearman and κw coefficients in bold when P < 0·05.

§ Beverages including alcohol.

Table 3 presents the daily reported intakes from FFQ1 and average intakes from at least two 24HDR for those participants included in the validity analyses. When compared with the 24HDR reported intakes, the FFQ1 underestimates intake for cereals, tubers, vegetables, oils, meat and derivatives, fish and eggs, and miscellaneous, and overestimates intake for milk and dairy products, beverages and sugar products in children. In adolescents, FFQ1 underestimates intake for tubers and miscellaneous and overestimates intake for cereals, fruits, meat and derivatives, fish and eggs, milk and dairy products, sugar products and both groups of beverages. According to Spearman’s ρ coefficients (Table 3), we found values higher than 0·20 for all food groups except for cereals, sugar products, oils, beverages and miscellaneous in children and for fruits, sugar products, miscellaneous and both groups of beverages in adolescents. In addition, the κw coefficients showed slight agreement for cereals, tubers, vegetables, meat and derivatives, fish and eggs, legumes and sugar products in children and for cereals, tubers, fruits, meat and derivatives, fish and eggs, and legumes in adolescents. Moreover, we found fair agreement for milk and dairy products in both children and adolescents and for fruits only in children. The energy-adjusted Pearson’s coefficients were lower than 0·20 only for sugar products and beverages in adolescents. According to classification into tertiles of intake, the percentages of children/adolescents classified in the same or adjacent tertile ranged between 45·79 and 67·06 % for children, and between 55·94 and 67·05 % for adolescents.

Table 3 Validity of the SAYCARE FFQ

FFQ1, first FFQ application; 24HDR, mean of at least two 24-h dietary recalls; κw, weighted Cohen’s kappa coefficient for tertiles comparison; ρ, Spearman rho coefficient.

* Beverages in ml/d.

Percentage of children/adolescents classified in the same or an adjacent tertiles.

Unadjusted Pearson coefficient correlations from multilevel regression models after food group intakes were log-transformed.

§ Pearson coefficient correlations from multilevel regression models after food group intakes were log-transformed and adjusted for total energy intake.

P < 0·05 for the comparison between FFQ1 and 24HDR intakes (Wilcoxon test). Spearman, Pearson and κw coefficients in bold when P < 0·05.

Beverages including alcohol.

Discussion

In the current study, the reliability and validity of a semi-quantitative FFQ was assessed by comparing two administrations of the FFQ over a two-week period and by comparing the FFQ against the 24HDR, respectively. Our results demonstrated a reasonable reliability and slight-to-moderate validity for almost all food groups intakes in children and adolescents.

In the reliability analyses, we found that our FFQ1 overestimated the intake of some food groups when compared to FFQ2. In the literature, some studies reported higher estimates in the first FFQ, and others reported higher estimates in the second FFQ(Reference Vioque, Gimenez-Monzo and Navarrete-Munoz21,Reference Lanfer, Hebestreit and Ahrens22) . Moreover, our analyses for children and adolescents shows Spearman’s correlation coefficients ranging from 0·47 to 0·73, ICC ranging from 0·66 to 0·99 and κw coefficients ranging from 0·35 to 0·63. The proportion of participants classified in the same and adjacent tertiles, for children and adolescents, varied between 70·75 and 83·52 %. In this sense, our FFQ shows an acceptable reliability for both children and adolescents. The correlation and κw coefficients for most food groups were comparable with those reported in other studies in the same population assessing food group reliability(Reference Vioque, Gimenez-Monzo and Navarrete-Munoz21Reference Rockett, Wolf and Colditz25). Moreover, the proportion of participants classified in the same and adjacent tertiles in our study were also similar to that of other studies(Reference Vioque, Gimenez-Monzo and Navarrete-Munoz21,Reference Vereecken and Maes23,Reference Saeedi, Skeaff and Wong24) in which this proportion is between 70 and 100 %.

Our FFQ has a common core of 56 items for all SAYCARE cities, with the addition of typical food items in each centre, which resulted in a list of 65 items on average for each centre(Reference Saravia, Gonzalez-Zapata and Rendo-Urteaga15). Additionally, as previously mentioned, we adopted a 2-week interval for reliability analyses in order to minimize variation in food intake responses due to true changes over time(Reference Metcalf, Scragg and Sharpe26). The replication interval should not be too short or too long because in a short span, subjects may remember and repeat answers. On the other hand, a long time interval could be influenced by diet changes, for example changes due to seasonality(Reference Marchioni, Voci and de Lima27). Although there is no consensus, previous studies have evaluated reliability with the same time interval of 2 weeks for children and adolescents(Reference Vereecken and Maes23,Reference Saeedi, Skeaff and Wong24,Reference Metcalf, Scragg and Sharpe26) .

In the validation analyses, our FFQ overestimated intake for some food groups and underestimated intake for other groups. As previously reported in other studies(Reference Vioque, Gimenez-Monzo and Navarrete-Munoz21Reference Vereecken and Maes23,Reference Bel-Serrat, Mouratidou and Pala28) , higher intake estimates were reported on FFQ than on 24HDR. For both children and adolescents, our validation analyses demonstrated a Spearman’s correlation ranging from 0·17 to 0·37, κw coefficients ranging from 0·09 to 0·24, and proportion of participants classified in the same and adjacent tertile ranging between 45·79 and 67·06 %. Although we observed a non-significant κw coefficient or κw < 0·20 (slight agreement) in several food groups, such as oils, beverages, sugar products, fruits or miscellaneous, we found percentages of children/adolescents correctly classified in the same or adjacent tertile ranging from 45·79 to 83·52 %, similar to other studies(Reference Vioque, Gimenez-Monzo and Navarrete-Munoz21,Reference Vereecken and Maes23,Reference Saeedi, Skeaff and Wong24,Reference Bel-Serrat, Mouratidou and Pala28,Reference Truthmann, Mensink and Richter29) . Moreover, we found an acceptable correlation (r > 0·20)(Reference Willett2) between FFQ1 and 24HDR in all food groups in children and in almost all food groups in adolescents (except for sugar products and beverages). Numerous studies have evaluated FFQ validity at the food level among children and adolescents, but the results were inconsistent(Reference Vioque, Gimenez-Monzo and Navarrete-Munoz21,Reference Bel-Serrat, Mouratidou and Pala28Reference Blum, Wei and Rockett30) . The lack of agreement between methods is often due to several factors(Reference Livingstone and Robson7,Reference Bel-Serrat, Mouratidou and Pala28) , such as proxy reporting from parents, nature of dietary habits at the studied age, and lack of a ‘perfect’ gold standard tool, among others. As previously reported in a systematic review(Reference Tabacchi, Amodio and Di Pasquale8), adolescents may forget what they have eaten, may remember other items although not consumed within the given time span, or some foods may not be recognized because they are part of a dish. Moreover, as mentioned previously, adolescents have difficulties in estimating portion sizes(Reference Cullen, Watson and Zakeri31,Reference Poslusna, Ruprich and de Vries32) , which may lead to over- or under-estimation of intake. In addition, parents/guardians’ educational level or social desirability could influence reporting, and parents/guardians are unreliable reporters of their children’s food intake when out of the home(Reference Livingstone and Robson7), leading to generally lower validity correlations(Reference Kolodziejczyk, Merchant and Norman9). Among South American children, it is common to have not only lunch but also breakfast or morning/afternoon snacks at school. In addition, correlation coefficients may be affected by the manner in which the questionnaire is administered, and the age, sex and ethnicity of population(Reference Saeedi, Skeaff and Wong24). Other factors affecting reported intakes and complicating the comparison among validation studies are the differences in the way the FFQ was developed, design characteristics such as number of items, inclusion of portion sizes or sample size, food groups examined, unit of estimation or statistical method used, use of a reference method and number of recorded days(Reference Bel-Serrat, Mouratidou and Pala28,Reference Molag, de Vries and Ocke33) . Although some authors suggest that the number of items included does not have an impact on validity(Reference Cade, Burley and Warm34), in a review it was suggested that an extensive list can lead to inaccuracy due to fatigue when filling out the questionnaire(Reference Kolodziejczyk, Merchant and Norman9). In this review, they found that studies in children and adolescents with the strongest validity correlations used medium length questionnaires, ranging from 19 to 63 items(Reference Kolodziejczyk, Merchant and Norman9).

Our study has some limitations. We used a convenience sample of children and adolescents(Reference Carvalho, Moreno and Silva14), although we included both private and public schools. Moreover, we used 24HDR as the reference method. Although 24HDR have acceptable validity in children and adolescents(Reference Willett2Reference Cade, Thompson and Burley4) and are widely used as a gold standard(Reference Tabacchi, Amodio and Di Pasquale8,Reference Kolodziejczyk, Merchant and Norman9,Reference Vereecken and Maes23,Reference Rockett, Breitenbach and Frazier35) , they are not a perfect measure of dietary intake due to the high degree of intrapersonal variability and the fact that misreporting of energy intake is a common problem, especially in adolescents, which can affect validity results(Reference Bel-Serrat, Mouratidou and Pala28,Reference Block and Hartman36) . In order to mitigate this, in our study, trained dietitians assisted the participants. Preferably, biochemical markers, such as doubly labelled water(Reference Bornhorst, Bel-Serrat and Pigeot37) or several dietary biomarkers(Reference Vioque, Gimenez-Monzo and Navarrete-Munoz21), should be implemented in validation studies as they can be alternative reference methods to objectively assess energy and dietary consumption because their measurement errors are independent of those from FFQ(Reference Vioque, Gimenez-Monzo and Navarrete-Munoz21,Reference Bornhorst, Bel-Serrat and Pigeot37) . However, although biochemical markers are valuable as reference methods as they are not affected by errors in recall or other issues, they are not available for all nutrients or for all food groups(Reference Willett2). Moreover, these methods are expensive, require sophisticated laboratories and equipment and do not provide information on all food groups(Reference Rockett, Breitenbach and Frazier35). Finally, the time span evaluated in our FFQ was 3 months(Reference Saravia, Gonzalez-Zapata and Rendo-Urteaga15). In this sense, a review found that studies with shorter time span assessment periods (previous day or week) have better validity than those with longer periods (from one month to one year)(Reference Kolodziejczyk, Merchant and Norman9).

On the other hand, the current study has several strengths. First, we followed standardized and harmonized procedures during data collection of the SAYCARE study fieldwork(Reference Carvalho, Moreno and Silva14). Moreover, we assessed a large enough sample of children and adolescents from seven South American cities and, according to Willett(Reference Willett2), our sample size was optimal for validation studies. Second, our FFQ was developed specifically for children and adolescents. Both the FFQ and 24HDR covered the same time frame, and we developed a food photo booklet(Reference Saravia, Gonzalez-Zapata and Rendo-Urteaga15) to facilitate accurate recordings. In some centres, as children have lunch or other meals at school, schoolteachers helped provide answers when necessary. Third, several studies in this field measured the reliability and validity of FFQ for children and adolescents in terms of nutrients intake. From our point of view, and in accordance with some intervention trials(Reference Neuhouser, Patterson and Thornquist38), whole foods rather than individual nutrients may best indicate the potential role of diet in disease prevention. Therefore, with the overconsumption of specific food groups associated with diseases (such as obesity in youths), assessing foods or food group intakes with validated methods is especially important(Reference Kolodziejczyk, Merchant and Norman9). In our study, participants answered the FFQ twice with a two-week interval between assessments, and they completed at least two 24HDR. The long recording periods and the repeated measures of the questionnaires may reduce accuracy due to increasing fatigue and boredom and potential alterations of dietary habits, which can increase the probability of drop-outs(Reference Bel-Serrat, Mouratidou and Pala28).

Conclusion

The SAYCARE food frequency questionnaire possesses satisfactory reliability. In addition, the questionnaire has slight-to-moderate validity for almost all food group intakes in South American children and adolescents. Accordingly, this questionnaire is appropriate for the purpose of ranking the intake of individuals within a population.

Acknowledgements

Acknowledgements: The authors would like to thank all the participants who took part in the study and to Dr. Alex Jones Flores Cassenote for his participation in the making of the food photo booklet. Financial support: Tara Rendo-Urteaga is in receipt of a post-doctoral scholarship from São Paulo Research Foundation – FAPESP (proc. 2014/25233-0). Luisa Saravia is in receipt of a doctoral scholarship from Carolina Foundation. Tatiana Sadalla Collese is in receipt of a doctoral scholarship from FAPESP (proc. 2016/13922-1). Augusto César F. de Moraes is in receipt of a post-doctoral scholarship from National Counsel of Technological and Scientific Development – CNPq (proc. 313772/2014-2) and FAPESP (proc. 2014/13367-2 and 2015/14319-4). Full Professor Luis A. Moreno was given scholarship of visiting professor from FAPESP (proc. 2015/11406-3). Heráclito B. Carvalho received funding grant from FAPESP (proc. 2014/11468-6). The SAYCARE Study was supported mainly by the Brazilian Government from CNPq (proc. 471266/2013-2) and São Paulo State Government from FAPESP (proc. 2014/11468-6). The SAYCARE Study has also been co-funded by other agencies in the other countries: (i) Collaborative Projects Fund – Instituto Nacional de Salud del Niño Lima; (ii) Sustainability Strategy 2014-2015 at the University of Antioquia, Medellin, Colombia; (iii) Secretary of University Extension and Student Welfare, University of Buenos Aires; (iv) European Regional Development Fund (MICINN-FEDER) to GENUD Research Group. Conflict of interest: The authors have nothing to disclose. Authorship: T.R.U., T.S.C., L.S., J.M.M.A., F.T. and B.M.O. were involved in the data collection. T.R.U. was involved in the conducting, analysis and writing of the manuscript. T.S.C. was involved in data interpretation and critically reviewed the manuscript. L.S., J.M.M.A., L.I.G.Z., F.T. and B.M.O. critically reviewed the manuscript. L.I.G.Z., F.L.T.L., L.A.M., A.C.F.M. and H.B.C. were involved in the design and funding and critically reviewed the manuscript. All authors approved the final version. Ethics of human subject participation: This study was conducted according to the guidelines laid down in the Declaration of Helsinki and all procedures involving human subjects/patients were approved by The Research Ethics Committee of each city involved in the study. Written informed consent was obtained from all participants.

References

Livingstone, MB, Robson, PJ & Wallace, JM (2004) Issues in dietary intake assessment of children and adolescents. Br J Nutr 92, Suppl. 2, S213S222.CrossRefGoogle ScholarPubMed
Willett, W (2012) Nutritional Epidemiology, 3rd ed. New York: Oxford University Press.10.1093/acprof:oso/9780199754038.001.0001CrossRefGoogle Scholar
McPherson, RS, Hoelscher, DM, Alexander, M et al. (2000) Dietary assessment methods among school-aged children: validity and reliability. Prev Med 31, S11S33.10.1006/pmed.2000.0631CrossRefGoogle Scholar
Cade, J, Thompson, R, Burley, V et al. (2002) Development, validation and utilisation of food-frequency questionnaires – a review. Public Health Nutr 5, 567587.10.1079/PHN2001318CrossRefGoogle ScholarPubMed
Magarey, A, Watson, J, Golley, RK et al. (2011) Assessing dietary intake in children and adolescents: considerations and recommendations for obesity research. Int J Pediatr Obes 6, 211.10.3109/17477161003728469CrossRefGoogle ScholarPubMed
Dietary Guidelines Advisory Committee (2015) Scientific Report of the 2015 Dietary Guidelines Advisory Committee: Advisory Report to the Secretary of Health and Human Services and the Secretary of Agriculture. Washington, DC: U.S. Department of Agriculture, Agricultural Research Service.Google Scholar
Livingstone, MB & Robson, PJ (2000) Measurement of dietary intake in children. Proc Nutr Soc 59, 279293.CrossRefGoogle ScholarPubMed
Tabacchi, G, Amodio, E, Di Pasquale, M et al. (2014) Validation and reproducibility of dietary assessment methods in adolescents: a systematic literature review. Public Health Nutr 17, 27002714.CrossRefGoogle ScholarPubMed
Kolodziejczyk, JK, Merchant, G & Norman, GJ (2012) Reliability and validity of child/adolescent food frequency questionnaires that assess foods and/or food groups. J Pediatr Gastroenterol Nutr 55, 413.10.1097/MPG.0b013e318251550eCrossRefGoogle ScholarPubMed
Rockett, HR & Colditz, GA (1997) Assessing diets of children and adolescents. Am J Clin Nutr 65, 1116S1122S.CrossRefGoogle ScholarPubMed
Pigeot, I, Baranowski, T & De Henauw, S (2015) The IDEFICS intervention trial to prevent childhood obesity: design and study methods. Obes Rev 16, Suppl. 2, 415.10.1111/obr.12345CrossRefGoogle ScholarPubMed
Moreno, LA, De Henauw, S, Gonzalez-Gross, M et al. (2008) Design and implementation of the Healthy Lifestyle in Europe by Nutrition in Adolescence Cross-Sectional Study. Int J Obes (Lond) 32, Suppl. 5, S411.CrossRefGoogle ScholarPubMed
Manios, Y, Androutsos, O, Katsarou, C et al. (2014) Designing and implementing a kindergarten-based, family-involved intervention to prevent obesity in early childhood: the ToyBox-study. Obes Rev 15, Suppl. 3, 513.CrossRefGoogle ScholarPubMed
Carvalho, HB, Moreno, LA, Silva, AM et al. (2018) Design and Objectives of the South American Youth/Child Cardiovascular and Environmental (SAYCARE) Study. Obesity (Silver Spring) 26, Suppl. 1, S5S13.CrossRefGoogle ScholarPubMed
Saravia, L, Gonzalez-Zapata, LI, Rendo-Urteaga, T et al. (2018) Development of a food frequency questionnaire for assessing dietary intake in children and adolescents in South America. Obesity (Silver Spring) 26, Suppl. 1, S31S40.CrossRefGoogle ScholarPubMed
United States Department of Agriculture, Agricultural Research Service USDA (2017) Food Composition Databases. https://ndb.nal.usda.gov/ndb/ (accessed March 2017).Google Scholar
International Network of Food Data Systems (INFOODS) Food and Agriculture Organization of the United Nations (2017) Latin American Food Composition Tables. http://www.fao.org/infoods/infoods/tablas-y-bases-de-datos/america-latina/es/ (accessed March 2017).Google Scholar
Food and Agriculture Organization of the United Nations & World Health Organization (2006) Joint FAO/WHO Food Standards Programme. Codex Classification of Foods and Animal Feeds. Draft Revision-1, pp. 49. Rome: Codex Alimentarius Commission.Google Scholar
Willett, WC, Sampson, L, Stampfer, MJ et al. (1985) Reproducibility and validity of a semiquantitative food frequency questionnaire. Am J Epidemiol 122, 5165.CrossRefGoogle ScholarPubMed
Landis, JR & Koch, GG (1977) The measurement of observer agreement for categorical data. Biometrics 33, 159174.10.2307/2529310CrossRefGoogle ScholarPubMed
Vioque, J, Gimenez-Monzo, D, Navarrete-Munoz, EM et al. (2016) Reproducibility and validity of a food frequency questionnaire designed to assess diet in children aged 4–5 years. PLoS One 11, e0167338.CrossRefGoogle ScholarPubMed
Lanfer, A, Hebestreit, A, Ahrens, W et al. (2011) Reproducibility of food consumption frequencies derived from the Children’s Eating Habits Questionnaire used in the IDEFICS study Int J Obes (Lond) 35, Suppl. 1, S61S68.CrossRefGoogle ScholarPubMed
Vereecken, CA & Maes, L (2003) A Belgian study on the reliability and relative validity of the Health Behaviour in School-Aged Children food-frequency questionnaire. Public Health Nutr 6, 581588.CrossRefGoogle Scholar
Saeedi, P, Skeaff, SA, Wong, JE et al. (2016) Reproducibility and relative validity of a short food frequency questionnaire in 9–10 year-old children. Nutrients 8, E721.10.3390/nu8050271CrossRefGoogle Scholar
Rockett, HR, Wolf, AM & Colditz, GA (1995) Development and reproducibility of a food frequency questionnaire to assess diets of older children and adolescents. J Am Diet Assoc 95, 336340.CrossRefGoogle ScholarPubMed
Metcalf, PA, Scragg, RKR, Sharpe, S et al. (2003) Short-term repeatability of a food frequency questionnaire in New Zealand children aged 1–14 y. Eur J Clin Nutr 57, 14981503.CrossRefGoogle ScholarPubMed
Marchioni, DML, Voci, SM, de Lima, FEL et al. (2007) Reproducibility of a food frequency questionnaire for adolescents. Cad Saude Publica 23, 21872196.10.1590/S0102-311X2007000900026CrossRefGoogle ScholarPubMed
Bel-Serrat, S, Mouratidou, T, Pala, V et al. (2014) Relative validity of the Children’s Eating Habits Questionnaire-food frequency section among young European children: the IDEFICS Study. Public Health Nutr 17, 266276.CrossRefGoogle ScholarPubMed
Truthmann, J, Mensink, GBM & Richter, A (2011) Relative validation of the KiGGS Food Frequency Questionnaire among adolescents in Germany. Nutr J 10, 133.10.1186/1475-2891-10-133CrossRefGoogle ScholarPubMed
Blum, RE, Wei, EK, Rockett, HR et al. (1999) Validation of a food frequency questionnaire in Native American and Caucasian children 1 to 5 years of age. Matern Child Health J 3, 167172.CrossRefGoogle ScholarPubMed
Cullen, KW, Watson, K & Zakeri, I (2008) Relative reliability and validity of the Block Kids Questionnaire among youth aged 10 to 17 years. J Am Diet Assoc 108, 862866.10.1016/j.jada.2008.02.015CrossRefGoogle ScholarPubMed
Poslusna, K, Ruprich, J, de Vries, JHM et al. (2009) Misreporting of energy and micronutrient intake estimated by food records and 24 hour recalls, control and adjustment methods in practice. Br J Nutr 101, S73S85.CrossRefGoogle ScholarPubMed
Molag, ML, de Vries, JHM, Ocke, MC et al. (2007) Design characteristics of food frequency questionnaires in relation to their validity. Am J Epidemiol 166, 14681478.10.1093/aje/kwm236CrossRefGoogle ScholarPubMed
Cade, JE, Burley, VJ, Warm, DL et al. (2004) Food-frequency questionnaires: a review of their design, validation and utilisation. Nutr Res Rev 17, 522.CrossRefGoogle ScholarPubMed
Rockett, HR, Breitenbach, M, Frazier, AL et al. (1997) Validation of a youth/adolescent food frequency questionnaire. Prev Med 26, 808816.10.1006/pmed.1997.0200CrossRefGoogle ScholarPubMed
Block, G & Hartman, AM (1989) Issues in reproducibility and validity of dietary studies. Am J Clin Nutr 50, 11331135.10.1093/ajcn/50.5.1133CrossRefGoogle ScholarPubMed
Bornhorst, C, Bel-Serrat, S, Pigeot, I et al. (2014) Validity of 24-h recalls in (pre-)school aged children: comparison of proxy-reported energy intakes with measured energy expenditure. Clin Nutr 33, 7984.CrossRefGoogle ScholarPubMed
Neuhouser, ML, Patterson, RE, Thornquist, MD et al. (2003) Fruits and vegetables are associated with lower lung cancer risk only in the placebo arm of the beta-carotene and retinol efficacy trial (CARET). Cancer Epidemiol Biomarkers Prev 12, 350358.Google Scholar
Figure 0

Fig. 1 Design of the reliability and validity analyses among children and adolescents of the SAYCARE study. *First 24HR with a nutritionist; included one weekend day. Referred to the last 3 months (24HDR, 24 h dietary recall; FFQ1, first FFQ application; FFQ2, second FFQ application)

Figure 1

Table 1 Main characteristics of the SAYCARE population for reliability and validity analyses

Figure 2

Table 2 Reliability of the SAYCARE FFQ

Figure 3

Table 3 Validity of the SAYCARE FFQ