- Research
- Open access
- Published:
Reliability and relative validity of a food frequency questionnaire to assess food group intakes in New Zealand adolescents
Nutrition Journal volume 11, Article number: 65 (2012)
Abstract
Background
Due to the absence of a current and validated food frequency questionnaire (FFQ) for use in New Zealand adolescents, there is a need to develop one as a cost-effective way to assess adolescents’ food patterns. This study aims to examine the test-retest reliability and relative validity of the New Zealand Adolescent FFQ (NZAFFQ) to assess food group intake in adolescents aged 14 to 18 years.
Methods
A non-quantitative (without portion size), 72-item FFQ was developed and pretested. Fifty-two participants (aged 14.9 ± 0.8 years) completed the NZAFFQ twice within a two-week period for test-retest reliability. Forty-one participants (aged 15.1 ± 0.9 years) completed a four-day estimated food record (4DFR) in addition to the FFQs to enable assessment of validity. Spearman’s correlations and cross-classification analyses were used to examine relative validity while intra-class correlations were additionally used for test-retest reliability.
Results
Weekly intakes were estimated for each food item and aggregated into 34 food groups. The median Spearman’s correlation coefficient (SCC) between FFQ administrations was 0.71. SCCs ranged from 0.46 for fruit juice or cordial to 0.87 for non-standard milk. The median intra-class correlation coefficient (ICC) between FFQ administrations was 0.69. The median SCC between food groups from the FFQ and the 4DFR was 0.40 with the highest SCC seen for standard milk (0.70). The exact agreement between the methods in ranking participants into thirds was highest for meat alternatives (78%), but lowest for red or yellow vegetables and potatoes (27%). The mean percent of participants misclassified into extreme thirds for food group intake was 12%.
Conclusions
Despite a small sample size, the NZAFFQ exhibited good to excellent short-term test-retest reliability and reasonable validity in ranking the majority of the food group intakes among adolescents aged 14 to 18 years. The comparability of the validity to that in the current literature suggests that the NZAFFQ may be used among adolescent New Zealanders to identify dietary patterns and rank them according to food group intake.
Background
The diet of adolescents, which is long known to be important for their growth and development, is now recognized as also important to their future health [1]. It is a major modifiable risk factor in the prevention of obesity and development of chronic diseases such as cardiovascular disease and cancer in adulthood [2, 3]. The diet of adolescents in Western countries has been frequently described as being poor, with low consumption of dairy, fruits, vegetables and grains and high consumption of soft drinks and sweets [4–8]. Taken together, these issues heighten the need to accurately and reliably assess the food intake of adolescents, so as to allow for assessment of dietary patterns and diet quality in relation to future education and intervention. In order to do this appropriate methods for collecting dietary information from adolescents are needed. In New Zealand, information on the dietary intakes of adolescents has been collected in national surveys using in-depth measures such as a 24-hour dietary recall in combination with a food frequency questionnaire which had been tested for repeatability only [9]. However, the cost of such methods makes them prohibitive for use in all large scale studies. Therefore other suitable methods of obtaining dietary information from New Zealand adolescents are needed.
Considerations must be made when selecting appropriate dietary assessment methods for adolescents. Although most adolescents possess the literacy skills necessary for reliable self-reporting, accuracy of dietary assessment in this age group is affected by factors such as motivation to complete assessments and reporting bias associated with unstructured eating patterns, concerns with body image and weight status [10–12]. Besides these adolescent-specific issues, the study design, outcomes of interest and available resources need to be taken into consideration when selecting an appropriate dietary assessment tool for a study [13, 14].
Food frequency questionnaires (FFQs), being relatively easy to administer and less onerous than other dietary assessment methods, appear to be a practical and affordable method for studying diets of adolescents [15]. They have been used successfully in large population studies and have been found to be valid and reliable tools for ranking food intakes of adolescents [16–18]. The major limitation of an FFQ lies in the measurement errors pertaining to an incomplete food list and inaccuracies in frequency and portion size estimation. In particular, the complex cognitive process of portion size estimation may pose additional challenges to adolescents who consume varying portion sizes across meals [19] and are less likely to pay attention to portion sizes than adults [10]. Although quantification skills may improve with intensive training and the use of age-appropriate food photograph aids [20, 21], inclusion of portion size questions in an FFQ may increase respondent burden and lead to data omission, and hence contribute only marginally beyond frequency data in improving validity of an FFQ [22, 23]. Therefore, recent research in this area has focused on the development of non-quantitative FFQs (without collection of portion size information) as targeted dietary assessment tools to rank individuals by intake of specific food groups, nutrients or dietary patterns rather than providing absolute values for foods and/or nutrients [13, 24]. Besides providing information on usual intakes of a particular food or food groups of interest, such FFQs are particularly useful in identifying dietary patterns at the population level [25, 26].
In addition to considering which type of FFQ (quantitative or non-quantitative) is most useful for a study, it is vital that any FFQ must be shown to be reliable and valid for use in the population of interest. An FFQ should also be designed to meet the aims of specific study populations and contain an up-to-date list of foods [27]. Although some FFQs exist for use in adolescents [18, 28], they contain extensive food lists (more than 100 items) and portion size questions, which may not be relevant to the New Zealand context.
As there is currently no reliable, valid and up to date FFQ for use in New Zealand adolescents the aims of this study were to: (i) adapt an FFQ to assess food group intakes in New Zealand adolescents aged 14 to 18 years for use in future studies; (ii) determine short-term reliability of this FFQ, and (iii) determine the relative validity of this FFQ compared to an estimated food record.
Methods
Development of the New Zealand Adolescent FFQ (NZAFFQ)
This study was approved by the University of Otago Human Ethics Committee. A paper-based, three section adolescent-specific food questionnaire was developed. The food questionnaire is made up of three sections: The first section contains 12 multiple-choice questions on general eating habits, including intakes of food group servings, meal consumption patterns and frequency of takeaway consumption. These questions were adapted from previously published questionnaires [29, 30]. This study focusses on the validity of the FFQ (sections 2 and 3 of the food questionnaire), namely the New Zealand Adolescent FFQ (NZAFFQ).
The NZAFFQ was produced by combining and modifying the Health Behaviour in School-aged Children (HBSC) FFQ [24] and the Children’s Dietary Questionnaire (CDQ) [26]. These FFQs were developed to describe food patterns, but not nutrient intakes, of children and adolescents (4 to 16 years), and therefore contain only a limited list of food items. In particular, the HBSC FFQ included 15 items covering the most commonly consumed foods known to be important sources of fibre and calcium among European youth. The CDQ included 28 items described as ‘encouraged foods’ (fruits, vegetables, water, reduced fat products) and ‘discouraged foods’ (high fat or sugar foods, sweetened beverages and full fat dairy products) for adolescents in Australia. These two validated questionnaires formed the basic construct of the NZAFFQ as they covered different important aspects (i.e. variety and intake frequency) of an adolescent’s diet and have been used to derive index-based dietary patterns [26, 31, 32].
Section 2 of the food questionnaire assessed ‘usual consumption’ of 32 food items, covering 15 items from the HBSC FFQ [24] and included extra questions on food groups relevant to the New Zealand adolescent population. Changes to the original HBSC FFQ included the addition of questions on consumption of meats and different types of soft drinks. As in the original HBSC FFQ, frequency of intake was estimated by asking “On average, how many times a week do you usually eat or drink……” and participants could select one of the following response categories: ‘none’, ‘less than once a week’, ‘once per week’, ‘2 to 4 days a week’, ‘5 to 6 days a week’, ‘once a day’, and ‘more than once a day’. Although a specific time frame for ‘usual’ was not defined, we believed that this was likely to cover the period of the previous four weeks, based on results of our pretesting group interviews. For the last section of the NZAFFQ (Section 3), we assessed intakes of 13 fruits, 22 vegetables and 7 miscellaneous foods consumed in the past seven days, as in the original CDQ [26]. Modifications to the original format included renaming and regrouping of conceptually similar food items to ensure the suitability of the food items to New Zealand. For example, ‘sweet potato’ was renamed as the locally known Māori name ‘kumara’ while ‘orange’ and ‘mandarin’ were grouped together as one item. Section 3 assessed ‘most current intake’ (in the past week) to reduce the difficulty of recall and accommodate seasonality and availability of foods [33].
Further revisions were also made to ensure that the food lists in sections 2 and 3 covered the foods frequently consumed in New Zealand including those indicated in the 2002 National Children’s Nutrition Survey [9]. To improve face validity of the NZAFFQ, two registered dietitians and a nutritionist were consulted to review this FFQ before formal pretesting.
Pretesting of the NZAFFQ in group interviews
The NZAFFQ was pre-tested in a sample of 29 adolescents (13 males, 16 females) aged 14 to 15 years recruited from one secondary school in Dunedin, Otago. The day before the pretesting, participants were asked to complete the FFQs and answer feedback questionnaires about their comprehension of the NZAFFQ questions. Two group interviews (one for males, one for females) were conducted, each moderated by a trained research assistant, with additional observers present to identify further discussion questions based on feedback from the group. The main focus of the group interview was to obtain details on the participants’ understanding of the questions, the food items listed and examples. The group discussions were audio recorded and transcribed so that the feedback could be used to further refine the FFQ. The final NZAFFQ included 74 food items as either (i) single foods (e.g. yoghurt), or (ii) lists of similar foods (e.g. chicken, turkey or duck). For analysis, these foods were subsequently aggregated into 34 food groups of interest by grouping similar items as had been done in other studies [34, 35] (Table 1).
Validation of the NZAFFQ
A convenience sample of adolescents aged 14 to 18 years was recruited to participate in the validation study via schools, sports clubs and youth groups in Dunedin based on the following inclusion criteria: aged between 14 and 18 years, absence of any disease that may influence nutritional status, ability to keep a food record, and those whose parents did not complete an opt-out consent form. All participants also provided written informed consent before participating in the study. Data collection was conducted in two periods from November to early December 2010 and March to May 2011.
NZAFFQ and estimated food record
Each participant was asked to keep a four-day estimated food record (4DFR) and complete the NZAFFQ twice within a fortnight. On the first visit day, each participant was asked to self-complete an FFQ in the presence of a research assistant. After the FFQs were checked for completeness and missing answers were obtained, participants were given verbal and written instructions on how to complete a structured Food and Drink diary for three weekdays and one weekend day. To facilitate accurate recording, the instructions incorporated standardized examples on the methods of recording and the food record was structured into six daily eating occasions. On each page, spaces were provided for recording of meal times, venue, whom the participants ate with, details of foods consumed including type, brand and amount of foods or beverages consumed. In addition, each participant was taught to use the portion aid kit provided for recording food quantities. The portion aid kit included a metric measuring cup, ruler, diameter circle and a coloured food photo booklet, which contained photographs of commonly consumed foods in different portion sizes [36]. At the end of the four-day record, participants answered supplementary questions on the type of sweetened drink, milk, bread and fat spread that they usually consumed. This qualitative information was collected to assist with coding of the food records. All food records received were checked for completeness. Participants were asked to clarify missing and unclear entries whenever possible. Within two weeks after the first completion of the NZAFFQ, all participants were asked to repeat the NZAFFQ for a second time to assess test-retest reliability. Based on results of previous research of FFQ repeatability conducted in New Zealand children [37], this two-week interval was chosen in order to minimize the variation in food intake responses due to true changes over time.
Data and statistical analysis
All data were entered into a Microsoft Excel spreadsheet and checked by a trained nutritionist. Recorded food items in the 4DFR were matched to the items as defined by the NZAFFQ. An example of this was ‘hash browns’ from the 4DFR assigned to ‘fried potatoes’ in the NZAFFQ. Food items within a composite meal were each allocated a proportion of the meal then assigned to their relevant food or food groups. For instance, a chicken burger was recorded to the three corresponding foods in the NZAFFQ: white bread/bun, poultry and lettuce/salad greens. All frequencies obtained from the 4DFR were adjusted to provide average weekly intakes. Food intakes were described as frequencies of intake (days per week) and used as the unit of comparison between the NZAFFQ and the 4DFR.
Spearman’s rank correlations were performed to evaluate the validity of the first FFQ administration (FFQtime1) relative to the 4DFR for ranking participants by frequency of consumption of the 34 food groups. Following grouping of participants into thirds, cross-classification analyses were undertaken to examine the proportion of participants correctly classified into the same thirds or grossly misclassified into extreme thirds of intake. For reliability (FFQtime1 vs. FFQtime2), intraclass correlation coefficients (ICCs) were calculated in addition to Spearman’s correlation analyses. Because ICCs take account of within- and between-subject variability in responses, it was deemed the most appropriate test to examine the agreement between the repeated FFQs in ranking individuals by food group intakes. All statistical analyses were performed using the statistical program STATA 11.1 (StataCorp, College Station, TX, USA). Significance levels for all tests were set at p < 0.05.
Results
Sample
Of the 78 participants who volunteered to take part in this study, 38 (49%) participants completed both the 4DFR and two replications of the NZAFFQ. Fourteen participants (18%) completed two NZAFFQs only while three participants (4%) completed the 4DFR and the FFQtime1. More males than females did not complete all parts of this study (p = 0.006) but there were no differences in demographic or anthropometric data between those who completed all parts of the study and those who did not (data not shown). In total, 41 participants (16 males, 25 females) were included in the validity study while 52 participants (28 males, 24 females) were included in the reliability study. Participants were aged 15.0 ± 0.8 years (range 14.0 to 17.9 years). The mean time interval between test-retest administrations of the NZAFFQ was 12 days.
Test-retest reliability (FFQtime1 vs. FFQtime2)
The median Spearman’s correlation coefficient (SCC) between the two administrations of the NZAFFQ was 0.71, and SCCs ranged from 0.46 for fruit juice or cordial to 0.87 for non-standard milk (Table 2). The median ICC was 0.69 (range 0.26-0.92) and 71% (24 of 34) of the food groups had ICCs above 0.6. At least 46% of participants were correctly classified into the same thirds for all food groups. No food groups had levels of gross misclassification above 10 percent, with the exception of meat alternatives (17%) and rice, pasta or noodles (25%).
Relative validity (FFQtime1 vs. 4DFR)
As shown in Table 2, SCCs above 0.3 were seen for over two-thirds (23) of the 34 food groups in the FFQ. The median SCC was 0.40, and individual SCCs ranged from 0.04 for convenience foods to 0.70 for standard milk (whole-fat milk). High correlations (SCC ≥ 0.50) were observed for breakfast cereals, milk (standard and non-standard), eggs, sweet bakery products and sweet snack bars. Overall, the exact agreement between the methods in ranking participants into thirds was highest for meat alternatives (78%), but lowest for red or yellow vegetables and potatoes (27%). The mean percent misclassified into extreme thirds for all food groups was 12%.
Discussion
In the present study, the short-term reliability of a non-quantitative FFQ (NZAFFQ) was established by comparing two administrations of the FFQ over a two-week period while relative validity was established against a 4DFR.
The results of this study demonstrated that the NZAFFQ yielded good test-retest reliability. The median ICC of 0.69 (range 0.26-0.92) compared favorably to those reported in previous studies in adolescent populations (ICC range 0.01-0.83) [38–40]. The median SCC was 0.71, with all food groups achieving Spearman’s correlations above 0.46. This reliability fell within a range considered good for an FFQ (0.50–0.80) [27, 41] and was similar to the reliability of the CNS02 FFQ, the only previous FFQ designed for New Zealand children [37]. The median test-retest correlation for the CNS02 FFQ for food servings was 0.73, ranging from 0.54 for mixed meat dishes to 0.89 for convenience meals in the 10–14 year age group (n = 42). As indicated by the ICC, we found that foods that were consumed regularly (e.g. milky or chocolate drinks) were recalled with more consistency than foods that were consumed occasionally or variably (e.g. red meat, processed meats and poultry), as observed in previous studies [17, 42, 43]. We acknowledge that the two-week interval between the administration of the NZAFFQs may have led to overestimation of the reliability of this FFQ.
Some variation was seen in the levels of validity between food groups. Among 34 food groups, most food groups (67%) yielded SCCs between 0.32 and 0.70 while 11 food groups produced correlations below 0.30. In particular, the NZAFFQ was less accurate in estimating the group intakes of some vegetables (cruciferous, green leafy, red or yellow vegetables and potatoes), fruits and red meat and processed meat. There are several possible explanations for this observed poor validity for these food groups.
Firstly, within-participant intakes of fruits, vegetables and meats were shown to be highly variable [44]. It is therefore possible that some of the food items consumed occasionally or episodically were not being consumed during the four-day recording period. This is a known limitation when a reference method that covers only a limited period of time is used to validate an FFQ [45]. Notably, 64% of vegetables, 85% of fruits and 64% of meat groups were consumed ‘once a week or less’ by more than two-thirds of the participants. These foods each had a 54% chance of not being consumed during the recording period. Although extending the number of recording days may potentially improve the correlations, this would have caused reporting fatigue and reduced the quality and completion of the food records [19].
Secondly, we noted that different recording methods and time frame might have attenuated the correlations between the NZAFFQ and the 4DFR. For the NZAFFQ, a particular food eaten both alone and in mixed dishes was recorded in a combined frequency. Conversely for the 4DFR, mixed dishes were recorded then segregated into their component foods and apportioned to their matching food groups. Because of this, foods often consumed as part of mixed dishes such as red or yellow vegetables (e.g. tomatoes and capsicum), red meat and processed meat (e.g. sausage) may either be forgotten (thus underestimated in the NZAFFQ) or miscoded in the food records due to insufficient information [7, 46]. In addition, following recommendations by Cade and colleagues [27], the FFQtime1 was administered before the 4DFR to eliminate learning effects from completion of a more onerous dietary method. As the NZAFFQ asked about ‘past seven days’ intakes for fruits and vegetables (in Section 3), it assessed diet retrospectively over a slightly different time span from the reference method. These issues of methodological difference between the two dietary methods (i.e. coding decisions and reference period) may have had a negative impact on the correlations of the food group intakes. It is also important to acknowledge that using FFQtime1 in validity analyses could potentially result in an underestimation of validity.
Comparison with other studies
Although validation studies of FFQs in adolescents have been previously reported, most studies validated their FFQs in terms of nutrients or absolute food intakes [47, 48]. Since this study focused on validating the actual responses of intake frequency, precise comparisons of this study with existing studies are not possible. One exception is a study by Vereecken and Maes [24], which validated a 15-item HBSC FFQ against a 7-day food diary using a similar approach to this study. These same 15 food items were included in the present NZAFFQ. A direct comparison of the two studies revealed that the NZAFFQ showed similar reliability (mean SCC = 0.71) compared to the original HBSC FFQ validation study (mean SCC = 0.67) for the 15 food items. Likewise, the validity of most food items was comparable to those of the original HBSC FFQ (mean SCC = 0.41), achieving an average SCC of 0.38. Vereecken and Maes found high correlations for milk (whole and semi-skimmed) and brown bread (SCC = 0.51-0.65) but low correlations for crisps, diet soft drinks, sweets and fruits (SCC = 0.10–0.34). Similarly, our study showed that validity was good for milk and breakfast cereals (SCC = 0.59-0.70), but less favorable for soft drinks (regular and diet), chips, crisps and sweets (SCC = 0.06-0.30). The most striking observation that emerged from the data comparison was the rather low validity for foods perceived as being ‘less healthy’. We speculate that these foods may be underreported in the NZAFFQ due to social undesirability [49]. This is evident for regular soft drinks where 50% of participants who reported usual consumption of ‘once or less per week’ in the NZAFFQ specified intake on two or more days during their 4-day recording periods.
Strengths and limitations
This study has several strengths and limitations. The main limitation of this study was the small sample size (n = 41), which may have limited the observation of significant correlations in food group intakes. Previous authors have suggested that a sample size of at least 50 is desirable [27], and ideally a sample of between 100 and 200 should be used, particularly if the FFQ is designed to provide information on nutrient intakes [41]. Although the recruitment deadlines were shifted several times, it was difficult to recruit more participants. A high percent (47%) of those recruited failed to complete the study due to the demanding task of keeping a 4DFR, even though estimated rather than weighed records were used. Our low compliance rate fell within the response range of 48% to 60% typically observed in previous validation studies of adolescents [19, 50, 51]. The sample in our study may comprise participants who were highly motivated; hence generalizability of these findings to other adolescent populations in New Zealand may be limited. On the other hand, this reinforces the clear need to develop a simple FFQ to accurately assess diet among adolescents, including those who are unlikely to provide high quality food records.
In the absence of an absolute gold standard for dietary assessment, we chose an estimated food record as the reference method. This method is advantageous in its ability to capture all food intakes without the reliance of memory and hence has the fewest correlated errors with an FFQ [52]. Additional effort was taken to prepare the Food and Drink Diary as an easy-to-carry booklet to facilitate recording ‘in situ’. Although participants were instructed to conduct recording ‘at the time’ of food and beverage consumption, we acknowledge that this may not be entirely possible. Food underestimation may still occur due to forgetfulness and the limited food knowledge among adolescents [47, 53, 54]. In addition, as the present NZAFFQ also assesses food intakes in the past, the different time frame between the FFQs and the food records may have had an effect on the correlations. Nevertheless, we found similar correlations between this study and other studies with overlapped time frame [38, 39, 44].
The strength of this study lies in the design of a non-quantitative FFQ, which is relatively short and practical for use in time-limited surveys where detailed measures of food intakes are not feasible. We attempted to address the limited motivation and portion size estimation skills among adolescents by omitting the requirement to provide food quantities in the NZAFFQ. As a result, this FFQ was highly repeatable and could be self-completed within 15 minutes. The median SCC of 0.40 obtained from this study was comparable to other validation studies of quantitative FFQs in adolescent populations [38, 44, 50]. Encompassing a wide range of food items from different food groups, this FFQ may offer a viable approach to measure diet diversity and derive dietary patterns or diet quality indices in large studies of adolescents. Whilst the intended use of the NZAFFQ is to assess food group intakes of adolescents in New Zealand, there is a potential for the frequency data to be used alongside other more intensive dietary assessment methods such as the 24-hour diet recall to estimate usual intake [55]. As it was adapted from previously validated questionnaires and pretested rigorously, we believe that the food list sufficiently covers the common foods consumed by New Zealand adolescents and is hence suitable to assess food group intakes in this age group.
Conclusions
Despite a small sample size, the NZAFFQ exhibited good to excellent test-retest reliability and reasonable validity in ranking intakes for a majority of the food groups. This positive finding raises the possibility that the true ability of the NZAFFQ to rank food intakes in adolescents is greater than that shown by our data. Based on the present study, we recommend that the NZAFFQ is appropriate for ranking participants according to food group intake and may be applied in future studies to assess dietary patterns of adolescents aged 14 to 18 years.
Consent
All participants provided written informed consent before participating in the study. Parents were only required to provide opt-out consent on behalf of their child.
Abbreviations
- FFQ:
-
Food frequency questionnaire
- NZAFFQ:
-
New Zealand Adolescent Food Frequency Questionnaire
- FFQTime1:
-
First administration of the NZAFFQ
- 4DFR:
-
Four-day estimated food records
- HBSC:
-
Health Behaviour in School-aged Children
- CDQ:
-
Children’s Dietary Questionnaire
- SCC:
-
Spearman’s correlation coefficient
- ICC:
-
Intra-class correlation coefficient
- %CC:
-
Percent correctly classified
- %GM:
-
Percent grossly misclassified.
References
Ministry of Health: Food and Nutrition Guidelines for Healthy Children and Young People (Aged 2–18 Years): A background paper: Draft for Consultation. 2010, Wellington
Kavey RE, Daniels SR, Lauer RM, Atkins DL, Hayman LL, Taubert K, American Heart A: American Heart Association guidelines for primary prevention of atherosclerotic cardiovascular disease beginning in childhood. Circulation. 2003, 107: 1562-1566. 10.1161/01.CIR.0000061521.15730.6E.
Linos E, Willett WC, Cho E, Frazier L: Adolescent diet in relation to breast cancer risk among premenopausal women. Cancer Epidemiol Biomarkers Prev. 2010, 19: 689-696. 10.1158/1055-9965.EPI-09-0802.
Neumark-Sztainer D, Story M, Hannan PJ, Croll J: Overweight status and eating patterns among adolescents: where do youths stand in comparison with the healthy people 2010 objectives?. Am J Public Health. 2002, 92: 844-10.2105/AJPH.92.5.844.
Nicklas TA, Baranowski T, Cullen KW, Berenson G: Eating patterns, dietary quality and obesity. J Am Coll Nutr. 2001, 20: 599-608.
Vereecken CA, De Henauw S, Maes L: Adolescents' food habits: results of the Health Behaviour in School-aged Children survey. Br J Nutr. 2005, 94: 423-431. 10.1079/BJN20051513.
Rockell JE, Skidmore PM, Parnell WR, Wilson N: What children eat during afternoons and evenings: is it important?. Public Health Nutr. 2011, 14: 557-562. 10.1017/S1368980010003277.
Diethelm K, Jankovic N, Moreno LA, Huybrechts I, De Henauw S, De Vriendt T, Gonzalez-Gross M, Leclercq C, Gottrand F, Gilbert CC, et al: Food intake of European adolescents in the light of different food-based dietary guidelines: results of the HELENA (Healthy Lifestyle in Europe by Nutrition in Adolescence) Study. Public Health Nutr. 2012, 15: 386-398. 10.1017/S1368980011001935.
Parnell E, Scragg R, Wilson N, Schaaf D, Fitzgerald E: NZ Food NZ Children: Key results of the 2002 National Children's Nutrition Survey. 2003, Wellington
Livingstone MB, Robson PJ: Measurement of dietary intake in children. Proc Nutr Soc. 2000, 59: 279-293. 10.1017/S0029665100000318.
Livingstone MB, Robson PJ, Wallace JM: Issues in dietary intake assessment of children and adolescents. Br J Nutr. 2004, 92 (Suppl 2): S213-S222.
Thompson FE, Subar AF: Dietary assessment methodology. Nutrition in the Prevention and Treatment of Disease. 2. Edited by: Coulston AM, Boushey CJ. 2008, San Diego: Academic Press, 1-38.
Magarey A, Watson J, Golley RK, Burrows T, Sutherland R, McNaughton SA, Denney-Wilson E, Campbell K, Collins C: Assessing dietary intake in children and adolescents: Considerations and recommendations for obesity research. Int J Pediatr Obes. 2011, 6: 2-11.
Moreno LA, Kersting M, de Henauw S, Gonzalez-Gross M, Sichert-Hellert W, Matthys C, Mesana MI, Ross N: How to measure dietary intake and food habits in adolescence: the European perspective. Int J Obes. 2005, 29: S66-S77.
Rockett HR, Berkey CS, Colditz GA: Evaluation of dietary assessment instruments in adolescents. Curr Opin Clin Nutr Metab Care. 2003, 6: 557-562. 10.1097/00075197-200309000-00009.
Berkey CS, Rockett HR, Field AE, Gillman MW, Frazier AL, Camargo CA, Colditz GA: Activity, dietary intake, and weight changes in a longitudinal study of preadolescent and adolescent boys and girls. Pediatrics. 2000, 105: E56-10.1542/peds.105.4.e56.
Frank GC, Nicklas TA, Webber LS, Major C, Miller JF, Berenson GS: A food frequency questionnaire for adolescents: defining eating patterns. J Am Diet Assoc. 1992, 92: 313-318.
Rockett HR, Breitenbach M, Frazier AL, Witschi J, Wolf AM, Field AE, Colditz GA: Validation of a youth/adolescent food frequency questionnaire. Prev Med. 1997, 26: 808-816. 10.1006/pmed.1997.0200.
Watanabe M, Yamaoka K, Yokotsuka M, Adachi M, Tango T: Validity and reproducibility of the FFQ (FFQW82) for dietary assessment in female adolescents. Public Health Nutr. 2011, 14: 297-305. 10.1017/S1368980010001618.
Lillegaard ITL, Overby NC, Andersen LF: Can children and adolescents use photographs of food to estimate portion sizes?. Eur J Clin Nutr. 2005, 59: 611-617. 10.1038/sj.ejcn.1602119.
Foster E, Matthews JN, Nelson M, Harris JM, Mathers JC, Adamson AJ: Accuracy of estimates of food portion size using food photographs–the importance of using age-appropriate tools. Public Health Nutr. 2006, 9: 509-514.
Buzzard IM, Stanton CA, Figueiredo M, Fries EA, Nicholson R, Hogan CJ, Danish SJ: Development and reproducibility of a brief food frequency questionnaire for assessing the fat, fiber, and fruit and vegetable intakes of rural adolescents. J Am Diet Assoc. 2001, 101: 1438-1446. 10.1016/S0002-8223(01)00347-9.
Schlundt DG, Buchowski MS, Hargreaves MK, Hankin JH, Signorello LB, Blot WJ: Separate estimates of portion size were not essential for energy and nutrient estimation: results from the Southern Community Cohort food-frequency questionnaire pilot study. Public Health Nutr. 2007, 10: 245-251.
Vereecken CA, Maes L: A Belgian study on the reliability and relative validity of the Health Behaviour in School-Aged Children food-frequency questionnaire. Public Health Nutr. 2003, 6: 581-588.
Lazarou C, Panagiotakos DB, Matalas AL: Foods E-KINDEX: a dietary index associated with reduced blood pressure levels among young children: the CYKIDS study. J Am Diet Assoc. 2009, 109: 1070-1075. 10.1016/j.jada.2009.03.010.
Magarey A, Golley R, Spurrier N, Goodwin E, Ong F: Reliability and validity of the Children's Dietary Questionnaire; a new tool to measure children's dietary patterns. Int J Pediatr Obes. 2009, 4: 257-265. 10.3109/17477160902846161.
Cade J, Thompson R, Burley V, Warm D: Development, validation and utilisation of food-frequency questionnaires - a review. Public Health Nutr. 2002, 5: 567-587. 10.1079/PHN2001318.
Watson JF, Collins CE, Sibbritt DW, Dibley MJ, Garg ML: Reproducibility and comparative validity of a food frequency questionnaire for Australian children and adolescents. Int J Behav Nutr Phys Act. 2009, 6: 62-10.1186/1479-5868-6-62.
United States Department of Health and Human Services, Health Resources and Services Administration, Maternal and Child Health Bureau, World Health Organization: Health Behavior in School-Aged Children, 2001–2002. Health Behavior in School-Aged Children (2008), 2001–2002. 2008, http://dx.doi.org/10.3886/ICPSR04372.v2,
University of Otago, Ministry of Health: A Focus on Nutrition: Key findings of the 2008/09 New Zealand Adult Nutrition Survey. 2011, Wellington
Vereecken CA, Rossi S, Giacchi MV, Maes L: Comparison of a short food-frequency questionnaire and derived indices with a seven-day diet record in Belgian and Italian children. Int J Public Health. 2008, 53: 297-305.
Yannakoulia M, Karayiannis D, Terzidou M, Kokkevi A, Sidossis LS: Nutrition-related habits of Greek adolescents. Eur J Clin Nutr. 2004, 58: 580-586. 10.1038/sj.ejcn.1601849.
Subar AF, Thompson FE, Smith AF, Jobe JB, Ziegler RG, Potischman N, Schatzkin A, Hartman A, Swanson C, Kruse L, et al: Improving food frequency questionnaires: a qualitative approach using cognitive interviewing. J Am Diet Assoc. 1995, 95: 781-788. 10.1016/S0002-8223(95)00217-0.
Ambrosini GL, O'Sullivan TA, de Klerk NH, Mori TA, Beilin LJ, Oddy WH: Relative validity of adolescent dietary patterns: a comparison of a FFQ and 3 d food record. Br J Nutr. 2011, 105: 625-633. 10.1017/S0007114510004137.
Bradlee ML, Singer MR, Qureshi MM, Moore LL: Food group intake and central obesity among children and adolescents in the Third National Health and Nutrition Examination Survey (NHANES III). Public Health Nutr. 2010, 13: 797-805. 10.1017/S1368980009991546.
Departmant of Human Nutrition: Diet Assessment Photos. 2000, Dunedin
Metcalf PA, Scragg RK, Sharpe S, Fitzgerald ED, Schaaf D, Watts C: Short-term repeatability of a food frequency questionnaire in New Zealand children aged 1–14 y. Eur J Clin Nutr. 2003, 57: 1498-1503. 10.1038/sj.ejcn.1601717.
Cullen KW, Watson K, Zakeri I: Relative reliability and validity of the Block Kids Questionnaire among youth aged 10 to 17 years. J Am Diet Assoc. 2008, 108: 862-866. 10.1016/j.jada.2008.02.015.
Deschamps V, de Lauzon-Guillain B, Lafay L, Borys JM, Charles MA, Romon M: Reproducibility and relative validity of a food-frequency questionnaire among French adults and adolescents. Eur J Clin Nutr. 2009, 63: 282-291. 10.1038/sj.ejcn.1602914.
Xia W, Sun C, Zhang L, Zhang X, Wang J, Wang H, Wu L: Reproducibility and relative validity of a food frequency questionnaire developed for female adolescents in Suihua, North China. PLoS ONE. 2011, 6: e19656-10.1371/journal.pone.0019656.
Willett W, Lenart E: Reproducibility and validity of food-frequency questionnaires. Nutritional Epidemiology. Edited by: Willett W. 1998, Oxford: Oxford University Pres
Lanfer A, Hebestreit A, Ahrens W, Krogh V, Sieri S, Lissner L, Eiben G, Siani A, Huybrechts I, Loit HM, et al: Reproducibility of food consumption frequencies derived from the Children's Eating Habits Questionnaire used in the IDEFICS study. Int J Obes. 2011, 35 (Suppl 1): S61-S68.
Speck BJ, Bradley CB, Harrell JS, Belyea MJ: A food frequency questionnaire for youth: psychometric analysis and summary of eating habits in adolescents. J Adolesc Health. 2001, 28: 16-25. 10.1016/S1054-139X(00)00171-3.
Field AE, Peterson KE, Gortmaker SL, Cheung L, Rockett H, Fox MK, Colditz GA: Reproducibility and validity of a food frequency questionnaire among fourth to seventh grade inner-city school children: implications of age and day-to-day variation in dietary intake. Public Health Nutr. 1999, 2: 293-300.
Tooze JA, Midthune D, Dodd KW, Freedman LS, Krebs-Smith SM, Subar AF, Guenther PM, Carroll RJ, Kipnis V: A new statistical method for estimating the usual intake of episodically consumed foods with application to their distribution. J Am Diet Assoc. 2006, 106: 1575-1587. 10.1016/j.jada.2006.07.003.
Haftenberger M, Heuer T, Heidemann C, Kube F, Krems C, Mensink GB: Relative validation of a food frequency questionnaire for national health and nutrition monitoring. Nutr J. 2010, 9: 36-10.1186/1475-2891-9-36.
Kobayashi T, Kamimura M, Imai S, Toji C, Okamoto N, Fukui M, Date C: Reproducibility and validity of the food frequency questionnaire for estimating habitual dietary intake in children and adolescents. Nutr J. 2011, 10: 27-10.1186/1475-2891-10-27.
Rockett HR, Berkey CS, Colditz GA: Comparison of a short food frequency questionnaire with the Youth/Adolescent Questionnaire in the Growing Up Today Study. Int J Pediatr Obes. 2007, 2: 31-39. 10.1080/17477160601095417.
Rodríguez G, Sjöberg A, Lissner L, Moreno LA: Food Patterns and Nutrient Intake in Relation to Childhood Obesity. Epidemiology of Obesity in Children and Adolescents. Edited by: Moreno LA, Pigeot I, Ahrens W. 2011, New York: Springer, 329-346.
Matthys C, Pynaert I, De Keyzer W, De Henauw S: Validity and reproducibility of an adolescent web-based food frequency questionnaire. J Am Diet Assoc. 2007, 107: 605-610. 10.1016/j.jada.2007.01.005.
Robinson S, Skelton R, Barker M, Wilman C: Assessing the diet of adolescent girls in the UK. Public Health Nutr. 1999, 2: 571-577.
Willett W: Nutritional Epidemiology. 1998, New York: Oxford University Press, 2
Araujo MC, Yokoo EM, Pereira RA: Validation and calibration of a semiquantitative food frequency questionnaire designed for adolescents. J Am Diet Assoc. 2010, 110: 1170-1177. 10.1016/j.jada.2010.05.008.
Truthmann J, Mensink GB, Richter A: Relative validation of the KiGGS Food Frequency Questionnaire among adolescents in Germany. Nutr J. 2011, 10: 133-10.1186/1475-2891-10-133.
Subar AF, Dodd KW, Guenther PM, Kipnis V, Midthune D, McDowell M, Tooze JA, Freedman LS, Krebs-Smith SM: The food propensity questionnaire: concept, development, and validation for use as a covariate in a model to estimate usual food intake. J Am Diet Assoc. 2006, 106: 1556-1563. 10.1016/j.jada.2006.07.002.
Acknowledgements
We would like to thank all schools, sports clubs, youth groups and participants who took part in this research. We are sincerely grateful to everyone who was involved in the data collection. This study was supported by grants from the National Heart Foundation New Zealand, Lottery Health New Zealand and the University of Otago.
Author information
Authors and Affiliations
Corresponding author
Additional information
Competing interests
The authors declare that they have no competing interests.
Authors' contributions
All authors were responsible for conception of the study, study design and set up. JW, KB and PS were responsible for data collection. JW entered and analyzed the data and drafted the manuscript. All authors were involved with data interpretation, critical revisions of the paper and provided approval for its publication. All authors read and approved the final manuscript.
Rights and permissions
Open Access This article is published under license to BioMed Central Ltd. This is an Open Access article is distributed under the terms of the Creative Commons Attribution License ( https://creativecommons.org/licenses/by/2.0 ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
About this article
Cite this article
Wong, J.E., Parnell, W.R., Black, K.E. et al. Reliability and relative validity of a food frequency questionnaire to assess food group intakes in New Zealand adolescents. Nutr J 11, 65 (2012). https://doi.org/10.1186/1475-2891-11-65
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/1475-2891-11-65