- Open Access
Validation and reproducibility of a new iodine specific food frequency questionnaire for assessing iodine intake in Norwegian pregnant women
Nutrition Journal volume 18, Article number: 62 (2019)
Iodized salt is not mandatory in Norway, and the permitted level of iodine in table salt is low (5 μg/g). Thus, milk and dairy products, fish and eggs are the main dietary sources of iodine in Norway. Mild-to-moderate iodine deficiency in pregnant women has been described in several European countries, including Norway. There are few validated tools available to assess iodine intake in an efficient manner. The aim of the current study was to assess the validity and reproducibility of a new iodine-specific food frequency questionnaire (I-FFQ) in Norwegian pregnant women.
An I-FFQ consisting of a total of 60 food items and the use of supplements was developed to assess iodine intake and was administrated to 137 pregnant women at gestational week 18–19. Reference methods were a structured 6-days iodine specific food diary, urinary iodine concentration (UIC) (pooled sample of spot UIC from six consecutive days), and thyroid function tests. Correlation analyses, Cohen’s weighted kappa, Bland-Altman plots, and linear regression analyses were used to assess validity. Reproducibility of the I-FFQ was assessed in a subgroup (n = 47) at gestational week 35–36.
There was a strong correlation between estimated iodine intake from the I-FFQ and food diary (r = 0.62, P < 0.001) and an acceptable correlation between the I-FFQ and UIC (r = 0.21, P = 0.018). There was no significant association between the I-FFQ and thyroid function tests. The I-FFQ estimated higher iodine intake compared to the food diary with a mean absolute difference 33 μg/day. The limits of agreement from the Bland-Altman plots were large, however few participants fell outside the limits of agreement (5.2–6.5%). There was no difference between the estimated iodine intake from the I-FFQ assessed at gestational week 18–19, and gestational week 35–36 (P = 0.866), and there was a strong correlation between the two time points (r = 0.63, P < 0.001).
In summary, this study suggests that the I-FFQ can be used as a valid tool to estimate and rank iodine intake among Norwegian pregnant women. We further suggest that this I-FFQ may also be valid in other populations with similarly dietary patterns and where salt is not iodized.
The study is registered in ClinicalTrials.gov (NCT02610959).
Iodine is an essential micronutrient which is crucial for the synthesis of the thyroid hormones triiodothyronine (T3) and thyroxine (T4) . The thyroid hormones regulates a wide range of physiological functions in the body and are essential for normal growth, development and metabolic regulation . Although great progress have been made towards eliminating iodine deficiency, it is still present in many European countries . Furthermore, pregnant women are a particularly vulnerable group regarding iodine deficiency, as the fetus is dependent on supply of thyroid hormones and iodine from the mother . Mild- to moderate iodine deficiency has been described in several studies of Norwegian pregnant women [5,6,7,8]. Iodized salt is not mandatory in Norway, and the permitted level of iodine in table salt is low (5 μg/g), therefore the main dietary sources of iodine in the Norwegian diet are milk and dairy products, fish and eggs [9, 10]. Since 2018, women of childbearing age in Norway with a low intake of milk and fish have been advised by the Norwegian Directorate of Health to take iodine containing supplements in order to secure sufficient iodine intake (supplement of 150 μg/day for pregnant and lactating women and supplement of 100 μg/day for women in fertile age) . This recommendation was introduced after the current study was conducted.
Urinary iodine concentration (UIC) is the most common method for assessing iodine status . However, as iodine excretion in urine varies considerable in individuals both between days, and within the same day, spot urine is not recommended to assess individual iodine status . The day-to-day variation will neither be accounted for in one 24-h urine sample [12, 13]. Other biomarkers such as thyroid stimulating hormone (TSH) and thyroglobulin may also be used to assess iodine status, but all current methods poses limitations [1, 12]. Dietary assessment methods may be used to estimate iodine intake, to identify the major dietary iodine sources, and evaluate the iodine status through dietary recommendations . However, all dietary assessment methods poses several challenges, as many tools are time consuming for the participants and rely on memory and accurate frequency, or portion estimations . Further, dietary methods are highly dependent on accurate and reliable food composition data . This may pose an extra challenge for assessment of iodine intake, since iodine content of food may vary considerably, e.g. between similar products  or between the same species of fish . Food frequency questionnaires (FFQs) are one of the most common dietary methods used to measure dietary intake in nutrition research . FFQs are particularly useful for assessing food items which are not frequently consumed, or foods consumed by less than 50% of the population that contain high levels of nutrients . FFQs can further be used to assess habitual iodine intake , however all FFQs developed should be validated for the specific nutrient and population .
The Mommy’s Food study is a randomized controlled trial (RCT), designed to explore whether cod intake during pregnancy could affect iodine status and subsequently infant development . An iodine-specific FFQ (I-FFQ) was developed for the RCT in order to assess the habitual iodine intake from iodine-rich food groups (milk and dairy products, seafood, eggs) and supplements in pregnant Norwegian women . The I-FFQ was based on a short validated seafood FFQ for pregnant and post-partum women . A full FFQ has previously been used and validated to assess iodine intake in pregnant women in Norway [21, 22]. However, a full FFQ may be very comprehensive and time consuming for the participants. An I-FFQ has the advantage to measure long-term dietary iodine intake in a simple, cost- and time-efficient manner, in a large sample size that is geographically widespread . It can also be useful in identifying the most important sources of iodine in the diet . Continuously monitoring of iodine intake in a population is important, especially in groups where deficiency already has been ascertained, such as pregnant women in Norway and in Europe.
As iodine deficiency is re-emerging in Norway, an I-FFQ to assess and evaluate iodine intake may be a useful tool. The aim of the present paper is to assess the validity and reproducibility of a new I-FFQ against the following: (1), a 6-days iodine specific food diary (2), urinary iodine concentration (UIC) (3), thyroid function tests (thyroid stimulating hormone (TSH), free T3 (fT3), free T4 (fT4)).
Study design and subjects
This paper used data from the Mommy’s Food study, a two-armed RCT in Norwegian pregnant women. The primary and secondary outcomes of the study were to investigate if an increased intake of cod during pregnancy has an impact on i) maternal iodine status and ii) infant development. The overall study design, including enrolment, randomization, study procedure and ethics are further described in detail by Markhus et al. . An overview of methods used in the validation of this I-FFQ is shown in Figure S1, listed in Additional file 1. This current paper used data from baseline (pre-intervention) at gestational week 18–19 for assessing validity of the I-FFQ. A total of 137 pregnant women from Bergen, Norway were enrolled in the study. The participants were recruited between January 2016 to February 2017. Data from the I-FFQ were available from 124 participants, food diary from 134 participants and UIC from 134 participants. The sample size was considered adequate in according to validate an FFQ in a population group, where of at least 50–100 subjects is recommended . To assess reproducibility of the I-FFQ, data from the control group post-intervention (gestational week 35–36) were used. Due to the design of the study (RCT) we were only able to use the control group (n = 47) for assessing reproducibility as the intervention group was intended to increase their iodine intake. Thus, including the intervention group would not be suitable for assessing reproducibility.
The study was conducted and performed according to the Declaration of Helsinki. The study was approved by the Regional Committees for Medical and Health Research Ethics West (REK 2015/879) and is registered in ClinicalTrials.gov (NCT02610959).
Data collection methods
The participants received an electronic online questionnaire in gestational week 18–19 and gestational week 35–36. The questionnaire included questions of baseline characteristics such as age, gestational age, education level, nicotine use, pre-pregnancy weight, current weight and height. Pre-pregnancy body mass index (BMI) was calculated as pre-pregnancy weight in kilograms (kg) divided by the square of the height in meters (kg/m2).
A semi-quantitative I-FFQ were included in the online questionnaire to acquire information about the participants’ habitual diet and supplement use with focus on iodine rich food groups. In the I-FFQ completed in gestational week 18–19, the participants were asked to report an estimate of their diet since they became pregnant. In the I-FFQ completed in gestational week 35–36, the participants were asked to report an estimate of their diet the last 16 weeks (since the last time they completed the I-FFQ).
The number of food items listed in the I-FFQ and the number of responses of frequencies for each food items are listed in Additional file 1: Table S1. The I-FFQ included 21 food items regarding frequency of seafood intake as dinner and warm lunch, and 14 food items regarding frequency of seafood intake as spread. All questions included type of seafood species or products consumed. The frequency intervals ranged from “never” to “three times a week or more” (five frequency alternatives in total). Further, there were 24 food items regarding intake of milk and dairy products (including mixed foods with milk such as pancakes, waffles and porridge) with frequency intervals ranging from “never” to “three to four times per day” (seven frequency alternatives in total). All food items of seafood, milk and dairy products had follow-up questions concerning portion sizes per meal, ranging from “half a portion or less” to “three portions” (five portion alternatives in total). There was in addition one food item regarding weekly intake of eggs ranging from “less than one egg per week” to “eight or more per week” (six alternatives in total). Thus, a total of 60 food items, regarding iodine rich foods (fish and seafood, milk and dairy products and eggs), were included when calculating total iodine intake from the diet from the I-FFQ. In addition, the I-FFQ also included questions regarding dietary supplements including type, brand and intake frequency.
Data from the I-FFQ were converted to numerical continuous data through calculation of indexes in accordance to the methodology described in Markhus et al. . For seafood intake, when frequency of consumption was given as a range (e.g. 1–2 times per week), the lowest frequency in each range was used (here: 1 time per week). This was due to recall is prone to overestimate low intakes when asked about several detailed food items separately . For milk, dairy products, eggs and dietary supplements, when frequency consumption was given as a range (e.g. 1–2 times per day), the mean frequency consumption was used (here: 1.5 times per day) as these food categories consisted of fewer detailed questions. The calculated frequency indexes of each question were further multiplied by the reported portion sizes of intake to estimate weekly intake.
A structured manual 6-days food diary was handed out, and instructions from the researcher were given to the participants at the first visit in gestational week 18. The food diary was filled out on six consecutive days between gestational week 18–19 (exact same days as the spot urinary samples). The food diary was developed specifically for this study with the purpose to estimate iodine intake during pregnancy. The number of food items listed in the food diary is given in Additional file 1: Table S1. The food diary included eight questions regarding seafood intake (as lunch/dinner and as spread), 19 questions regarding milk and dairy products, including foods made with milk, such as pancakes, waffles and other mixed dished with milk, and one question about intake of eggs. Thus, a total of 28 food items, regarding iodine rich foods (fish and seafood, milk and dairy products and eggs), were included when calculating total iodine intake from the diet from the food diary. The food diary also included questions regarding use of dietary supplements including type, brand and intake frequency. Each question included quantitative response alternatives (portions, glasses or cups, slices etc.) and the participants filled out their respective intakes from each day (e.g. 4 glasses of milk).
Estimation of iodine intake from the I-FFQ and food diary
In order to calculate consumption of the different food items from the I-FFQ and the food diary in grams per week, intake in portions per week were multiplied by estimated portion sizes in gram as defined in the report “Weights, measures and portion sizes for foods” from the Norwegian Food Safety Authority, University of Oslo and the Norwegian Directorate of Health . These portion sizes were also defined in the I-FFQ and the food diary. To calculate the mean daily iodine intake from the I-FFQ and food diary, intake of the different food groups in gram per day was multiplied by the average iodine content of the specific food and further summarized. The iodine content of the specific food groups were retrieved from Nerhus et al. 2018 , the database Seafood data from the Institute of Marine Research (IMR)  and the Norwegian Food Composition Table . The most relevant and recent analytical value of iodine was used. Information of iodine content of the specific food groups are specified in Additional file 2: Table S2 and S3. Regarding dietary supplements, the specific iodine content of each supplement was retrieved from the manufacturers, and the mean daily iodine intake from supplements were calculated from both the I-FFQ and the food diary. Total estimated iodine intake per day from both the I-FFQ and the food diary were further calculated by summarizing the estimated iodine from foods and estimated iodine intake from supplements.
Urinary iodine concentration and thyroid function tests
The participants collected one spot urine samples on six consecutive days between gestational week 18–19 (same days as the structured 6-days food diary). The participants were instructed to collect the spot urine sample between 4 PM and midnight. The participants stored the urine samples in their home freezer until the next visit in gestational week 19. The urine samples were then transferred to cryo tubes and stored at minus 20 °C pending analysis by inductively coupled plasma mass spectrometry (ICP-MS), at the Institute of Marine Research, Norway. Equally amounts of urine from the six spot urine samples were homogenized into one composite sample of 1 ml before determination of iodine concentration. Description of the analytical method to determine UIC (μg/L) has previously been described by others [7, 27]. Estimated iodine intake from UIC was calculated by the following formula: UIC (μg/L) × 0.0235 x body weight (kg) , using current pregnancy weight in kg as body weight (self-reported body weight from gestational week 18–19).
Blood samples were drawn at gestational week 18. Venous blood samples for serum preparation were collected in BD Vacutainer® SST™ vials II Advanced and set to coagulate for minimum 30 min before centrifuging (1000–3000 G, room temperature, 10 min) within 60 min after extraction. Post separation, serum samples were stored at minus 80 °C pending analysis at Fürst Medical Laboratories in Bergen, Norway. The serum samples were stored for maximum three months before analysis. TSH, fT4 and fT3 were analysed in serum using magnetic separation and detection by chemiluminescence, labelled with acridinium ester, on an Advia Centaur XPT Immunoassay system (Siemens Healthcare diagnostics Inc., Tarrytown, USA). For all blood constitutes the CV was < 6%.
Statistical analyses were performed using Statistical Package for Social Sciences version 25, IBM Corporation (IBM Corp. Released 2017. IBM SPSS Statistics for Windows, Version 25.0. Armonk, NY: IBM Corp). Two-sided statistical tests were performed. P-values < 0.05 were considered statistically significant. Variables were tested for normality by using the Kolmogorov-Smirnov test and by visual inspection of Q-Q plots and histograms. Descriptive results are reported as frequency (%) for categorical variables. For continuous variables mean (SD), median (p25-p75) or p5-p95 are reported as appropriate. Difference between estimated iodine intake from the I-FFQ, food diary and UIC were assessed using Wilcoxon signed-rank test. Correlation between the methods were assessed using Spearman’s rank order correlation coefficient (Spearman’s rho). The correlation coefficients strength (effect size) was considered poor if the Spearman’s rho was < 0.20, acceptable if 0.20–0.49 and good/strong if ≥0.50 in according to previously used dietary methods .
The agreement between methods was analyzed using Bland-Altman plots , using a plot of the mean difference of iodine intake between the two methods against the mean iodine intake of the two methods, also showing 95% limits of agreement (LOA). This was conducted to graphically assess the presence of bias or disagreement.
Agreement of quartile membership was assessed between estimated iodine intake from the I-FFQ and the food diary, estimated iodine intake from the I-FFQ and UIC, and estimated iodine intake from the food diary and UIC, using Cohen’s weighted kappa (kw), which takes the squared concordance of position among groups into account . The weighted kappa was calculated using crosstab analysis and the script “Weighted Kappa, Kappa for ordered categories” available from the IBM website . Stability between methods are presented as numbers and percentage of participants remaining in their quartile (stable quartile), in adjacent quartile, or in opposite quartile (two or more quartiles between, e.g. from first, to third or fourth quartile), compared to the other method selected. The criteria’s from Landis and Koch  were used to assess agreement, where a kw of 0.01–0.20 represents slight agreement, 0.21–0.40 fair agreement, 0.41–0.60 moderate agreement, 0.61–0.80 substantial agreement, and 0.81–1.00 almost perfect agreement.
Linear regression analyses were used to assess the relationship between estimated iodine intake (including supplements) from the I-FFQ and thyroid markers: TSH, fT3 and fT4. Simple and adjusted (adjusted for BMI, age, nicotine use, and education) analyses are presented. Residual plots were examined and standardized residuals ±3 were excluded from the model (1 excluded from TSH, 2 excluded from fT4).
To assess the reproducibility of the I-FFQ we compared the estimated iodine intake from the I-FFQ completed at gestational week 18–19 with the I-FFQ completed at gestational week 35–36. The correlation of iodine intake from the I-FFQ were evaluated between the two time points, in addition to Bland-Altman plots.
Characteristics of the pregnant women (gestational week 19) enrolled in the study are shown in Table 1.
Estimated iodine intake from the I-FFQ and food diary, and UIC and estimated iodine intake from UIC in the pregnant women are shown in Table 2. Median estimated iodine from the I-FFQ was 202 μg/day, which was significantly higher compared to estimated iodine intake from the food diary (151 μg/day) (P = 0.002). This was also higher compared to the estimated iodine intake from UIC (median 147 μg/day) (P = 0.001). The median estimated iodine intake from UIC (147 μg/day) was similar to the median total estimated iodine intake from the iodine specific food diary (151 μg/day) (same time period as urine spot samples) (P = 0.882).
Correlations coefficients between estimated iodine intake from the I-FFQ, the food diary and UIC are presented in Table 3. There was a significant strong correlation between estimated iodine intake (including diet and supplements) from the I-FFQ and the food diary (r = 0.62, P < 0.001). Further, there was a significant acceptable correlation between estimated iodine intake from I-FFQ and UIC (r = 0.21, P = 0.018) and a significant acceptable correlation between estimated iodine intake from the food diary and UIC (r = 0.41, P < 0.001).
Table 4 presents the stability of quartile membership between the different methods. The stability was highest between the estimated iodine intake from I-FFQ and the food diary, where respectively 89% were classified into the same (47%) or adjacent (42%) quartile, showing a moderate to substantial agreement (kw = 0.60). A fair agreement was seen between the I-FFQ and UIC (kw = 0.21), and between the food diary and UIC (kw = 0.40).
The Bland-Altman plot comparing estimated iodine intake from I-FFQ and food diary (including diet and supplements) is presented in Fig. 1. The mean absolute difference (bias) in iodine intake between the methods was observed to 33 μg/day, with a LOA ranging from − 150 (lower LOA) to 216 (upper LOA) μg/day. The number of individuals observed to be beyond the LOA was 8 of 123, which corresponds to 6.5%.
The Bland-Altman plot comparing iodine intake estimated from the I-FFQ (including diet and supplements) and estimated iodine intake from UIC is presented in Fig. 2. The mean absolute difference (bias) in iodine intake between the methods was observed to 38 μg/day, with a LOA ranging from − 206 (lower LOA) to 281 (upper LOA) μg/day. The number of individuals observed to be beyond the LOA was 7 of 123, which corresponds to 5.7%.
The Bland-Altman plot comparing iodine intake estimated from the food diary (including diet and supplements) and estimated iodine intake from UIC is presented in Fig. 3. The mean absolute difference (bias) in iodine intake between the methods was observed to 3 μg/day, with a LOA ranging from − 197 (lower LOA) to 203 (upper LOA) μg/day. The number of individuals observed to be beyond the (LOA) was 7 of 134, which corresponds to 5.2%.
Estimated iodine intake from the I-FFQ was positively associated with TSH, and negatively associated with fT3 and fT4, however neither of the associations were statistically significant after adjustments (Table 5).
There was no difference between the estimated iodine intake from the I-FFQ at gestational week 18–19 and gestational week 35–36 (median (p25-p75) iodine intake: 145 (90–267) vs. 152 (115–258), P = 0.866, n = 47). In addition, there was a strong correlation between estimated iodine intake from the I-FFQ between these two time points (r = 0.63, P < 0.001, n = 47). The mean absolute difference (bias) in iodine intake between the methods was observed to − 5 μg/day, with a LOA ranging from − 177 (lower limit of agreement) to 167 (upper LOA) μg/day. The number of individuals observed to be beyond the LOA was 5 of 47 (5.2%).
This study suggests that the I-FFQ can be used as a valid tool to estimate and rank iodine intake among Norwegian pregnant women, because of its association with estimated iodine intake from a 6-days structured food diary and UIC from six spot urine samples. The I-FFQ further showed strong reproducibility. To the best of our knowledge, there is only one previously validated I-FFQ for pregnant women, which was developed in Australia . A comprehensive FFQ has previously been used and validated for iodine intake in the Norwegian Mother and Child Cohort study [21, 22], however, this is a full FFQ consisting of 255 food items . Therefore, this I-FFQ could be a useful tool, as it presents a lower burden for the participants. There are few validated tools available to asses iodine intake in an efficient manner. UIC is the most common method for assessing iodine status . However, an I-FFQ has the advantage to measure long-term dietary intake in a simple, cost- and time-efficient manner in a large sample size that is geographically widespread . As iodine is present in few foods, and iodized salt is used in negligible amounts in Norway, dietary assessment tools may be a promising method to evaluate iodine intake through dietary reference intakes in a population. An I-FFQ along with the use of UIC in a population, can also give a better understanding of current iodine status and iodine sources in population studies .
Weighed food- or diet records are considered the gold standard in dietary research, and is the first methods of choice for validation of FFQ data . According to Gibson, a 7-days weighted food record is considered the best reference method . We only used a 6-days structured food diary including 28 food items of iodine rich food groups as the dietary reference method. Though, in most settings, using more than four to five observations (days) of the reference methods per subject has also been considered sufficient . The agreement between the I-FFQ and the food diary was moderate to substantial (k = 0.60). When assessing validation of specific nutrients from an FFQ, a weighted kappa value above 0.4 has been considered as acceptable [29, 37]. The kappa value was in accordance with the correlation coefficients as there was a strong correlation between estimated total iodine intake from the I-FFQ and food diary (r = 0.62, P < 0.001). This was mostly higher or comparable to what is reported in other studies comparing iodine intake from an FFQ against a food diary or food record (correlation coefficients ranging from 0.26–0.88) [21, 34, 38,39,40,41].
The mean absolute difference between the methods showed that the estimated iodine intake was highser from the I-FFQ, compared to the food diary and estimated iodine intake from UIC. A higher iodine intake estimated from an FFQ compared to other dietary reference methods has also been found in other studies [39, 42, 43], while in some studies FFQ have not been found to overestimate [22, 34, 40]. There could be several reasons of why the I-FFQ estimated a higher iodine intake compared to the food diary. The records of the I-FFQ and the food diary was from different time periods (approximately four months vs. six days) and the I-FFQ was completed retrospective while the food diary was completed day-by-day. In addition, the I-FFQ assessed long-term habitual iodine intake, included more food items and covered rarely consumed food items such as several seafood species and items (e.g. reporting of an intake 1–3 times/months) which the food diary may not has covered. The time period of pregnancy have also been shown to be a period where there is a potential for dietary changes [44,45,46,47]. Thus, we cannot conclude whether the estimated higher iodine intake from the I-FFQ compared to the food diary was caused by an overestimation from the I-FFQ, reporting of rarely consumed food items which the food diary did not cover, or if it was an actual difference in intake between the two time periods. It should also be noted that we did not adjust for energy intake when calculating iodine intake, as we did not complete a full FFQ or food diary, which further is a limitation in our study. In both the I-FFQ and food diary, we only included iodine intake from milk and dairy products, seafood, eggs and supplements. These are the most important food groups of iodine intake in Norway, however other food groups (such as e.g. bread, cereals, snack, vegetables) may also contribute with some iodine , and the exclusion of these food groups may on the other hand contributed to an underestimation of iodine intake.
There was a significantly higher estimated iodine intake from the I-FFQ and food diary when supplements was added to the summarization. In addition, the correlations coefficients were strengthened. This is also found in other studies [21, 34] and highlights the importance of including supplements in dietary research studies of iodine as it contributes with a significant amount of intake.
Correlation between methods only assess the degree of the association between them, and not the agreement between them. In contrast, the Bland-Altman plot is a preferred method to assess agreement between two dietary reference methods across the range of intakes . From the Bland-Altman plots (Figs. 1, 2 and 3), the LOA were large and for all plots there seemed to be a systematic increase in the difference between the two methods with increasing iodine intake. This may indicate that estimating iodine intake is more difficult when intake is higher. This may also be explained by the fact that when several sources of intake are included, the accuracy of the dietary intake estimations decrease as an increased number of potential errors are introduced, e.g. inaccurate portion estimations or food composition data. This have also been confirmed by other studies validating FFQs [38, 39]. However, few participants (5.3–6.5%) fell outside the LOA (±1.96 SD) which is indicated as the accepted level of agreement [30, 48].
A biomarker can provide an estimate of dietary intake that is objective and independent of the subject’s reported dietary intake [18, 49]. We found a fair agreement between UIC and iodine intake from the I-FFQ (k = 0.205) and the food diary (k = 0.399). In addition, there was an acceptable correlation between UIC and iodine intake from the I-FFQ (r = 0.213, P = 0.018) and the food diary (r = 0.408, P < 0.001). The use of spot urine samples to measure UIC as a marker of iodine status has its limitations owing to large inter- and intra-individual variations. A strength to this study is that the participants collected six spot urinary samples on consecutive days, and not a single spot urine sample. However, it has been suggested that at least ten spot urine samples or 24-h urine collections, is needed to account for intra- and inter individual variability . Nonetheless, this is demanding for the participants and was not prioritized in this study. Consequently, we cannot exclude that the UIC has limitations regarding within day, and day-to-day variation. The iodine intake from the food diary had the highest relative validity, as it showed the highest correlation and agreement with the UIC. This was also expected as the sampling of spot urine samples was collected of the same days as the food diary was conducted (six consecutive days).
We also assessed the association between thyroid function tests (TSH, fT3, fT4) with estimated iodine intake from the I-FFQ. The direction of the associations were similar to what was reported in another study of Norwegian pregnant women, where an inverse association was seen between UIC and fT3, and fT4, and a positive association between UIC and TSH . However, we did not find any significant associations, similarly as reported by others [34, 51]. TSH and thyroid hormones are not considered sensitive markers of iodine status and may only be affected if severe iodine deficiency is present . Thus, a significant association was not be expected.
To determine whether an FFQ shows reproducible results, reproducibility should always be assessed . There was a strong association between estimated iodine intake from the I-FFQ at gestational week 18–19 with gestational week 35–36. Further, no significant differences in estimated iodine intake from the I-FFQ between the two time points were found. However, as this paper was part of an RCT we were only able to assess reproducibility in the control group of the study (n = 47). Thus, the reduced number of participants assessing the reproducibility of the I-FFQ is a limitation.
The strengths in this study are the use of both a dietary method (food diary) and biomarkers (UIC and thyroid function tests) to validate the I-FFQ, as using more than one approach to validate an FFQ gives further credibility to the results . We also used multiple statistical tests, which is considered a strength when evaluating validity of dietary methods . In addition, we used up to date chemical analyses of most food items to estimate iodine intake . We included portion sizes in the I-FFQ which is recommended when calculating nutrient intake . Further, the sample size was considered adequate for validation of an FFQ . However, the study group may not be a representative sample of pregnant women in Norway as this was a group with high socioeconomic status. Still, the study group has a broad range of iodine intakes (Table 2), and we believe that this I-FFQ may also be valid in other populations with similarly dietary patterns where salt is not iodized, such as the general adult population in Norway.
In summary, this study suggests that the I-FFQ can be used as a valid tool to estimate and rank iodine intake among Norwegian pregnant women, because of its acceptable correlation and agreement with estimated iodine intake from a 6-days structured food diary and UIC. The I-FFQ further showed strong reproducibility. Thus, this I-FFQ can be used as a tool to evaluate and monitor iodine intake in this population. As iodine deficiency is re-emerging in Norway and Europe, there is a need for validated tools that are non-invasive, simple, cost- and time-efficient to evaluate iodine intake and to identify women at risk of inadequate intake.
Availability of data and materials
The datasets used and analysed during the current study are available from the corresponding author on reasonable request.
Body mass index
Food frequency questionnaire
Inductively coupled plasma mass spectrometry
Iodine-specific food frequency questionnaire
Institute of Marine Research;
Randomized controlled trial
Thyroid stimulating hormone
Urinary iodine concentration
World Health Organization
World Health Organization (WHO). Assessment of iodine deficiency disorders and monitoring their elimination - A guide for programme managers, Third edition. 2007.
Brent GA. Mechanisms of thyroid hormone action. J Clin Invest. 2012;122(9):3035–43.
Lazarus JH. Iodine Status in Europe in 2014. Eur Thyroid J. 2014;3(1):3–6.
Pearce EN, Lazarus JH, Moreno-Reyes R, Zimmermann MB. Consequences of iodine deficiency and excess in pregnant women: an overview of current knowns and unknowns. Am J Clin Nutr. 2016;104(Supplement 3):918S–923S.
Brantsaeter AL, Abel MH, Haugen M, Meltzer HM. Risk of suboptimal iodine intake in pregnant Norwegian women. Nutrients. 2013;5(2):424–40.
Abel MH, Caspersen IH, Meltzer HM, Haugen M, Brandlistuen RE, Aase H. Suboptimal maternal iodine intake is associated with impaired child neurodevelopment at 3 years of age in the Norwegian mother and child cohort study. J Nutr. 2017;147.
Dahl L, Wik Markhus M, Sanchez PVR, Moe V, Smith L, Meltzer HM, et al. Iodine Deficiency in a Study Population of Norwegian Pregnant Women-Results from the Little in Norway Study (LiN). Nutrients. 2018;10(4). https://doi.org/10.3390/nu10040513.
Henjum S, Aakre I, Lilleengen AM, Garnweidner-Holme L, Borthne S, Pajalic Z, et al. Suboptimal Iodine Status among Pregnant Women in the Oslo Area, Norway. Nutrients. 2018;10(3). https://doi.org/10.3390/nu10030280.
Nyström HF, Brantsæter AL, Erlund I, Gunnarsdottir I, Hulthén L, Laurberg P, et al. Iodine status in the Nordic countries – past and present. Food Nutr Res. 2016;60(1):31969.
Carlsen MH, Andersen LF, Dahl L, Norberg N, Hjartaker A. New Iodine Food Composition Database and Updated Calculations of Iodine Intake among Norwegians. Nutrients. 2018;10(7). https://doi.org/10.3390/nu10070930.
The Norwegian Directorate of Health (Helsedirektoratet). Viktig å få nok jod [Important to get enough iodine] (In Norwegian). 2018 [updated 18 July 2018. Available from: https://helsenorge.no/kosthold-og-ernaring/derfor-trenger-vi-jod. Accessed 1 July 2019.
Rohner F, Zimmermann M, Jooste P, Pandav C, Caldwell K, Raghavan R, et al. Biomarkers of Nutrition for Development—iodine review. J Nutr. 2014;144(8):1322S–42S jn. 113.181974.
Meltzer HM, Brantsæter AL, Ydersbond TA, Alexander J, Haugen M, Group TMDS. Methodological challenges when monitoring the diet of pregnant women in a large study: experiences from the Norwegian mother and child cohort study (MoBa). Matern Child Nutr. 2008;4(1):14–27.
Aakre I, Næss S, Kjellevold M, Markhus MW, Alvheim AR, Dalane J, et al. New data on nutrient composition in large selection of commercially available seafood products and its impact on micronutrient intake. Food Nutr Res. 2019;63:3573.
Nerhus I, Wik Markhus M, Nilsen BM, Oyen J, Maage A, Odegard ER, et al. Iodine content of six fish species, Norwegian dairy products and hen's egg. Food Nutrition Res. 2018;62:1291.
Shim J-S, Oh K, Kim HC. Dietary assessment methods in epidemiologic studies. Epidemiology and Health. 2014;36:e2014009.
European Food Safety Authority (EFSA). Guidance on the EU Menu methodology. EFSA J. 2014;12(12):3944.
Cade J, Thompson R, Burley V, Warm D. Development, validation and utilisation of food-frequency questionnaires - a review. Public Health Nutr. 2002;5(4):567–87.
Markhus MW, Kvestad I, Midtbø LK, Nerhus I, Ødegaard ER, Graff IE, et al. Effects of cod intake in pregnancy on iodine nutrition and infant development: study protocol for Mommy’s food - a randomized controlled trial. BMC Nutrition. 2018;4(1):7.
Markhus MW, Graff IE, Dahl L, Seldal CF, Skotheim S, Braarud HC, et al. Establishment of a seafood index to assess the seafood consumption in pregnant women. Food Nutr Res. 2013;57.
Brantsaeter AL, Haugen M, Julshamn K, Alexander J, Meltzer HM. Evaluation of urinary iodine excretion as a biomarker for intake of milk and dairy products in pregnant women in the Norwegian mother and child cohort study (MoBa). Eur J Clin Nutr. 2009;63(3):347–54.
Brantsaeter AL, Haugen M, Alexander J, Meltzer HM. Validity of a new food frequency questionnaire for pregnant women in the Norwegian mother and child cohort study (MoBa). Maternal Child Nutrition. 2008;4(1):28–43.
Pearce EN. Assessing iodine intakes in pregnancy: why does this matter? Br J Nutr. 2015;113(8):1179–81.
Dalane JØ, Bergvatn TAM, Kielland E, Carlsen MH. Mål, vekt og porsjonsstørrelser for matvarer [Weights, measures and portion sizes for foods] (in Norwegian) Oslo, Norway: The Norwegian Food Safety Authority (Mattilsynet), University of Oslo (Universitetet i Oslo), The Norwegian Directorate of Health (Helsedirektoratet). 2015 [Available from: https://www.matportalen.no/verktoy/kostholdsplanleggeren/article40868.ece/BINARY/Rapport:%20M%C3%A5l,%20vekt%20og%20porsjonsst%C3%B8rrelser%20for%20matvarer. Accessed 8 November 2018.
Institute of Marine Research (Havforskningsinstituttet). Seafood data (Sjømatdata). 2019 [Available from: https://sjomatdata.hi.no/. Accessed 12 November 2018.
Norwegian Food Safety Authority (Mattilsynet). The Norwegian Food Composition Tabel (Matvaretabellen), 2019 [Available from: https://www.matvaretabellen.no/. Accessed 8 November 2018.
Markhus MW, Dahl L, Moe V, Abel MH, Brantsaeter AL, Oyen J, et al. Maternal Iodine Status is Associated with Offspring Language Skills in Infancy and Toddlerhood. Nutrients. 2018;10(9). https://doi.org/10.3390/nu10091270.
Institute of Medicine (US) Panel on Micronutrients. Iodine (Chapter 8) in Dietary Reference Intakes for Vitamin A, Vitamin K, Arsenic, Boron, Chromium, Copper, Iodine, Iron, Manganese, Molybdenum, Nickel, Silicon, Vanadium, and Zinc. Washington (DC): National Academies Press (US). Copyright 2001 by the National Academy of Sciences; 2001.
Lombard MJ, Steyn NP, Charlton KE, Senekal M. Application and interpretation of multiple statistical tests to evaluate validity of dietary intake assessment methods. Nutr J. 2015;14:40.
Bland JM, Altman D. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986;327(8476):307–10.
Cohen J. Weighted kappa: nominal scale agreement provision for scaled disagreement or partial credit. Psychol Bull. 1968;70(4):213.
IBM. Weighted Kappa, Kappa for ordered categories. [Available from: https://www-01.ibm.com/support/docview.wss?uid=swg21477357. Accessed 9 May 2019.
Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33(1):159–74.
Condo D, Makrides M, Skeaff S, Zhou SJ. Development and validation of an iodine-specific FFQ to estimate iodine intake in Australian pregnant women. Br J Nutr. 2015;113(6):944–52.
Gibson RS. Principles of nutritional assessment. USA: Oxford university press; 2005.
Stram DO, Longnecker MP, Shames L, Kolonel LN, Wilkens LR, Pike MC, et al. Cost-efficient Design of a Diet Validation Study. Am J Epidemiol. 1995;142(3):353–62.
Masson LF, McNeill G, Tomany JO, Simpson JA, Peace HS, Wei L, et al. Statistical approaches for assessing the relative validity of a food-frequency questionnaire: use of correlation coefficients and the kappa statistic. Public Health Nutr. 2003;6(3):313–21.
Rasmussen LB, Ovesen L, Bulow I, Jorgensen T, Knudsen N, Laurberg P, et al. Evaluation of a semi-quantitative food frequency questionnaire to estimate iodine intake. Eur J Clin Nutr. 2001;55(4):287–92.
Glabska D, Malowaniec E, Guzek D. Validity and Reproducibility of the Iodine Dietary Intake Questionnaire Assessment Conducted for Young Polish Women. Int J Environ Res Public Health. 2017;14(7) https://doi.org/10.3390/ijerph14070700.
Combet E, Lean ME. Validation of a short food frequency questionnaire specific for iodine in U.K. females of childbearing age. J Hum Nutr Diet. 2014;27(6):599–605.
Li-Min T, Charlton KE, Sze-Yen T, Gary M, Batterham M. Validity and reproducibility of an iodine-specific food frequency questionnaire to estimate dietary iodine intake in older Australians. Nutr Diet. 2013;70(1):71–8.
Khalesi S, Doshi D, Buys N, Sun J. Validation of a short food frequency questionnaire in Australian adults. Int J Food Sci Nutr. 2017;68(3):349–57.
Wu Y, Chen W, Shen J, Tan L, L'Abbe MR, Pearce EN, et al. Reproducible and reliable general semiquantitative food frequency questionnaire for evaluating iodine intake in Chinese children. Nutr Res (New York, NY). 2018;55:72–80.
Forbes LE, Graham JE, Berglund C, Bell RC. Dietary Change during Pregnancy and Women's Reasons for Change. Nutrients. 2018;10(8). https://doi.org/10.3390/nu10081032.
Olafsdottir AS, Skuladottir GV, Thorsdottir I, Hauksson A, Steingrimsdottir L. Maternal diet in early and late pregnancy in relation to weight gain. Int J Obes. 2006;30(3):492–9.
Rifas-Shiman SL, Rich-Edwards JW, Willett WC, Kleinman KP, Oken E, Gillman MW. Changes in dietary intake from the first to the second trimester of pregnancy. Paediatr Perinat Epidemiol. 2006;20(1):35–42.
Hook EB. Dietary cravings and aversions during pregnancy. Am J Clin Nutr. 1978;31(8):1355–62.
Kowalkowska J, Slowinska MA, Slowinski D, Dlugosz A, Niedzwiedzka E, Wadolowska L. Comparison of a full food-frequency questionnaire with the three-day unweighted food records in young polish adult women: implications for dietary assessment. Nutrients. 2013;5(7):2747–76.
Potischman N. Biologic and methodologic issues for nutritional biomarkers. J Nutr. 2003;133(3):875S–80S.
König F, Andersson M, Hotz K, Aeberli I, Zimmermann MB. Ten repeat collections for urinary iodine from spot samples or 24-hour samples are needed to reliably estimate individual iodine status in women. J Nutr. 2011;141(11):2049–54.
Abel MH, Korevaar TIM, Erlund I, Villanger GD, Caspersen IH, Arohonka P, et al. Iodine intake is associated with thyroid function in mild to moderately iodine deficient pregnant women. Thyroid. 2018;28(10):1359–71.
The authors are very grateful for all the women who participated in the study. The authors are thankful for all technical and laboratory assistance, especially to Elisabeth R. Ødegaard and technicians at the Inorganic Laboratory at IMR.
The Mommy’s Food study is financially supported by The Norwegian Seafood Research Fund (http://www.fhf.no/) (grant no. 901038). The funder had no role in the design of the study, or analysis, interpretation of data or writing of this article.
Ethics approval and consent to participate
The study was approved by the Regional Committees for Medical and Health Research Ethics West (REK 2015/879) and is registered in ClinicalTrials.gov (NCT02610959). The study was conducted and performed according to the Declaration of Helsinki. Participation in the study was voluntary and written informed consent was obtained from the participants after giving both written and oral information about the study. The participants could withdraw from the study at any time without giving any reason and this was highlighted in the declaration of informed consent.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Overview of methods used in validation of the I-FFQ in Norwegian pregnant women. Table S1. Number of food items specified in the I-FFQ and the food diary, and number of frequency alternatives in the I-FFQ.
Iodine content in food items used for calculation of iodine intake from the I-FFQ. Table S3. Iodine content in food items used for calculation of iodine intake from the food diary.
About this article
Cite this article
Næss, S., Aakre, I., Kjellevold, M. et al. Validation and reproducibility of a new iodine specific food frequency questionnaire for assessing iodine intake in Norwegian pregnant women. Nutr J 18, 62 (2019). https://doi.org/10.1186/s12937-019-0489-4
- Dietary assessment