Skip to main content
Download PDF
Download ePub

Validation of an web-based dietary assessment tool (RiksmatenFlex) against doubly labelled water and 24 h dietary recalls in pregnant women

Nutrition Journal volume 23, Article number: 85 (2024) Cite this article

Abstract

Introduction

Digital technologies have enabled new possibilities to assess dietary intake and have shown promise in terms of decreased participant burden, improved accuracy and lower costs. However, their potential and validity in pregnant populations are scarcely explored.

Objectives

This study aimed to (a) validate energy intakes obtained from a web-based dietary recall method developed for national surveys (RiksmatenFlex) against total energy expenditure (TEE) by means of the doubly labelled water (DLW) method, and (b) to compare intakes of macronutrients, key unhealthy and healthy foods as well as adherence to food-based dietary guidelines between RiksmatenFlex and repeated 24 h telephone dietary recalls in healthy Swedish pregnant women.

Methods

This study was conducted as a nested validation within the HealthyMoms trial. Intakes of foods, macronutrients and energy were assessed during three days through RiksmatenFlex and 24 h telephone dietary recalls, and Swedish Healthy Eating Index (SHEI) scores were also calculated for both methods (n = 52). For 24 women, TEE was also assessed through the DLW method. Paired Samples T-tests and Wilcoxon Signed Ranks Tests were used to identify differences between means for foods, macronutrients, energy and SHEI scores. Pearson correlation coefficient or Spearman’s rho were performed to identify relationships between variables. To compare energy intake (RiksmatenFlex) with TEE (DLW method) and 24 h telephone dietary recalls, Bland and Altman plots were constructed.

Results

Average energy intake from RiksmatenFlex (10,015 [SD 2004] kJ) was not statistically different from TEE (10,252 [SD 1197] kJ) (p = 0.596) (mean difference: -237 kJ/24 h). Correspondingly, there were small mean differences between average intakes of key unhealthy and healthy foods and average SHEI scores between RiksmatenFlex and 24 h telephone dietary recalls. However, the Bland and Altman plots showed wide limits of agreement for all dietary variables (e.g., for energy intake using RiksmatenFlex versus TEE: ±4239 kJ/24 h). High correlations between the investigated dietary variables for the two dietary methods were observed (r = 0.751 to 0.931; all p < 0.001).

Conclusion

RiksmatenFlex captured average intakes of energy, unhealthy and healthy food groups and adherence to food-based dietary guidelines in a comparable way to 24 h telephone dietary recalls and the DLW method. Our results support the validity of RiksmatenFlex as a web-based dietary assessment method for future use in pregnancy for intervention studies and national dietary surveys.

Peer Review reports

Introduction

Pregnancy is a critical period where maternal lifestyle behaviors such as dietary habits have significant impact on health outcomes in both the pregnant woman and the growing child. For instance, a healthy diet has been associated with lower risk for gestational diabetes mellitus [1], large-for-gestational-age infants [1], excessive gestational weight gain (GWG) [1,2,3], and having a better maternal cardiometabolic health in pregnancy [4]. Given the increased prevalence of obesity and excessive GWG in pregnant women in many high-income countries [5,6,7], dietary intakes are clearly not optimal. Correspondingly, a recent meta-analysis (54 studies, n = 135 566 pregnant women, several world regions) concluded that suboptimal energy intakes were common and requested more efforts to encourage women to adopt healthy eating habits during pregnancy [8]. Validity of dietary assessment methods plays a vital role in accurately determining dietary intakes and adherence to recommendations as well as assessing dietary intervention effects. Therefore, access to scalable and accurate methods to assess dietary intake in pregnant women is essential. This is particularly important for methods which are intended to be used at a large scale to monitor dietary intakes in the general population, including pregnant women.

To date, there is no reference method with high accuracy and precision to assess diet and most methods (e.g., food frequency questionnaires, dietary history and weighed diet records) have been reported to have limited accuracy with predominantly under-reporting of energy intake being common for all methods [9,10,11]. Moreover, these traditional approaches are often both time consuming and burdensome for participants and researchers to perform [12]. With digitalisation, various technology-assisted methods to assess dietary intake have become increasingly available, including web-based tools, food photography images or wearable cameras. These methods can be advantageous by facilitating access, be less time consuming for participants to use, could increase accuracy of reported intakes [13] and can be used in studies with large sample sizes. One such example is the web-based dietary recall method RiksmatenFlex [14] which was developed by the Swedish Food Agency for their regular national dietary surveys in different age groups and it has also been used in research studies (e.g., the HealthyMoms trial) [15]. RiksmatenFlex consists of a flexible online registration platform supporting both prospective and retrospective dietary recordings, e.g., repeated 24 h dietary recalls, which also can be adapted to various study populations. Although RiksmatenFlex has been validated in adolescents [13], and is currently being validated in young children [16], it is yet to be validated in a pregnant population. This is important since the type and amount of food consumed might differ in this group [17, 18], and there might also be differences in the accuracy of reporting. Moreover, to the best of our knowledge, no previous study has assessed the validity of a web-based and scalable dietary recall method in pregnant women compared to traditional data collection approaches (i.e., telephone-based 24 h dietary recalls) and the doubly labelled water (DLW) method, which is the reference method to validate energy intake [16].

Objectives

The aims of this nested validation study within the HealthyMoms trial [15, 19] were (a) to validate energy intakes obtained from RiksmatenFlex against TEE by means of the DLW method, and (b) to compare intakes of macronutrients, key unhealthy and healthy foods as well as adherence to food-based dietary guidelines (the Swedish Healthy Eating Index, SHEI, score) between RiksmatenFlex and three repeated 24 h telephone dietary recalls in healthy Swedish pregnant women.

Materials and methods

Participants and study design

This validation study was conducted with a sub-sample of pregnant women participating in the HealthyMoms trial (n = 305) [15] which took place in Östergötland county, Sweden. The trial targeted pregnant women and aimed to evaluate an app (HealthyMoms) as a support for healthy weight gain, dietary- and physical activity habits. Recruitment and study population have previously been described in detail [15]. During the final recruitment phase of the HealthyMoms trial (October 2019 to March 2020), we performed this validation of energy- and dietary intake obtained from RiksmatenFlex (part of the baseline assessment in the trial). To validate dietary intake, we conducted three repeated telephone interviews, i.e., 24 h telephone dietary recalls, with women for the same days that they performed an online registration of their diet, i.e., RiksmatenFlex (n = 52). For validation of energy intake obtained with RiksmatenFlex, participants were also invited to participate in a validation of their energy intakes using the DLW method and 24 women accepted to do so. Figure 1 shows an overview of the study design including the timing of the three methods. In short, participants started by drinking DLW and were given instructions to log into RiksmatenFlex two days after to register their diet. The research team then matched the 24 h telephone dietary recalls with the days that participants registered their diet in RiksmatenFlex. Data for this nested validation study was collected between October 2019 and March 2020 and all data was collected prior to randomization in the trial. There were no major differences in baseline characteristics for women participating in the validation study (n = 52 and n = 24) compared to all women in the HealthyMoms trial (n = 305) (see results section). All participants provided their written informed consents, and all procedures were approved by the Regional Ethical Review Board in Linköping (reference numbers 2017/112 − 31, and 2018/262 − 32;).

Fig. 1
figure 1

Study overview showing dosing of doubly labelled water (DLW) and timing of RiksmatenFlex and 24 h telephone dietary recalls

Full size image

Methods

RiksmatenFlex

All participants were instructed to use the web-based dietary assessment tool RiksmatenFlex, developed by the Swedish Food Agency [14]. The assessment is based on repeated (3 days) 24 h dietary recalls, where participants reported the first two days consecutively whereas the third day was randomly assigned 2–7 days after the first day to ensure that both week- and weekend days were covered [20]. Through the 24 h dietary recalls, participants recalled all intake of food and drinks. To exemplify, when logging in to the system for the first time, participants were asked to register all their intake of foods and drinks from the day before. Amounts of registered items were specified through household measures (e.g., dl and tablespoons for foods such as yoghurt) or slices/pieces (e.g., for bread) and for some foods and complete dishes, pictures of various portion sizes too chose from were provided. The registered intakes of foods and drinks were linked with the Swedish Food Agency Food composition database [21] to provide daily intakes of energy and macronutrients for each participant. Registrations with daily energy intake that exceeded 3500 kcal or were less than 800 kcal were manually checked to ensure that no obvious incorrect imputations had been made, e.g., incomplete registrations or any mistakes regarding amounts or other evident misunderstandings [20]. Two days exceeded 3500 kcal and were manually checked but deemed plausible and were thus not excluded from the analysis. Data on selected key food groups and drinks representing healthy and unhealthy foods including fruit and vegetables, fish and shellfish, red and processed meat, nuts and seeds, fruit juice, sugar sweetened beverages, artificial sweetened beverages, sweet and savoury treats (i.e., ice cream, candy, baked goods, desserts, chips and popcorn) were then summarised for each participant and day and a mean intake was calculated (in grams/day or week). Finally, for each participant, a SHEI score was calculated as a measure of compliance to existing Swedish food-based dietary guidelines [22] and recommendations for specific nutrients [23]. The score included the following components: fruit and vegetables (g/day), whole grain (g/10 MJ), fibre (g/MJ), polyunsaturated fatty acids (Energy %, E%), monounsaturated fatty acids (E%), saturated fatty acids (E%), fish and shellfish (g/day), red meat (g/week) and added sugar (E%) (Additional file, Supplementary Table 1). An individual score (0 to 1) was calculated for each component and these scores were then summarised into a total SHEI score (0 to 9), as previously been described [22]. High scores indicated better compliance to Swedish dietary recommendations.

24 h telephone dietary recalls

All participants partook in telephone based 24 h dietary recalls matching the days for RiksmatenFlex, and completion order of the two methods was random, i.e., sometimes participants finished their registration in RiksmatenFlex before the 24 h telephone dietary recall and sometimes it was done afterwards. Participants were asked to report their intake of food and drinks the previous day and to specify amounts. Amounts were specified through measures such as deciliters, tablespoons and teaspoons. Other foods, e.g., bread and sweets, were specified in terms of slices or pieces. Based on reported intakes of foods and drinks, the interviewer asked follow-up questions to capture foods used in mixed dishes, cooking methods as well as e.g., fat and fiber content of certain foods. All dietary data was imputed into a software program (Dietist Net Pro, Kost och Näringsdata AB, Stockholm, Sweden) where it was linked to the Swedish food composition database [21], to provide data on intakes of energy, food groups and macronutrients. Similar to RiksmatenFlex, food groups (i.e., fruit and vegetables, fish and shellfish, red and processed meat, nuts and seeds, fruit juice, sugar sweetened beverages, artificial sweetened beverages, sweet and savoury treats, defined as above) were summarized for each participant and day and means were calculated (in grams/day or week). Correspondingly, a SHEI score for each participant was calculated from the 24 h telephone dietary recalls in the same way as described above for RiksmatenFlex.

Doubly labelled water

Participants that accepted to participate in the validation of energy intake (n = 24) were instructed to collect two baseline urine samples prior to coming to Linköping University hospital for an assessment of TEE in early pregnancy (12.6 ± 1.2 gestational weeks). Participants were weighed in light clothing and were given an accurately weighed dose of stable isotopes (0.08 g 2H2O and 0.15 g H218O, per kg body weight). After drinking the water, participants were instructed to collect five urine samples during the following two weeks (on day 1, 5, 8, 12 and 15). Each sample was marked with a date and time for sampling. During the same two-week period, assessment of participant energy intake through RiksmatenFlex was performed, as previously described. Collected urine samples were stored (-18 °C) at Linköping University Hospital until analysis. Samples were shipped to, and analyzed at Pennington Biomedical Research Center, Baton Rouge, Louisiana, the United States.

Doses and urine samples were analyzed for 18O and 2H abundance by isotope ratio mass spectrometry using automated devices for deuterium (H/Device, Finnigan) and 18O (GasBench, Finnigan) [24]. The isotopic enrichments of the post-dose urine samples compared with the pre-dose samples were used to calculate elimination rates (kd and kO) using linear regression. The quotient between the 2H dilution space and 18O dilution space was 1.035 ± 0.010 for the 24 women. The CO2 production was calculated using the equation of Speakman et al. [25]. TEE was calculated by multiplying CO2 production by the energy equivalent of CO2 based on the estimated food quotient of the diet (0.86) [26].

Statistics and power considerations

Values for energy intake, TEE, key unhealthy and healthy foods, macronutrients, and SHEI score are presented as means and standard deviations (SD). Paired Samples T-tests and Wilcoxon Signed Ranks Tests were used to identify differences between means for parametric and non-parametric data and correlation tests (Pearson correlation coefficient or Spearman’s rho) were performed to identify relationships between variables. To compare energy intake (RiksmatenFlex) with TEE (DLW method) and 24 h telephone dietary recalls, Bland and Altman plots were constructed [27], where the difference between the methods (y) were plotted against the average of the two methods (x). The mean difference of the methods as well as limits of agreement (mean difference ± 2SD) were calculated. Linear regression was used to evaluate the relationship between x and y in the plot. Mean intakes of macronutrients and the specified key unhealthy and healthy foods from RiksmatenFlex and 24 h telephone dietary recalls were also compared according to Bland and Altman [27]. A significance level of 5% was used. All analyses were performed using IBM SPSS Statistics version 29. This validation study was performed as a nested sub-study for the HealthyMoms trial which was carefully dimensioned to address the primary trial outcomes [15]. We also considered sample size a priori for the research questions investigated in this validation study. For the comparison of mean values (e.g., energy intake versus TEE) we estimated that TEE was on average 10,000 +/- 1300 kJ, assuming a correlation between energy intake and TEE of 0.6. Thus, 24 women would provide us with more than 80% power to detect a 7% difference in energy intake and TEE, which is considered as acceptable agreement in accordance with Lombard et al. [28]. A slightly higher target sample size for the comparison against 24 h telephone dietary recalls was decided (at least n = 50) which would provide us with the possibility to detect correlation coefficients between variables from the two methods from approximately 0.39 and higher, with lower correlation coefficients not deemed relevant.

Results

Participant characteristics are presented in Table 1. No major differences were found for demographic data, anthropometrics or lifestyle behaviors in the DLW sub-sample (n = 24) and 24 h telephone dietary recall sub-sample (n = 52) compared to the entire HealthyMoms population (n = 305), respectively, except for slightly lower levels of moderate-to-vigorous physical activity in the two sub-samples for the validation. The compliance for the two dietary methods (n = 52) was high, with 48 women (92.3%) having three days of dietary data while four women (7.7%) had two days of registrations for both methods. All 24 women that were assessed using DLW had three days of recordings for both methods. In total, there were 152 days of data included in the analysis from RiksmatenFlex and 24 h telephone dietary recalls, respectively.

Table 1 Characteristics for study population and the entire HealthyMoms trial
Full size table

The average energy intake calculated using RiksmatenFlex (10,015 [SD 2004] kJ) was not statistically different from TEE measured with the DLW method (10,252 [SD 1197] kJ) (P = 0.596). The Bland and Altman plot (Fig. 2) displays energy intake from RiksmatenFlex and TEE from DLW. Although the mean difference was small (-237 kJ/24 h, -2.3% of average TEE), the limits of agreement were wide (± 4239 kJ/24 h) and there was a positive association between the difference and average of the two methods (y = 0.83X – 8647; r = 0.479, P = 0.018). More specifically, lower energy intake levels tended to be underestimated compared to TEE while higher levels tended to be overestimated.

Fig. 2
figure 2

Bland and Altman plot for comparison of energy intake (EI) estimated using RiksmatenFlex compared to total energy expenditure (TEE) assessed through the doubly labelled water method. The mean difference between the methods was − 237 kJ/24 h and limits of agreement (2SD) of 4239 kJ/24 h. The regression equation was y = 0.83X – 8647 (r = 0.479, p = 0.018)

Full size image

Table 2 shows average intakes and correlations for energy, macronutrients and key unhealthy and healthy foods estimated through RiksmatenFlex versus 24 h telephone dietary recalls. There was a significant positive correlation for energy intake between the two methods (r = 0.727, P < 0.001) and no significant difference between means was observed (9427 [SD 1817] kJ vs. 9432 [SD 1936] kJ, P = 0.978). The Bland and Altman plot showed large limits of agreement (± 2727 kJ/24 h) but there was no systematic trend in reports of energy intake using RiksmatenFlex compared to 24 h telephone dietary recalls (Fig. 3). Mean differences were low for all macronutrients (RiksmatenFlex vs. 24 h telephone dietary recalls: protein: -0.3, fat: -1.0 and carbohydrates: 1.2 E%, respectively) (Additional file, Supplementary Figures I-III). However, the Bland and Altman plots also showed wide limits of agreements corresponding to ± 3.7, ± 9.2 and ± 8.2 E%, respectively, with no proportional bias observed. Correspondingly, there were no statistically significant differences in average levels of key unhealthy and healthy foods between the two assessment methods (P = 0.14–0.90) (Table 2). Nevertheless, the Bland and Altman comparison showed large limits of agreement for all foods, e.g., ± 173 g/day for fruits and vegetables (Additional file, Supplementary Table 2). Moderate to high correlations ranging from 0.751 to 0.931 (all P < 0.001) were found for all food groups (Table 2).

Table 2 Mean intakes and correlations for energy intake, macronutrients and selected key healthy and unhealthy foods and beverages estimated by 24 h telephone dietary recalls and RiksmatenFlex (n = 52)
Full size table
Fig. 3
figure 3

Bland and Altman plot for comparison of energy intake (EI) estimated using RiksmatenFlex compared to EI assessed through 24 h telephone dietary recalls. The mean difference between the methods was 5.3 kJ/24 h and limits of agreement (2SD) of 2727 kJ/24 h. The regression equation was y = 0.07x – 690 (r = 0.09, p = 0.515)

Full size image

Average intake for the SHEI score and its components from 24 h telephone dietary recalls and RiksmatenFlex are shown in Table 3. The average SHEI score assessed with 24 h telephone dietary recalls (6.44 [SD 1.01]) was not significantly different from that of RiksmatenFlex (6.60 [SD 0.99]) (P = 0.066). Although, a small mean difference in average SHEI score (+ 0.16 units for RiksmatenFlex versus 24 h telephone dietary recalls), the Bland and Altman plot revealed relatively wide limits of agreement of ± 1.2 units (Additional file, Supplementary Figure IV). Finally, a high correlation (r = 0.815, P < 0.001) between SHEI score assessed with the two methods was observed (Table 3). Sucrose (E%) was the only component of the SHEI score that differed between the methods (average: -1.3 E%; P < 0.001).

Table 3 Mean intakes and correlations for the Swedish Healthy Eating Index (SHEI) score and its components estimated by 24 h telephone dietary recalls and RiksmatenFlex (n = 52)
Full size table

Discussion

This is the first study to investigate validity of dietary intakes obtained with RiksmatenFlex in pregnant women. We found that the mean difference between energy intake from RiksmatenFlex and corresponding TEE obtained from the reference standard, the DLW method, was only − 237 kJ/24 h (-2.3%). Even though there are, to the best of our knowledge, no sharp cut-offs when applying the Bland and Altman method, such a small mean difference in energy intake should be considered an acceptable agreement and it is also in accordance with Lombard et al. (mean difference: 0–10%, acceptable agreement) [28]. For comparison, a review of 59 studies in adults by Burrows et al. reported that average energy intake was underestimated by 1–47% for traditional dietary methods [9]. Validation studies with DLW are scarce in pregnant women, however, Svensson et al. previously reported that a short dietary questionnaire underestimated energy intake by 21% on average in pregnant women [29]. Also, another study found that an image-based method underestimated energy intake compared to DLW by 37% in a pregnant population with obesity [30]. Thus, even though we found a tendency that lower energy intake levels were underestimated, and higher levels overestimated, RiksmatenFlex performed relatively well considering the evidence base for traditional methods as well as newer online dietary methods regarding its ability to capture average energy intakes.

Our results also indicated that RiksmatenFlex captured average intake of macronutrients as well as unhealthy and healthy foods similar to 24 h telephone dietary recalls. Moreover, the average SHEI score did not differ between RiksmatenFlex and 24 h telephone dietary recalls, indicating that RiksmatenFlex accurately can capture adherence to Swedish food-based dietary guidelines. Only one component of the SHEI score, sucrose intake (E %), was overestimated by RiksmatenFlex versus 24 h telephone dietary recalls, however, the difference was relatively small (1.3 E %). We can only speculate about the reason for this difference, but possible explanations include that women reported portion sizes for sweets and similar foods differently for the two methods. Validation studies of dietary intake through digital assessment methods in pregnancy are limited. However, a previous validation study of online 24 h dietary recalls found that the method was valid at a group level assessing energy and most nutrients when compared against a 3 day food record [31]. Further, image-based assessment methods have shown agreement when validated against 24 h dietary recalls in terms of energy as well as macro and micro nutrients [32].

The method RiksmatenFlex has previously been validated in adolescents against estimated energy expenditure from accelerometer data, biomarkers and comparison with 24 h dietary recalls [14]. In contrast to this study, RiksmatenFlex tended to overestimate average energy intake compared to estimated energy expenditure in this population [14]. This might be explained by that estimated energy expenditure was derived from accelerometer data. Accelerometry is not considered a reference standard to validate energy intake and it is well-known that accelerometers cannot capture all types of physical activity, which might be an explanation for lower estimated energy expenditure compared to energy values obtained with RiksmatenFlex. Similar to us, Lindroos et al. found that energy intakes tended to be over-reported at higher intake levels [14]. Further, RiksmatenFlex did in comparison to 24 h dietary recalls and biomarkers, capture intake of energy, fruit, vegetables and wholegrain in a comparable way in adolescents [14]. These findings are in line with our results, showing no difference in the intake of unhealthy or healthy foods and we also found that average energy intake was similar to average TEE.

We found that the limits of agreement were wide for all investigated dietary variables (energy, macronutrients, key foods and SHEI scores). To illustrate, the limits of agreement corresponded to as much as 40% of energy intake and intakes of fruits and vegetables, which limits use at an individual level. However, it is also important to note that this is commonly seen in validation studies of dietary methods in various populations including children, adults and pregnant women [14, 29, 33,34,35]. It is also expected as the day-to-day variation in energy intake is larger than the corresponding variation in TEE [36]. Still, further research is required in order to improve the accuracy of RiksmatenFlex and other dietary assessment methods at an individual level.

This study has several strengths. We used the DLW method to validate energy intake, which is considered the reference method [37]. We assessed dietary intake from RiksmatenFlex, 24 h telephone dietary recalls and TEE from the DLW method during the same time period, ensuring comparability between estimates. Further, the 24 h telephone dietary recalls were performed to match the days for when participants recorded their diet in RiksmatenFlex, making sure that we validated intakes from the same days and one weekend day was also included. Given that the days were matched, we cannot exclude the possibility of increased reporting accuracy if participants were affected by what earlier had been reported for that day with the other assessment method, thus there may be a risk that our observed correlation coefficients for the two dietary assessment methods are overestimated. However, in this context it is relevant to note that we also observed a strong correlation between energy intake using RiksmatenFlex and TEE using the DLW method where the methods do not share common errors [38]. Also, the order of completion of the two assessment methods was random and given that we compared three days of data and that day-to-day variation can be large, we believe this was a suitable way to validate intakes from RiksmatenFlex. Finally, we validated the SHEI score obtained from RiksmatenFlex as a measure of participants’ adherence to national food-based dietary guidelines. The SHEI score was used as a measure of participants’ diets in the HealthyMoms trial, and it was also one of the outcomes we observed an intervention effect on. There are also limitations to this study. We used 24 h telephone dietary recalls for validation of intakes of macronutrients, key unhealthy and healthy foods and the SHEI score. The 24 h recall method is not a reference method for these variables and it should be noted that both the validation method, i.e., 24 h telephone dietary recalls and RiksmatenFlex are based on self-report and share common errors, which could result in an overestimated correlation coefficient [38]. However, the 24 h recall method is a well-accepted method to assess current dietary intake and has, compared to other dietary assessment methods, been associated with less misreporting of dietary intake [9]. Moreover, we had a relatively small sample size with a relatively high educational level which might limit generalizability of our result. Furthermore, our results need to be confirmed in pregnant populations also including later stages of pregnancy and more women with obesity. Nevertheless, in this context it is important to note that the women covered a wide range in baseline characteristics including BMI as well as TEE and dietary variables. Finally, data collection was performed prior to any randomization in the HealthyMoms trial and hence participants had not taken part of any intervention content (e.g., recommendations for physical activity and diet) that might have affected their diet or physical activity levels.

Through this study we have extended the validity of RiksmatenFlex to also include pregnant women. The validation of RiksmatenFlex further strengthens the result obtained in the HealthyMoms trial where we observed a beneficial effect on diet, more specifically on the SHEI score [15], which we found to accurately be captured through RiksmatenFlex compared to 24 h telephone dietary recalls. Our findings suggest that RiksmatenFlex can be used as a dietary assessment tool in other interventions targeting pregnant women as well as in dietary surveys to capture dietary intake on a national level.

Conclusion

We found that RiksmatenFlex accurately captured average intakes of energy, key foods (e.g., fruits and vegetables, red meat and processed meat, sweetened beverages) and adherence to food based dietary guidelines (SHEI score) in pregnant women. This validation study extends previous validation results in adolescents and supports that RiksmatenFlex may be a useful tool for national surveys and intervention studies targeting pregnant women.

Data availability

The data that support the findings of this study are not openly available due to reasons of sensitivity and are available from the corresponding author upon reasonable request. Data are located in controlled access data storage at Karolinska Institutet.

Abbreviations

DLW:

Doubly labelled water

E%:

Energy percent

GWG:

Gestational weight gain

SD:

Standard deviation

SHEI:

Swedish Healthy Eating Index

TEE:

Total energy expenditure

References

  1. Teede HJ, Bailey C, Moran LJ, Bahri Khomami M, Enticott J, Ranasinha S, et al. Association of antenatal diet and physical activity-based interventions with gestational weight gain and pregnancy outcomes: a systematic review and meta-analysis. JAMA Intern Med. 2022;182(2):106–14. https://doi.org/10.1001/jamainternmed.2021.6373.

  2. You Z, Shan L, Cheng S, Xia Y, Zhao Y, Zhang H, et al. Dietary intake patterns during pregnancy and excessive gestational weight gain: a systematic review and meta-analysis. Food Funct. 2023;14:5910–20. https://doi.org/10.1039/d3fo01550e.

    Article  CAS  PubMed  Google Scholar 

  3. Ferreira LB, Lobo CV, Miranda AEDS, Carvalho BDC, Dos Santos LC. Dietary patterns during pregnancy and Gestational Weight Gain: a systematic review. Rev Bras De Ginecol Obstet. 2022;44(5):540–7. https://doi.org/10.1055/s-0042-1744290.

    Article  Google Scholar 

  4. Flor-Alemany M, Acosta P, Marín-Jiménez N, Baena-García L, Aranda P, Aparicio VA. Influence of the degree of adherence to the mediterranean diet and its components on cardiometabolic risk during pregnancy. The GESTAFIT project. Nutr Metab Cardiovasc Dis. 2021;31(8):2311–8. https://doi.org/10.1016/j.numecd.2021.04.019.

    Article  CAS  PubMed  Google Scholar 

  5. The Public Health Agency of Sweden. Statistik om övervikt och fetma hos gravida. https://www.folkhalsomyndigheten.se/livsvillkor-levnadsvanor/mat-fysisk-aktivitet-overvikt-och-fetma/overvikt-och-fetma/statistik-om-overvikt-och-fetma/overvikt-och-fetma-hos-gravida/. Accessed Apr 2024.

  6. Wang MC, Freaney PM, Perak AM, Greenland P, Lloyd-Jones DM, Grobman WA, et al. Trends in prepregnancy obesity and association with adverse pregnancy outcomes in the United States, 2013 to 2018. J Am Heart Assoc. 2021;10(17). https://doi.org/10.1161/JAHA.120.020717.

  7. Goldstein RF, Abell SK, Ranasinha S, Misso ML, Boyle JA, Harrison CL, et al. Gestational weight gain across continents and ethnicity: systematic review and meta-analysis of maternal and infant outcomes in more than one million women. BMC Med. 2018;16(1). https://doi.org/10.1186/s12916-018-1128-1.

  8. Khammarnia M, Ansari-Moghaddam A, kakhki FG, Clark CCT, Barahouei FB. Maternal macronutrient and energy intake during pregnancy: a systematic review and meta-analysis. BMC Public Health. 2024;24(1):1–19. https://doi.org/10.1186/s12889-024-17862-x.

    Article  Google Scholar 

  9. Burrows TL, Ho YY, Rollo ME, Collins CE. Validity of Dietary Assessment methods when compared to the method of doubly labeled water: a systematic review in adults. Front Endocrinol Front Media. 2019;10(10):850. https://doi.org/10.3389/fendo.2019.00850.

    Article  Google Scholar 

  10. McKenzie BL, Coyle DH, Santos JA, Burrows T, Rosewarne E, Peters SAE, et al. Investigating sex differences in the accuracy of dietary assessment methods to measure energy intake in adults: a systematic review and meta-analysis. Am J Clin Nutr. 2021;113(5):1241–55. https://doi.org/10.1093/ajcn/nqaa370.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  11. Howes EM, Laskaridou E, Davy KP, Hedrick VE. Representation of adults with class III obesity in studies assessing validity of self-reported energy intake using doubly labeled water: a systematic review. Obes Rev. 2024;25(5). https://doi.org/10.1111/obr.13713.

  12. Shim J-S, Oh K, Kim HC. Dietary assessment methods in epidemiologic studies. Epidemiol Health. 2014;36. https://doi.org/10.4178/epih/e2014009.

  13. Capling L, Beck KL, Gifford JA, Slater G, Flood VM, O’Connor H. Validity of dietary assessment in athletes: a systematic review. Nutrients. 2017;9:1313. https://doi.org/10.3390/nu912131.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Lindroos AK, Sipinen JP, Axelsson C, Nyberg G, Landberg R, Leanderson P, et al. Use of a web-based dietary assessment tool (Riksmatenflex) in Swedish adolescents: comparison and validation study. J Med Internet Res. 2019;21(10). https://doi.org/10.2196/12572.

  15. Sandborg J, Söderström E, Henriksson P, Bendtsen M, Henström M, Leppänen MH, et al. Effectiveness of a smartphone app to promote healthy weight gain, diet, and physical activity during pregnancy (Healthymoms): Randomized controlled trial. JMIR mHealth uHealth. 2021;9(3). https://doi.org/10.2196/26091.

  16. Swedish Food Agency. Utvärdering av metoden i Riksmaten småbarn. https://www.livsmedelsverket.se/matvanor-halsa--miljo/matvanor---undersokningar/riksmaten-smabarn/utvardering-av-metod. Accessed Apr 2024.

  17. Lundqvist A, Johansson I, Wennberg AL, Hultdin J, Högberg U, Hamberg K, et al. Reported dietary intake in early pregnant compared to non-pregnant women - a cross-sectional study. BMC Pregnancy Childbirth. 2014;14:373. https://doi.org/10.1186/s12884-014-0373-3.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  18. Forbes LE, Graham JE, Berglund C, Bell RC. Dietary change during pregnancy and women’s reasons for change. Nutrients. 2018;10:1032. https://doi.org/10.3390/nu10081032.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Henriksson P, Sandborg J, Blomberg M, Alexandrou C, Maddison R, Silfvernagel K, et al. A smartphone app to promote healthy weight gain, diet, and physical activity during pregnancy (HealthyMoms): protocol for a randomized controlled trial. J Med Internet Res. 2019;8(3). https://doi.org/10.2196/13011.

  20. Moraeus L, Lemming EW, Hursti UKK, Arnemo M, Sipinen JP, Lindroos AK. Riksmaten adolescents 2016–17: a national dietary survey in Sweden – Design, methods, and participation. Food Nutr Res. 2018;62:1381. https://doi.org/10.29219/fnr.v62.1381.

    Article  Google Scholar 

  21. The Swedish Food Agency. The food database. https://www.livsmedelsverket.se/livsmedel-och-innehall/naringsamne/livsmedelsdatabasen. Accessed April 2024.

  22. Moraeus L, Lindroos AK, Warensjö Lemming E, Mattisson I. Diet diversity score and healthy eating index in relation to diet quality and socio-demographic factors: results from a cross-sectional national dietary survey of Swedish adolescents. Public Health Nutr. 2020;23(10):1754–65. https://doi.org/10.1017/S1368980019004671.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Nordic Council of Ministers. Nordic Nutriton Recommendations. 2012. Integrating nutrition and physical activity. 2014. https://www.norden.org/en/publication/nordic-nutrition-recommendations-2012. Accessed April 2024.

  24. Delany JP, Schoeller DA, Hoyt RW, Askew EW, Sharp MA. Field use of D218O to measure energy expenditure of soldiers at different energy intakes. J Appl Physiol. 1989;67:1922–9. https://doi.org/10.1152/jappl.1989.67.5.1922.

    Article  CAS  PubMed  Google Scholar 

  25. Speakman JR, Yamada Y, Sagayama H, Berman ESF, Ainslie PN, Andersen LF, et al. A standard calculation methodology for human doubly labeled water studies. Cell Rep Med. 2021;2. https://doi.org/10.1016/j.xcrm.2021.100203.

  26. Weir J. New methods for calculating metabolic rate with special reference to protein metabolism. J Physiol. 1949;109:1–9. https://doi.org/10.1113/jphysiol.1949.sp004363.

    Article  PubMed  PubMed Central  Google Scholar 

  27. Bland MJ, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986;1(8476):307–10.

    Article  CAS  PubMed  Google Scholar 

  28. Lombard MJ, Steyn NP, Charlton KE, Senekal M. Application and interpretation of multiple statistical tests to evaluate validity of dietary intake assessment methods. Nutr J. 2015;14:40. https://doi.org/10.1186/s12937-015-0027-y.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Svensson Å, Renström F, Bluck L, Lissner L, Franks PW, Larsson C. Dietary intake assessment in women with different weight and pregnancy status using a short questionnaire. Public Health Nutr. 2014;17(9):1939–48. https://doi.org/10.1017/S1368980013003042.

    Article  PubMed  Google Scholar 

  30. Most J, Vallo PM, Altazan AD, Gilmore LA, Sutton EF, Cain LE, et al. Food photography is not an accurate measure of energy intake in obese, pregnant women. J Nutr. 2018;148(4):658–63. https://doi.org/10.1093/jn/nxy009.

    Article  PubMed  PubMed Central  Google Scholar 

  31. Savard C, Lemieux S, Lafrenière J, Laramée C, Robitaille J, Morisset AS. Validation of a self-administered web-based 24-hour dietary recall among pregnant women. BMC Pregnancy Childbirth. 2018;18(1):112. https://doi.org/10.1186/s12884-018-1741-1.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  32. Ashman AM, Collins CE, Brown LJ, Rae KM, Rollo ME. Validation of a smartphone image-based dietary assessment method for pregnant women. Nutrients. 2017;9(1). https://doi.org/10.3390/nu9010073.

  33. Nyström CD, Forsum E, Henriksson H, Trolle-Lagerros Y, Larsson C, Maddison R, et al. A mobile phone based method to assess energy and food intake in young children: A validation study against the doubly labelled water method and 24 h dietary recalls. Nutrients. 2016;8(1). https://doi.org/10.3390/nu8010050.

  34. Nyström CD, Henriksson H, Alexandrou C, Bergström A, Bonn S, Bälter K, et al. Validation of an online food frequency questionnaire against doubly labelled water and 24 h dietary recalls in pre-school children. Nutrients. 2017;9(1). https://doi.org/10.3390/nu9010066.

  35. Eke H, Sjöblom L, Lagerros YT, Bonn SE. A validation study comparing energy and nutrient intake between a web-based food frequency questionnaire and a 4-d dietary record. Nutrition. 2024;120. https://doi.org/10.1016/j.nut.2023.11233.

  36. Hall KD, Heymsfield SB, Kemnitz JW, Klein S, Schoeller DA, Speakman JR. Energy balance and its components: implications for body weight regulation. Am J Clin Nutr. 2012;95(4):989–94. https://doi.org/10.3945/ajcn.112.036350.

    Article  PubMed  PubMed Central  Google Scholar 

  37. Pontzer H, Yamada Y, Sagayama H, Ainslie PN, Andersen LF, Anderson LJ, et al. Daily energy expenditure through the human life course. Science. 2021;373:6556. https://doi.org/10.1126/science.abe5017.

    Article  CAS  Google Scholar 

  38. Krikpatrick SI, Baranowski T, Subar AF, Tooze JA, Frongillo EA. Best practices for conducting and interpreting studies to Validate Self-Report Dietary Assessment methods. J Acad Nutr Diet. 2019;119(11):1801–16. https://doi.org/10.1016/j.jand.2019.06.01.

    Article  Google Scholar 

Download references

Acknowledgements

The authors would like to thank the participating pregnant women as well as Eva Flinke for help with recruitment and data collection. The authors would also like to thank Pontus Henriksson for supporting in the first phase of this study.

Funding

The HealthyMoms trial was funded by the Swedish Research Council (2016 − 01147 to ML) and additionally supported by the Swedish Research Council for Health, Working Life and Welfare (2018 − 01410 to ML); Bo and Vera Ax: son Johnsons’ Foundation (to ML); and ALF Grants, Region Östergötland (LIO-893101, to ML).

Open access funding provided by Karolinska Institute.

Author information

Authors and Affiliations

  1. Department of Health, Medicine and Caring Sciences, Linköping University, Linköping, Sweden

    Emmie Söderström

  2. Department of Medicine, Karolinska Institutet, Huddinge, Sweden

    Emmie Söderström, Johanna Sandborg, Ellinor Nilsson, Maria Henström & Marie Löf

  3. Medical Epidemiology, Department of Surgical Sciences, Uppsala University, Uppsala, Sweden

    Eva Warensjö Lemming

  4. Department of Food science, Nutrition and Dietetics, Uppsala University, Uppsala, Sweden

    Eva Warensjö Lemming

  5. Swedish Food Agency, Uppsala, Sweden

    Anna Karin Lindroos & Jessica Petrelius Sipinen

  6. Department of Internal Medicine and Clinical Nutrition, the Sahlgrenska Academy, University of Gothenburg, Gothenburg, Sweden

    Anna Karin Lindroos

  7. Pennington Biomedical Research Center, Baton Rouge, LA, USA

    Jennifer Rood

Authors
  1. Emmie Söderström
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Johanna Sandborg
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ellinor Nilsson
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Maria Henström
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Eva Warensjö Lemming
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Anna Karin Lindroos
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Jennifer Rood
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Jessica Petrelius Sipinen
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Marie Löf
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

ML is the principal investigator for the HealthyMoms trial. ES contributed to study design for this validation study and was responsible for data collection, data analysis and drafted the first full version of the manuscript. JS contributed to data collection by means of RiksmatenFlex. EN contributed to imputation of data for 24 h dietary recalls and MH to processing food groups for RiksmatenFlex. EWL, AKL and JPS set up RiksmatenFlex for this study and processed reported intakes of foods and drinks into intakes of energy and nutrients for RiksmatenFlex. JR analyzed the dose and urine samples for the women who had their total energy expenditure measured by means of the doubly labelled water method. The manuscript was reviewed by all authors and all authors approved the final version.

Corresponding author

Correspondence to Emmie Söderström.

Ethics declarations

Ethics approval and consent to participate

This study follows the Declaration of Helsinki and all participants in the study provided their written informed consents before their participation. All procedures of the study were approved by the Regional Ethical Review Board in Linköping, Sweden (reference numbers: 2017/112 − 31, and 2018/262 − 32).

Consent for publication

Not applicable.

Competing interests

The authors declare no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Additional file.

Compilation of supplementary tables and figures. Supplementary Table I: Description of the Swedish Healthy Eating Index (SHEI) score. Supplementary Table II: Comparison of intake of macronutrients and key healthy and unhealthy foods between RiksmatenFlex and 24 h telephone dietary recalls in accordance with the Bland and Altman procedure. Supplementary Figures I-IX: Bland and Altman plots and scatterplots for the comparison of macronutrients, energy and Swedish Healthy Eating Index score for RiksmatenFlex versus the 24 h dietary recalls, n = 52).

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Söderström, E., Sandborg, J., Nilsson, E. et al. Validation of an web-based dietary assessment tool (RiksmatenFlex) against doubly labelled water and 24 h dietary recalls in pregnant women. Nutr J 23, 85 (2024). https://doi.org/10.1186/s12937-024-00987-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12937-024-00987-5

Keywords

Nutrition Journal

ISSN: 1475-2891

Contact us