- Open Access
Repeatability and measurement error in the assessment of choline and betaine dietary intake: the Atherosclerosis Risk in Communities (ARIC) Study
Nutrition Journal volume 8, Article number: 14 (2009)
The repeatability of a risk factor measurement affects the ability to accurately ascertain its association with a specific outcome. Choline is involved in methylation of homocysteine, a putative risk factor for cardiovascular disease, to methionine through a betaine-dependent pathway (one-carbon metabolism). It is unknown whether dietary intake of choline meets the recommended Adequate Intake (AI) proposed for choline (550 mg/day for men and 425 mg/day for women). The Estimated Average Requirement (EAR) remains to be established in population settings. Our objectives were to ascertain the reliability of choline and related nutrients (folate and methionine) intakes assessed with a brief food frequency questionnaire (FFQ) and to estimate dietary intake of choline and betaine in a bi-ethnic population.
We estimated the FFQ dietary instrument reliability for the Atherosclerosis Risk in Communities (ARIC) study and the measurement error for choline and related nutrients from a stratified random sample of the ARIC study participants at the second visit, 1990–92 (N = 1,004). In ARIC, a population-based cohort of 15,792 men and women aged 45–64 years (1987–89) recruited at four locales in the U.S., diet was assessed in 15,706 baseline study participants using a version of the Willett 61-item FFQ, expanded to include some ethnic foods. Intraindividual variability for choline, folate and methionine were estimated using mixed models regression.
Measurement error was substantial for the nutrients considered. The reliability coefficients were 0.50 for choline (0.50 for choline plus betaine), 0.53 for folate, 0.48 for methionine and 0.43 for total energy intake. In the ARIC population, the median and the 75th percentile of dietary choline intake were 284 mg/day and 367 mg/day, respectively. 94% of men and 89% of women had an intake of choline below that proposed as AI. African Americans had a lower dietary intake of choline in both genders.
The three-year reliability of reported dietary intake was similar for choline and related nutrients, in the range as that published in the literature for other micronutrients. Using a brief FFQ to estimate intake, the majority of individuals in the ARIC cohort had an intake of choline below the values proposed as AI.
Population-level measurements of dietary intake of the essential nutrient choline and its metabolite, betaine, are of interest since a food composition database has only recently become available [1, 2]. As a result, the habitual intake of these micronutrients and their health effects at the population level are not well established. In animal studies, low dietary intake of choline and betaine ostensibly results in aberrant DNA methylation and possible increased atherogenesis . Independently of folate, dietary intake of choline and betaine are inversely associated with plasma homocysteine [4–6], a putative cardiovascular disease risk factor [7, 8]. While it is true that it is unknown whether dietary intake of choline in the U.S. population meets the recommended Adequate Intake (AI) proposed for this nutrient, 550 mg/day for men and 425 mg/day for women , the studies conducted suggest that an important percent of the population may be choline deficient [10–12]. The Estimated Average Requirement (EAR), whose calculation requires a higher level of evidence, remains to be established in populations .
The reliability (reproducibility) of micronutrient intake, as assessed with a food frequency questionnaire, is lower compared with that of macronutrients [14–16]. Because the random effect (the error prone variance – covariance structure) of dietary assessment has been shown to have an important impact on risk estimates [17, 18], several studies have estimated and have adjusted for measurement error in the assessment of dietary intake. The objective of our study was to ascertain the reliability of the dietary assessment for choline as assessed with a brief food frequency questionnaire (FFQ) and to estimate population dietary choline and betaine intakes. We also aimed to assess the FFQ measurement error and study the intraindividual variability when several related nutrients are considered simultaneously.
Our study is based on data from the cohort component of the Atherosclerosis Risk in Communities (ARIC) Study. ARIC is an observational bi-racial cohort of 15,792 men and women between the ages of 45 and 64, sampled from four U.S. communities, Forsyth County, NC, Jackson, MS, suburbs of Minneapolis, MN, and Washington County, MD . Enrollment reflected the demographics of the communities from which they were selected with the exception of the city of Jackson where enrollment was limited to black/African American residents. Baseline home interviews and examinations at specialized field centers occurred during 1987–1989; response rates were 46% of all eligible subjects in Jackson and approximately 66% in the remaining sites. The population included in these analyses is composed of 15,706 men and women aged 45–64 years with dietary data at the baseline visit.
The habitual dietary intake of choline and betaine was estimated and quantified with a 66-item food-frequency-questionnaire (FFQ), based on the Willett 61-item FFQ and expanded to include some ethnic foods. This dietary assessment instrument was applied for all the ARIC participants at baseline and on a random sample of 1,004 participants three years later (1990–1992). The participants were asked how often, on average, they had consumed listed items during the previous year. Nine frequency responses were listed ranging from more than six per day to almost never. We calculated daily servings by converting the consumption frequency to servings per day. Dietary choline and betaine were estimated as the sum of daily intakes using a choline and betaine database composed of the USDA choline and betaine content in common foods database (207 food items) and the University of Minnesota Nutrition Data System database for the portion sizes.
As part of the ARIC Dietary Assessment Repeatability Study, the mentioned random sample composed of 1,004 subjects (522 males and 482 females) was selected in equal number of participants from each ARIC locale, and studied three years after the baseline examination. The dietary form was administered in an identical manner as done during the ARIC baseline examination. The intraindividual variability (between-person and dietary instrument variability) was calculated and the reliability coefficient, the correlation between measures made at repeat visits, was estimated using mixed models regression .
For regressions models with several nutrients considered at one time, accounting for measurement error is complex. One needs to know not only the reliability for each independent variable in the model but also the measurement variation of the covariance between them, which is necessary in the measurement error estimation . The total variance could be written as σ2 Total(T) = σBP 2 + σe 2 where σBP 2 is the between-person component of variation and σe 2 is the intraindividual component, sometimes called the measurement error. Using our repeatability study, a conditional reliability matrix was constructed; this matrix was derived from the measurement error estimates. To consider the joint intraindividual variation in several variables the total variance-covariance matrix of that set (vector) of variables can be specified as a sum of the between-person variance-covariance matrix (ΣTotal = ΣBP + Σe). In our mixed model (Additional file 1) all four interrelated parameters, choline, total energy intake, folate and methionine, were the dependent variables, subject was used as a random effect variable, and study center and examination visit as fixed effect variables. Algorithms shown in Appendix were used to estimate the general variance-covariance matrix for the dietary compounds. From this the between-person (σB 2) and the error variances (σe 2) and error covariances between the nutrients, as well as the ratios of the between to the total (σT 2) variances were produced. In a first step the mixed model had an unstructured composition. We used the output estimates (as an average) as starting values in a new mixed model with the same variables and a structured covariance shown in Appendix. From this last mixed model we obtained the between-person and error variances and covariances as well as the ratios of between to total (σB 2/σT 2) variances and error to total (σe 2/σT 2) variances. Both the correlation coefficient between visits for choline and other nutrients, ρchol = covvisit/varchol = σB 2/σT 2, as well as the total variance were calculated. Following the modeling to assess the joint intraindividual variability of the interrelated nutrients, a model was constructed with choline as the only dependent variable and technician nested within center, one of the main randomness factors in questionnaire-based dietary assessments, added to the random effect variables.
Of the 1,004 participants in the repeatability study, 482 (48%) were female and 294 (29%) were African Americans. The mean age was 55 years. Only for choline and methionine the mean and the standard deviation of energy-adjusted nutrient intakes were different between repeat visits Table 1.
In mixed models used to assess the joint intraindividual variability for all interrelated nutrients Tables 2 we found a reliability coefficient of 0.50 for choline, 0.43 for caloric intake and 0.53 for folate (0.50 for total choline; choline plus betaine). These coefficients were similar to Pearson correlation coefficients estimated between the two visits (0.48 for choline and 0.49 for folate). The reliability coefficients for all studied nutrients showed similar values to those typically seen in the nutritional epidemiologic literature for micronutrients. The correlations between the observed values of the three micronutrients were 0.55, 0.91 and 0.53 for choline-folate, choline-methionine and folate-methionine, respectively. The measurement error variances had high values for all considered nutrients; 6,228 for choline, 145,397 for total energy intake, 5,504 for folate and 221,628 for methionine (Table 2). Somewhat surprisingly, the technician nested within center measurement error component was negligible, representing less than 0.01% of the total variance (results not shown).
In the full ARIC cohort the median and the 75th percentile of dietary choline intake were 284 mg/day and 367 mg/day, respectively. In regression models, choline intake was associated with gender, race, study site, BMI, total energy intake, physical activity and, in women, with menopausal status (results not shown). Table 3 presents a series of statistics of interest for both choline and betaine. As expected, men had a higher intake compared to women. For men, African Americans had a lower intake for both choline and betaine. For comparison purposes, the percentages of participants below the AI were 94% of white men, 90% of white women, 93% of African American men, and 89% of African American women (results not shown).
We assessed the reliability of a brief food frequency questionnaire and estimated the dietary intake of choline and betaine in a biracial middle aged cohort of men and women from four US locales. In our population-based cohort the majority of participants had an intake below the value proposed as the adequate intake (AI), used for comparison purposes. The reliability coefficients between visits were in the range of those for other micronutrients but lower compared with those found, for example, for laboratory analytes . The measurement error variance values were substantial for all considered nutrients in concordance with previous studies that suggested that the FFQ is underestimating the actual dietary intakes. The variances of the mean dietary intakes of choline were relatively high in all race-gender groups, a finding that was expected due to the relatively modest reliability coefficients.
Choline, an essential nutrient for humans [13, 23], is included in several compounds that belong to methyl-donors group. Betaine, a methyl-donor that is continuously produced from choline , has been shown to lead to immediate and long term lowering of plasma homocysteine after supplementation in the dietary intake range of betaine . Through aberrant methylation of DNA, a low dietary intake of methyl-donors alters epigenetic regulation of a series of genes by which the atherogenic mechanism may be accelerated [25, 26]. Folate and choline are metabolically interrelated . When folate availability diminishes, there is an increased demand for choline as a methyl donor . When choline availability is decreased, the demand for folate methyl-groups is increased . Because methyl donation by folate and choline can be interchangeable, both folate and choline should be considered in epidemiological studies assessing the relationship between dietary intake of these compounds and cardiovascular disease (CVD). Accurate analysis of choline intake was previously not possible because the choline content of most foods was not known until recently [1, 2]. During the past five years, several major population studies reported on the associations between high dietary intakes of choline and betaine and pathological conditions or markers of disease such as plasma total homocysteine (an inverse association in the Framingham Heart Study  and in the Nurses' Health Study ), incident coronary heart disease (marginally positive association in the Atherosclerosis Risk in Communities Study  and in the European Prospective Investigation into Cancer and Nutrition ), colorectal adenoma (positive association in the Nurses' Health Study ) and neural tube defects in offspring (negative association in a case-control study in California ). In a study that assessed the variability of dietary intake of choline in human subjects  in a clinical research setting, when healthy male and female volunteers were asked to select ad libitum a variety of foods, the standard deviations of choline in the total measured diet were 157 mg/day for males and 88 mg/day for females corresponding to a mean dietary intake of 631 mg/day for men, respectively 443 mg/day for women. These values are in the range of the AI for choline that has been tentatively set at 425 mg/day for women and 550 mg/day for men . The EAR, one of the Dietary Reference Intake (DRI) categories for choline that requires a higher level of evidence for its calculation, remains to be established in population settings.
Much epidemiologic research is based on estimation of an association between a putative risk factor and a health outcome – for example, dietary intake of a certain nutrient and coronary heart disease. Regression techniques, including Cox regression, produce biased estimates of exposure-disease relationships when the exposure variable has a high variability, which is equivalent with a low repeatability . The reliability coefficients were relatively low in our study, in the range 0.43–0.53. As a consequence regression calibration procedures, using these coefficients, should be used to adjust for the measurement error [34–36]. The algorithm we used permitted the partition of the total variance into the between-person component and the error component. For each of the nutrients considered these two components were of comparable magnitude, implying a relatively large measurement error.
As expected, the dietary choline intake was associated with factors such as gender, menopausal status, total energy intake and BMI. These associations might be explained by the consequence of a direct proportionality between the total quantity of ingested foods and the amount of choline within it than by the capacity of premenopausal women to internally synthesize choline moieties which have an impact on the choline plasma levels.
Several limitations of our study should be acknowledged. The interval between dietary assessments in the ARIC study was long, which may have resulted in changes in dietary intake over time. This may have contributed to the modest level of repeatability we observed. Another limitation is the use of a food frequency questionnaire to estimate intakes of choline and betaine in general. Not all foods containing choline and betaine are assessed with the ARIC FFQ. However, foods that were high in choline such as liver and eggs and would contribute significantly to the population intake were included. The validity of this questionnaire to assess intake of choline and betaine is unknown and remains of interest for future studies.
There are several strengths to our investigation. Prior to this study, information about the repeatability of the short version of the Willett FFQ as it pertains to dietary choline and betaine intake was lacking. There is also novelty in estimating intraindividual variability and correcting for measurement error bias as it pertains to choline and betaine. We report both the correlations between the two visits as well as the magnitude of error (variance components) in the dietary assessment which have an application for future studies.
For choline and for choline plus betaine the relative low reliability was similar to those of folate and methionine, and in the range of those reported for other micronutrients. In the estimation of these nutrients, adjustment for measurement variability (using, for example, a calibration method) should be used whenever possible. The majority of the ARIC participants were below the AI: 93% of white men, 88% of white women, 92% of African American men, and 87% of African American women.
USDA Database for the choline content of common foods: Edited by: Howe JC, Williams JR, Holden JM. 2004, Nutrient Data Laboratory, Agricultural Research Service, U.S. Department of Agriculture, in collaboration with Zeisel SH and Mar M-H, Department of Nutrition, University of North Carolina at Chapel Hill, [http://www.nal.usda.gov/fnic/foodcomp/Data/Choline/Choline.html]
Zeisel SH, Mar M-H, Howe JC, Holden JM: Concentrations of choline-containing compounds and betaine in common foods. Journal of Nutrition. 2003, 133: 1302-1307.
James SJ, Yin L: Diet-induced DNA damage and altered nucleotide metabolism in lymphocytes from methyl-donor-deficient rats. Carcinogenesis. 1989, 10: 1209-14. 10.1093/carcin/10.7.1209.
Steenge GR, Verhoef P, Katan MB: Betaine supplementation lowers plasma homocysteine in healthy men and women. Journal of Nutrition. 2003, 133: 1291-1295.
Olthof MR, Verhoef P: Effects of Betaine Intake on Plasma Homocysteine Concentrations and Consequences for Health. Curr Drug Metab. 2005, 6 (1): 15-22. 10.2174/1389200052997366.
da Costa K-A, Gaffney CE, Fischer LM, Zeisel SH: Choline deficiency in mice and humans is associated with increased plasma homocysteine concentration following a methionine load. American Journal of Clinical Nutrition. 2005, 81: 440-444.
Harjai KJ: Potential new cardiovascular risk factors: left ventricular hypertrophy, homocysteine, lipoprotein (a), triglycerides, oxidative stress, and fibrinogen. Annals of Internal Medicine. 1999, 131: 376-386.
Clarke R, Collins R, Lewington S, Donald A, Alfthan G, Tuomilehto J, (Homocysteine Studies Collaboration): Homocysteine and risk of ischemic heart disease and stroke: a meta-analysis. Journal of American Medical Association. 2002, 288: 2015-2022. 10.1001/jama.288.16.2015.
Yates AA, Schlicker SA, Suitor CW: Dietary Reference Intakes: the new basis for recommendations for calcium and related nutrients, B vitamins, and choline. Journal of American Dietary Association. 1998, 98: 699-706. 10.1016/S0002-8223(98)00160-6.
Shaw GM, Carmichael SL, Yang W, Selvin S, Schaffer DM: Periconceptional dietary intake of choline and betaine and neural tube defects in offspring. American Journal of Epidemiology. 2004, 160 (2): 102-109. 10.1093/aje/kwh187.
Cho E, Zeisel SH, Jacques P, Selhub J, Dougherty L, Colditz GA, Willett WC: Dietary choline and betaine assessed by food-frequency questionnaire in relation to plasma total homocysteine concentration in the Framingham Offspring Study. American Journal of Clinical Nutrition. 2006, 83: 905-11.
Chiuve SE, Giovannucci EL, Hankinson SE, Zeisel SH, Dougherty LW, Willett WC, Rimm EB: The association between betaine and choline intakes and the plasma concentrations of homocysteine in women. American Journal of Clinical Nutrition. 2007, 86: 1073-81.
Institute of Medicine and National Academy of Sciences, USA: Dietary reference intakes for folate, thiamin, riboflavin, niacin, vitamin B12, panthothenic acid, biotin, and choline. 1998, Washington D.C.: National Academy Press, 1: 390-422.
Willett WC: Nutritional epidemiology. 1998, New York, NY: Oxford University Press, 2
Patterson RE, Kristal AR, Tinker LF, Carter RA, Bolton MP, Agurs-Collins T: Measurement characteristics of the Women's Health Initiative food frequency questionnaire. Annals of Epidemiology. 1999, 9: 178-187. 10.1016/S1047-2797(98)00055-6.
Satia-Abouta J: Reliability and validity of self-report of vitamin and mineral supplement use in the vitamins and lifestyle study. American Journal of Epidemiology. 2003, 157 (10): 944-954. 10.1093/aje/kwg039.
Carroll RJ, Freedman LS, Hartman AM: Use of semiquantitative food frequency questionnaires to estimate the distribution of usual intake. American Journal of Epidemiology. 1996, 143 (4): 392-404.
Carroll RJ, Freedman LS, Kipnis V: Measurement error and dietary intake. Advances in experimental medicine and biology. 1998, 445: 139-145.
The ARIC Investigators: The Atherosclerosis Risk in Communities (ARIC) study: design and objectives. American Journal of Epidemiology. 1989, 129: 687-702.
Littell RC, Milliken GA, Stroup WW, Wolfinger RD: SAS system for mixed models. 1996, Cary, NC, SAS Institute Inc
Glesser LJ: The importance of assessing measurement reliability in multivariate regression. Journal of the American Statistical Association. 1992, 87 (419): 696-707. 10.2307/2290207.
Chambless LE, McMahon RP, Brown SA, Patsch W, Heiss G, Shen YL: Short-term intraindividual variability in lipoprotein measurements: the Atherosclerosis Risk in Communities (ARIC) Study. American Journal of Epidemiology. 1992, 136 (9): 1069-1081.
Zeisel SH, Niculescu MD: Choline and Phosphatidylcholine. Modern Nutrition in Health and Disease. Edited by: Shils ME, Shike M, Ross AC, Caballero B, Cousins RJ. 2006, Baltimore: Lippincott, Williams and Wilkins, 525-536. 10
Craig SAS: Betaine in human nutrition. American Journal of Clinical Nutrition. 2004, 80: 539-549.
Dong C, Yoon W, Goldschmidt-Clermont PJ: DNA methylation and atherosclerosis. Journal of Nutrition. 2002, 132 (8 Suppl): 2406S-2409S.
Zaina S, Lindholm MW, Lund G: Nutrition and aberrant DNA methylation patterns in atherosclerosis: more than just hyperhomocysteinemia?. Journal of Nutrition. 2005, 135: 5-8.
Zeisel SH, daCosta KA, Franklin PD, Alexander EA, LaMont JT, Sheard NF, Beiser A: Choline, an essential nutrient for humans. FASEB Journal. 1991, 5: 2093-2098.
Jacob RA, Jenden DJ, Allman-Farinelli MA, Swendseid ME: Folate nutriture alters choline status of women and men fed low choline diets. Journal of Nutrition. 1999, 129 (3): 712-717.
Kim YI, Miller JW, daCosta KA, Nadeau M, Smith D, Selhub J, Zeisel SH, Mason JB: Folate deficiency causes secondary depletion of choline and phosphocholine in liver. J Nutr. 1994, 124 (11): 2197-2203.
Bidulescu A, Chambless LE, Siega-Riz AM, Zeisel SH, Heiss G: Usual choline and betaine dietary intake and incident coronary heart disease: the Atherosclerosis Risk in Communities (ARIC) study. BMC Cardiovascular Disorders. 2007, 7: 20-10.1186/1471-2261-7-20.
Dalmeijer GW, Olthof MR, Verhoef P, Bots ML, Schouw van der YT: Prospective study on dietary intakes of folate, betaine, and choline and cardiovascular disease risk in women. European Journal of Clinical Nutrition. 2008, 62 (3): 386-94. 10.1038/sj.ejcn.1602725.
Cho E, Willett WC, Colditz GA, Fuchs CH, Wu K, Chan AT, Zeisel SH, Giovannucci EL: Dietary choline and betaine and the risk of distal colorectal adenoma in women. Journal of National Cancer Institute. 2007, 99: 1224-31. 10.1093/jnci/djm082.
Fischer LM, Scearce JA, Mar M-H, Patel J, Blanchard RT, Macintosh BA, Busby MG, Zeisel SH: Ad libitum choline intake in healthy individuals meets or exceeds the proposed adequate intake level. Journal of Nutrition. 2005, 135 (4): 826-829.
Rosner B, Willett WC, Spiegelman D: Correction of logistic regression relative risk estimates and confidence intervals for systematic within-person measurement error. Statistics in Medicine. 1989, 8: 1051-1069. 10.1002/sim.4780080413.
Spiegelman D, McDermott A, Rosner B: Regression calibration method for correcting measurement-error bias in nutritional epidemiology. 1997, 65 (4): 1179S-1186S.
Chambless LE, Davis V: Analysis of associations with change in a multivariate outcome variable when baseline is subject to measurement error. Statistics in Medicine. 2003, 22: 1041-1067. 10.1002/sim.1352.
The Atherosclerosis Risk in Communities (ARIC) Study is carried out as a collaborative study supported by the National Heart, Lung, and Blood Institute contracts: N01-HC-55015, N01-HC-55016, N01-HC-55018, N01-HC-55019, N01-HC-55020, N01-HC-55021 and N01-HC-55022. A list of principal ARIC study staff was published in American Journal of Epidemiology (1989; 129: 687–688). The authors thank the staff and participants of the ARIC study for their important contributions. Dr. A. Bidulescu was supported in part by two institutional training grants (HL07055 and DK07686) from the National Institutes of Health (NIH). Dr. A.M. Siega-Riz was supported by a research grants from the NIH (DK56350). Dr. S.H. Zeisel was supported by NIH grants DK55865 and DK56350, and by U.S. Department of Agriculture grant AG09525.
Dr. S. H. Zeisel received grant support from Mead Johnson Nutritionals and the Egg Nutrition Research Center for studies other than those described in this paper. The other authors declare that they have no competing interests.
AB, LEC and GH conceived of and designed the study. AB and LEC performed the statistical analyses. AB, LEC, AMSR, SHZ and GH interpreted the results. AB drafted the manuscript. All authors revised the manuscript for intellectual content, and read and approved the final manuscript.
Electronic supplementary material
Additional File 1: Measurement error model and variance-covariance matrix. The description provided represents the algorithms used to construct the measurement error mixed model and to obtain the variance-covariance matrix for the related dietary nutrients. (DOC 56 KB)
About this article
Cite this article
Bidulescu, A., Chambless, L.E., Siega-Riz, A.M. et al. Repeatability and measurement error in the assessment of choline and betaine dietary intake: the Atherosclerosis Risk in Communities (ARIC) Study. Nutr J 8, 14 (2009). https://doi.org/10.1186/1475-2891-8-14
- Food Frequency Questionnaire
- Total Energy Intake
- Adequate Intake