Repeatability and measurement error in the assessment of choline and betaine dietary intake: the Atherosclerosis Risk in Communities (ARIC) Study
© Bidulescu et al; licensee BioMed Central Ltd. 2009
Received: 28 October 2008
Accepted: 20 February 2009
Published: 20 February 2009
The repeatability of a risk factor measurement affects the ability to accurately ascertain its association with a specific outcome. Choline is involved in methylation of homocysteine, a putative risk factor for cardiovascular disease, to methionine through a betaine-dependent pathway (one-carbon metabolism). It is unknown whether dietary intake of choline meets the recommended Adequate Intake (AI) proposed for choline (550 mg/day for men and 425 mg/day for women). The Estimated Average Requirement (EAR) remains to be established in population settings. Our objectives were to ascertain the reliability of choline and related nutrients (folate and methionine) intakes assessed with a brief food frequency questionnaire (FFQ) and to estimate dietary intake of choline and betaine in a bi-ethnic population.
We estimated the FFQ dietary instrument reliability for the Atherosclerosis Risk in Communities (ARIC) study and the measurement error for choline and related nutrients from a stratified random sample of the ARIC study participants at the second visit, 1990–92 (N = 1,004). In ARIC, a population-based cohort of 15,792 men and women aged 45–64 years (1987–89) recruited at four locales in the U.S., diet was assessed in 15,706 baseline study participants using a version of the Willett 61-item FFQ, expanded to include some ethnic foods. Intraindividual variability for choline, folate and methionine were estimated using mixed models regression.
Measurement error was substantial for the nutrients considered. The reliability coefficients were 0.50 for choline (0.50 for choline plus betaine), 0.53 for folate, 0.48 for methionine and 0.43 for total energy intake. In the ARIC population, the median and the 75th percentile of dietary choline intake were 284 mg/day and 367 mg/day, respectively. 94% of men and 89% of women had an intake of choline below that proposed as AI. African Americans had a lower dietary intake of choline in both genders.
The three-year reliability of reported dietary intake was similar for choline and related nutrients, in the range as that published in the literature for other micronutrients. Using a brief FFQ to estimate intake, the majority of individuals in the ARIC cohort had an intake of choline below the values proposed as AI.
Population-level measurements of dietary intake of the essential nutrient choline and its metabolite, betaine, are of interest since a food composition database has only recently become available [1, 2]. As a result, the habitual intake of these micronutrients and their health effects at the population level are not well established. In animal studies, low dietary intake of choline and betaine ostensibly results in aberrant DNA methylation and possible increased atherogenesis . Independently of folate, dietary intake of choline and betaine are inversely associated with plasma homocysteine [4–6], a putative cardiovascular disease risk factor [7, 8]. While it is true that it is unknown whether dietary intake of choline in the U.S. population meets the recommended Adequate Intake (AI) proposed for this nutrient, 550 mg/day for men and 425 mg/day for women , the studies conducted suggest that an important percent of the population may be choline deficient [10–12]. The Estimated Average Requirement (EAR), whose calculation requires a higher level of evidence, remains to be established in populations .
The reliability (reproducibility) of micronutrient intake, as assessed with a food frequency questionnaire, is lower compared with that of macronutrients [14–16]. Because the random effect (the error prone variance – covariance structure) of dietary assessment has been shown to have an important impact on risk estimates [17, 18], several studies have estimated and have adjusted for measurement error in the assessment of dietary intake. The objective of our study was to ascertain the reliability of the dietary assessment for choline as assessed with a brief food frequency questionnaire (FFQ) and to estimate population dietary choline and betaine intakes. We also aimed to assess the FFQ measurement error and study the intraindividual variability when several related nutrients are considered simultaneously.
Our study is based on data from the cohort component of the Atherosclerosis Risk in Communities (ARIC) Study. ARIC is an observational bi-racial cohort of 15,792 men and women between the ages of 45 and 64, sampled from four U.S. communities, Forsyth County, NC, Jackson, MS, suburbs of Minneapolis, MN, and Washington County, MD . Enrollment reflected the demographics of the communities from which they were selected with the exception of the city of Jackson where enrollment was limited to black/African American residents. Baseline home interviews and examinations at specialized field centers occurred during 1987–1989; response rates were 46% of all eligible subjects in Jackson and approximately 66% in the remaining sites. The population included in these analyses is composed of 15,706 men and women aged 45–64 years with dietary data at the baseline visit.
The habitual dietary intake of choline and betaine was estimated and quantified with a 66-item food-frequency-questionnaire (FFQ), based on the Willett 61-item FFQ and expanded to include some ethnic foods. This dietary assessment instrument was applied for all the ARIC participants at baseline and on a random sample of 1,004 participants three years later (1990–1992). The participants were asked how often, on average, they had consumed listed items during the previous year. Nine frequency responses were listed ranging from more than six per day to almost never. We calculated daily servings by converting the consumption frequency to servings per day. Dietary choline and betaine were estimated as the sum of daily intakes using a choline and betaine database composed of the USDA choline and betaine content in common foods database (207 food items) and the University of Minnesota Nutrition Data System database for the portion sizes.
As part of the ARIC Dietary Assessment Repeatability Study, the mentioned random sample composed of 1,004 subjects (522 males and 482 females) was selected in equal number of participants from each ARIC locale, and studied three years after the baseline examination. The dietary form was administered in an identical manner as done during the ARIC baseline examination. The intraindividual variability (between-person and dietary instrument variability) was calculated and the reliability coefficient, the correlation between measures made at repeat visits, was estimated using mixed models regression .
For regressions models with several nutrients considered at one time, accounting for measurement error is complex. One needs to know not only the reliability for each independent variable in the model but also the measurement variation of the covariance between them, which is necessary in the measurement error estimation . The total variance could be written as σ2 Total(T) = σBP 2 + σe 2 where σBP 2 is the between-person component of variation and σe 2 is the intraindividual component, sometimes called the measurement error. Using our repeatability study, a conditional reliability matrix was constructed; this matrix was derived from the measurement error estimates. To consider the joint intraindividual variation in several variables the total variance-covariance matrix of that set (vector) of variables can be specified as a sum of the between-person variance-covariance matrix (ΣTotal = ΣBP + Σe). In our mixed model (Additional file 1) all four interrelated parameters, choline, total energy intake, folate and methionine, were the dependent variables, subject was used as a random effect variable, and study center and examination visit as fixed effect variables. Algorithms shown in Appendix were used to estimate the general variance-covariance matrix for the dietary compounds. From this the between-person (σB 2) and the error variances (σe 2) and error covariances between the nutrients, as well as the ratios of the between to the total (σT 2) variances were produced. In a first step the mixed model had an unstructured composition. We used the output estimates (as an average) as starting values in a new mixed model with the same variables and a structured covariance shown in Appendix. From this last mixed model we obtained the between-person and error variances and covariances as well as the ratios of between to total (σB 2/σT 2) variances and error to total (σe 2/σT 2) variances. Both the correlation coefficient between visits for choline and other nutrients, ρchol = covvisit/varchol = σB 2/σT 2, as well as the total variance were calculated. Following the modeling to assess the joint intraindividual variability of the interrelated nutrients, a model was constructed with choline as the only dependent variable and technician nested within center, one of the main randomness factors in questionnaire-based dietary assessments, added to the random effect variables.
Comparison between the baseline visit and the second visit (mean and standard deviation) for the 1,004 ARIC participants in the repeatability study
Total energy intake (kcal/d)
Choline intake (mg/d)†
Betaine intake (mg/d)†
Folate intake* (μg/d)†
Methionine intake* (mg/d)†
Vitamin B6 intake (mg/d)†
Components of reliability and measurement error expressed as ratios of between-person variance or covariance to total (co)variance for related dietary nutrients
Total Energy Intake
Total Energy Intake
Distribution in the ARIC cohort, at baseline visit, of dietary choline and betaine by gender and race
Dietary Choline (mg/day)
Dietary Betaine (mg/day)
All ARIC participants
(N = 15,706)
(N = 5419)
(N = 6043)
African American Men
(N = 1618)
African American Women
(N = 2626)
We assessed the reliability of a brief food frequency questionnaire and estimated the dietary intake of choline and betaine in a biracial middle aged cohort of men and women from four US locales. In our population-based cohort the majority of participants had an intake below the value proposed as the adequate intake (AI), used for comparison purposes. The reliability coefficients between visits were in the range of those for other micronutrients but lower compared with those found, for example, for laboratory analytes . The measurement error variance values were substantial for all considered nutrients in concordance with previous studies that suggested that the FFQ is underestimating the actual dietary intakes. The variances of the mean dietary intakes of choline were relatively high in all race-gender groups, a finding that was expected due to the relatively modest reliability coefficients.
Choline, an essential nutrient for humans [13, 23], is included in several compounds that belong to methyl-donors group. Betaine, a methyl-donor that is continuously produced from choline , has been shown to lead to immediate and long term lowering of plasma homocysteine after supplementation in the dietary intake range of betaine . Through aberrant methylation of DNA, a low dietary intake of methyl-donors alters epigenetic regulation of a series of genes by which the atherogenic mechanism may be accelerated [25, 26]. Folate and choline are metabolically interrelated . When folate availability diminishes, there is an increased demand for choline as a methyl donor . When choline availability is decreased, the demand for folate methyl-groups is increased . Because methyl donation by folate and choline can be interchangeable, both folate and choline should be considered in epidemiological studies assessing the relationship between dietary intake of these compounds and cardiovascular disease (CVD). Accurate analysis of choline intake was previously not possible because the choline content of most foods was not known until recently [1, 2]. During the past five years, several major population studies reported on the associations between high dietary intakes of choline and betaine and pathological conditions or markers of disease such as plasma total homocysteine (an inverse association in the Framingham Heart Study  and in the Nurses' Health Study ), incident coronary heart disease (marginally positive association in the Atherosclerosis Risk in Communities Study  and in the European Prospective Investigation into Cancer and Nutrition ), colorectal adenoma (positive association in the Nurses' Health Study ) and neural tube defects in offspring (negative association in a case-control study in California ). In a study that assessed the variability of dietary intake of choline in human subjects  in a clinical research setting, when healthy male and female volunteers were asked to select ad libitum a variety of foods, the standard deviations of choline in the total measured diet were 157 mg/day for males and 88 mg/day for females corresponding to a mean dietary intake of 631 mg/day for men, respectively 443 mg/day for women. These values are in the range of the AI for choline that has been tentatively set at 425 mg/day for women and 550 mg/day for men . The EAR, one of the Dietary Reference Intake (DRI) categories for choline that requires a higher level of evidence for its calculation, remains to be established in population settings.
Much epidemiologic research is based on estimation of an association between a putative risk factor and a health outcome – for example, dietary intake of a certain nutrient and coronary heart disease. Regression techniques, including Cox regression, produce biased estimates of exposure-disease relationships when the exposure variable has a high variability, which is equivalent with a low repeatability . The reliability coefficients were relatively low in our study, in the range 0.43–0.53. As a consequence regression calibration procedures, using these coefficients, should be used to adjust for the measurement error [34–36]. The algorithm we used permitted the partition of the total variance into the between-person component and the error component. For each of the nutrients considered these two components were of comparable magnitude, implying a relatively large measurement error.
As expected, the dietary choline intake was associated with factors such as gender, menopausal status, total energy intake and BMI. These associations might be explained by the consequence of a direct proportionality between the total quantity of ingested foods and the amount of choline within it than by the capacity of premenopausal women to internally synthesize choline moieties which have an impact on the choline plasma levels.
Several limitations of our study should be acknowledged. The interval between dietary assessments in the ARIC study was long, which may have resulted in changes in dietary intake over time. This may have contributed to the modest level of repeatability we observed. Another limitation is the use of a food frequency questionnaire to estimate intakes of choline and betaine in general. Not all foods containing choline and betaine are assessed with the ARIC FFQ. However, foods that were high in choline such as liver and eggs and would contribute significantly to the population intake were included. The validity of this questionnaire to assess intake of choline and betaine is unknown and remains of interest for future studies.
There are several strengths to our investigation. Prior to this study, information about the repeatability of the short version of the Willett FFQ as it pertains to dietary choline and betaine intake was lacking. There is also novelty in estimating intraindividual variability and correcting for measurement error bias as it pertains to choline and betaine. We report both the correlations between the two visits as well as the magnitude of error (variance components) in the dietary assessment which have an application for future studies.
For choline and for choline plus betaine the relative low reliability was similar to those of folate and methionine, and in the range of those reported for other micronutrients. In the estimation of these nutrients, adjustment for measurement variability (using, for example, a calibration method) should be used whenever possible. The majority of the ARIC participants were below the AI: 93% of white men, 88% of white women, 92% of African American men, and 87% of African American women.
The Atherosclerosis Risk in Communities (ARIC) Study is carried out as a collaborative study supported by the National Heart, Lung, and Blood Institute contracts: N01-HC-55015, N01-HC-55016, N01-HC-55018, N01-HC-55019, N01-HC-55020, N01-HC-55021 and N01-HC-55022. A list of principal ARIC study staff was published in American Journal of Epidemiology (1989; 129: 687–688). The authors thank the staff and participants of the ARIC study for their important contributions. Dr. A. Bidulescu was supported in part by two institutional training grants (HL07055 and DK07686) from the National Institutes of Health (NIH). Dr. A.M. Siega-Riz was supported by a research grants from the NIH (DK56350). Dr. S.H. Zeisel was supported by NIH grants DK55865 and DK56350, and by U.S. Department of Agriculture grant AG09525.
- USDA Database for the choline content of common foods: Edited by: Howe JC, Williams JR, Holden JM. 2004, Nutrient Data Laboratory, Agricultural Research Service, U.S. Department of Agriculture, in collaboration with Zeisel SH and Mar M-H, Department of Nutrition, University of North Carolina at Chapel Hill, [http://www.nal.usda.gov/fnic/foodcomp/Data/Choline/Choline.html]
- Zeisel SH, Mar M-H, Howe JC, Holden JM: Concentrations of choline-containing compounds and betaine in common foods. Journal of Nutrition. 2003, 133: 1302-1307.PubMedGoogle Scholar
- James SJ, Yin L: Diet-induced DNA damage and altered nucleotide metabolism in lymphocytes from methyl-donor-deficient rats. Carcinogenesis. 1989, 10: 1209-14. 10.1093/carcin/10.7.1209.View ArticlePubMedGoogle Scholar
- Steenge GR, Verhoef P, Katan MB: Betaine supplementation lowers plasma homocysteine in healthy men and women. Journal of Nutrition. 2003, 133: 1291-1295.PubMedGoogle Scholar
- Olthof MR, Verhoef P: Effects of Betaine Intake on Plasma Homocysteine Concentrations and Consequences for Health. Curr Drug Metab. 2005, 6 (1): 15-22. 10.2174/1389200052997366.View ArticlePubMedGoogle Scholar
- da Costa K-A, Gaffney CE, Fischer LM, Zeisel SH: Choline deficiency in mice and humans is associated with increased plasma homocysteine concentration following a methionine load. American Journal of Clinical Nutrition. 2005, 81: 440-444.PubMedGoogle Scholar
- Harjai KJ: Potential new cardiovascular risk factors: left ventricular hypertrophy, homocysteine, lipoprotein (a), triglycerides, oxidative stress, and fibrinogen. Annals of Internal Medicine. 1999, 131: 376-386.View ArticlePubMedGoogle Scholar
- Clarke R, Collins R, Lewington S, Donald A, Alfthan G, Tuomilehto J, (Homocysteine Studies Collaboration): Homocysteine and risk of ischemic heart disease and stroke: a meta-analysis. Journal of American Medical Association. 2002, 288: 2015-2022. 10.1001/jama.288.16.2015.View ArticleGoogle Scholar
- Yates AA, Schlicker SA, Suitor CW: Dietary Reference Intakes: the new basis for recommendations for calcium and related nutrients, B vitamins, and choline. Journal of American Dietary Association. 1998, 98: 699-706. 10.1016/S0002-8223(98)00160-6.View ArticleGoogle Scholar
- Shaw GM, Carmichael SL, Yang W, Selvin S, Schaffer DM: Periconceptional dietary intake of choline and betaine and neural tube defects in offspring. American Journal of Epidemiology. 2004, 160 (2): 102-109. 10.1093/aje/kwh187.View ArticlePubMedGoogle Scholar
- Cho E, Zeisel SH, Jacques P, Selhub J, Dougherty L, Colditz GA, Willett WC: Dietary choline and betaine assessed by food-frequency questionnaire in relation to plasma total homocysteine concentration in the Framingham Offspring Study. American Journal of Clinical Nutrition. 2006, 83: 905-11.PubMedPubMed CentralGoogle Scholar
- Chiuve SE, Giovannucci EL, Hankinson SE, Zeisel SH, Dougherty LW, Willett WC, Rimm EB: The association between betaine and choline intakes and the plasma concentrations of homocysteine in women. American Journal of Clinical Nutrition. 2007, 86: 1073-81.PubMedPubMed CentralGoogle Scholar
- Institute of Medicine and National Academy of Sciences, USA: Dietary reference intakes for folate, thiamin, riboflavin, niacin, vitamin B12, panthothenic acid, biotin, and choline. 1998, Washington D.C.: National Academy Press, 1: 390-422.Google Scholar
- Willett WC: Nutritional epidemiology. 1998, New York, NY: Oxford University Press, 2View ArticleGoogle Scholar
- Patterson RE, Kristal AR, Tinker LF, Carter RA, Bolton MP, Agurs-Collins T: Measurement characteristics of the Women's Health Initiative food frequency questionnaire. Annals of Epidemiology. 1999, 9: 178-187. 10.1016/S1047-2797(98)00055-6.View ArticlePubMedGoogle Scholar
- Satia-Abouta J: Reliability and validity of self-report of vitamin and mineral supplement use in the vitamins and lifestyle study. American Journal of Epidemiology. 2003, 157 (10): 944-954. 10.1093/aje/kwg039.View ArticlePubMedGoogle Scholar
- Carroll RJ, Freedman LS, Hartman AM: Use of semiquantitative food frequency questionnaires to estimate the distribution of usual intake. American Journal of Epidemiology. 1996, 143 (4): 392-404.View ArticlePubMedGoogle Scholar
- Carroll RJ, Freedman LS, Kipnis V: Measurement error and dietary intake. Advances in experimental medicine and biology. 1998, 445: 139-145.View ArticlePubMedGoogle Scholar
- The ARIC Investigators: The Atherosclerosis Risk in Communities (ARIC) study: design and objectives. American Journal of Epidemiology. 1989, 129: 687-702.Google Scholar
- Littell RC, Milliken GA, Stroup WW, Wolfinger RD: SAS system for mixed models. 1996, Cary, NC, SAS Institute IncGoogle Scholar
- Glesser LJ: The importance of assessing measurement reliability in multivariate regression. Journal of the American Statistical Association. 1992, 87 (419): 696-707. 10.2307/2290207.View ArticleGoogle Scholar
- Chambless LE, McMahon RP, Brown SA, Patsch W, Heiss G, Shen YL: Short-term intraindividual variability in lipoprotein measurements: the Atherosclerosis Risk in Communities (ARIC) Study. American Journal of Epidemiology. 1992, 136 (9): 1069-1081.PubMedGoogle Scholar
- Zeisel SH, Niculescu MD: Choline and Phosphatidylcholine. Modern Nutrition in Health and Disease. Edited by: Shils ME, Shike M, Ross AC, Caballero B, Cousins RJ. 2006, Baltimore: Lippincott, Williams and Wilkins, 525-536. 10Google Scholar
- Craig SAS: Betaine in human nutrition. American Journal of Clinical Nutrition. 2004, 80: 539-549.PubMedGoogle Scholar
- Dong C, Yoon W, Goldschmidt-Clermont PJ: DNA methylation and atherosclerosis. Journal of Nutrition. 2002, 132 (8 Suppl): 2406S-2409S.PubMedGoogle Scholar
- Zaina S, Lindholm MW, Lund G: Nutrition and aberrant DNA methylation patterns in atherosclerosis: more than just hyperhomocysteinemia?. Journal of Nutrition. 2005, 135: 5-8.PubMedGoogle Scholar
- Zeisel SH, daCosta KA, Franklin PD, Alexander EA, LaMont JT, Sheard NF, Beiser A: Choline, an essential nutrient for humans. FASEB Journal. 1991, 5: 2093-2098.PubMedGoogle Scholar
- Jacob RA, Jenden DJ, Allman-Farinelli MA, Swendseid ME: Folate nutriture alters choline status of women and men fed low choline diets. Journal of Nutrition. 1999, 129 (3): 712-717.PubMedGoogle Scholar
- Kim YI, Miller JW, daCosta KA, Nadeau M, Smith D, Selhub J, Zeisel SH, Mason JB: Folate deficiency causes secondary depletion of choline and phosphocholine in liver. J Nutr. 1994, 124 (11): 2197-2203.PubMedGoogle Scholar
- Bidulescu A, Chambless LE, Siega-Riz AM, Zeisel SH, Heiss G: Usual choline and betaine dietary intake and incident coronary heart disease: the Atherosclerosis Risk in Communities (ARIC) study. BMC Cardiovascular Disorders. 2007, 7: 20-10.1186/1471-2261-7-20.View ArticlePubMedPubMed CentralGoogle Scholar
- Dalmeijer GW, Olthof MR, Verhoef P, Bots ML, Schouw van der YT: Prospective study on dietary intakes of folate, betaine, and choline and cardiovascular disease risk in women. European Journal of Clinical Nutrition. 2008, 62 (3): 386-94. 10.1038/sj.ejcn.1602725.View ArticlePubMedGoogle Scholar
- Cho E, Willett WC, Colditz GA, Fuchs CH, Wu K, Chan AT, Zeisel SH, Giovannucci EL: Dietary choline and betaine and the risk of distal colorectal adenoma in women. Journal of National Cancer Institute. 2007, 99: 1224-31. 10.1093/jnci/djm082.View ArticleGoogle Scholar
- Fischer LM, Scearce JA, Mar M-H, Patel J, Blanchard RT, Macintosh BA, Busby MG, Zeisel SH: Ad libitum choline intake in healthy individuals meets or exceeds the proposed adequate intake level. Journal of Nutrition. 2005, 135 (4): 826-829.PubMedPubMed CentralGoogle Scholar
- Rosner B, Willett WC, Spiegelman D: Correction of logistic regression relative risk estimates and confidence intervals for systematic within-person measurement error. Statistics in Medicine. 1989, 8: 1051-1069. 10.1002/sim.4780080413.View ArticlePubMedGoogle Scholar
- Spiegelman D, McDermott A, Rosner B: Regression calibration method for correcting measurement-error bias in nutritional epidemiology. 1997, 65 (4): 1179S-1186S.Google Scholar
- Chambless LE, Davis V: Analysis of associations with change in a multivariate outcome variable when baseline is subject to measurement error. Statistics in Medicine. 2003, 22: 1041-1067. 10.1002/sim.1352.View ArticlePubMedGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.