Hostname: page-component-cd9895bd7-hc48f Total loading time: 0 Render date: 2024-12-27T07:30:44.543Z Has data issue: false hasContentIssue false
  • English
  • Français

Agreement between a brief food frequency questionnaire and diet records using two statistical methods

Published online by Cambridge University Press:  27 September 2007

GL Ambrosini ,
NH de Klerk ,
AW Musk  and
D Mackerras
GL Ambrosini*
Affiliation:
Department of Public Health, University of Western Australia, Nedlands Campus, Perth, W.A. 6907, Australia
NH de Klerk
Affiliation:
Department of Public Health, University of Western Australia, Nedlands Campus, Perth, W.A. 6907, Australia
AW Musk
Affiliation:
Department of Public Health, University of Western Australia, Nedlands Campus, Perth, W.A. 6907, Australia Department of Respiratory Medicine, Sir Charles Gairdner Hospital, Perth, W.A., Australia Department of Medicine, University of Western Australia, Perth, W.A., Australia
D Mackerras
Affiliation:
Menzies School of Health Research, Darwin, N.T., Australia
*
*Corresponding author: Email ginaa@dph.uwa.edu.au
Rights & Permissions [Opens in a new window]

Abstract

Core share and HTML view are not available for this content. However, as you have access to this content, a full PDF is available via the ‘Save PDF’ action button.
Objective

To compare intra- and inter-method reliability of a semi-quantitative food frequency questionnaire (FFQ) designed specifically to measure beta carotene (BC) and retinol intake, using two methods – the limits of agreement (LOA) and the correlation coefficient.

Design

A cross-sectional study of dietary intake.

Setting

A randomized trial of vitamin A supplements in 2769 subjects with past asbestos exposure.

Subjects

Data from 57 men and 26 women, aged 28–72 years, living in Western Australia.

Methods

The FFQ was administered at baseline (FFQ1) and repeated 1 year later (FFQ2). Four 1-week diet records (DRs) were completed during the year.

Results

Mean agreement between FFQ2 and FFQ1 was 120% for BC and 98% for retinol. LOA were 47–306% and 21–459%, respectively. Mean agreement between FFQ2 and the DR was 149% for BC and 63% for retinol; LOA were 50–447% and 11–349%, respectively. Mean agreement and LOA varied across energy intakes. Between the DR and FFQ2, correlation coefficients were 0.36 for BC and 0.51 for retinol. These varied considerably across age, gender and energy intakes and were not in accordance with limits of agreement findings.

Conclusion

Although correlation coefficients were positive and significant, there was less than ideal intra-method and inter-method reliability shown by the limits of agreement method. Bias was uneven across the range of intakes, the LOA were wide and, compared with the DR, the FFQ significantly over-estimated BC and under-estimated retinol. This shows the limitations of calculating correlation coefficients alone, for assessing reliability and validity.

Keywords

Food frequency questionnaireDiet recordsReliabilityValidityReproducibilityNutritional epidemiologyVitamin A
Type
Research Article
Information
Public Health Nutrition , Volume 4 , Issue 2 , April 2001 , pp. 255 - 264
Copyright
Copyright © CABI Publishing 2001

References

1Willett, WC. Nutritional Epidemiology. 2nd edn. New York: Oxford University Press, 1998.CrossRefGoogle Scholar
2Kaaks, R, Riboli, E.Validation and calibration of dietary intake measurements in the EPIC project: methodological considerations. Int. J. Epidemiol. 1997; 26((Suppl. 1)): S15–25.CrossRefGoogle ScholarPubMed
3Kipnis, V, Carroll, RJ, Freedman, LS, Li, L.Implications of a new dietary measurement error model for estimation of relative risk: application to four calibration studies. Am. J. Epidemiol. 1999; 150: 642–51.CrossRefGoogle ScholarPubMed
4Prentice, RL. Measurement error and results from analytic epidemiology: dietary fat and breast cancer. JNCI 1996; 88((23)): 1738–47.CrossRefGoogle ScholarPubMed
5Altman, DB, Bland, JM. Measurement in medicine: the analysis of method comparison studies. The Statistician 1983; 32: 307–17.CrossRefGoogle Scholar
6Bland, MJ, Altman, DG. Statistical methods for assessing agreement between two methods of clinical assessment. Lancet 1986; (Feb 8): 307–11.CrossRefGoogle Scholar
7Hebert, J, Miller, D.The inappropriateness of conventional use of the correlation coefficient in assessing validity and reliability of dietary assessment methods. Eur. J. Epidemiol. 1991; 7(4): 339–43.CrossRefGoogle ScholarPubMed
8Armstrong, BK, White, E, Saracci, R. Principles of Exposure Measurement in Epidemiology. New York: Oxford University press, 1992.CrossRefGoogle Scholar
9Chinn, S.The assessment of methods of measurement. Stat. Med. 1990; 9: 351–62.CrossRefGoogle ScholarPubMed
10Last, JM. ed. A Dictionary of Epidemiology. 2nd edn. New York: Oxford University Press, 1988.Google Scholar
11De Klerk, NH, Musk, AW, Ambrosini, GL, Eccles, JL, Hansen, J, Olsen, N, et al. Vitamin A and cancer prevention II: comparison of the effects of retinol and beta-carotene. Int. J. Cancer 1998; 75: 362–7.3.0.CO;2-0>CrossRefGoogle ScholarPubMed
12Musk, AW, de Klerk, NH, Ambrosini, GL, Eccles, JL, Hansen, J, Olsen, NJ, et al. Vitamin A and cancer prevention I: observations in workers previously exposed to asbestos at Wittenoom, Western Australia. Int. J. Cancer 1998; 75: 335–61.3.0.CO;2-1>CrossRefGoogle ScholarPubMed
13Block, G, Dresser, A, Hartman, M, Carroll, M.Nutrient sources in the American diet: quantitative data from the NHANES II survey. Am. J. Epidemiol. 1985; 122: 13–26.CrossRefGoogle ScholarPubMed
14Cade, J, Margetts, B.Nutrient sources in the English diet: quantitative data from three English towns. Int. J. Epidemiol. 1988; 17: 844–8.CrossRefGoogle ScholarPubMed
15Lewis, J, Holt, R. NUTTAB91–92: Commonwealth Government of Australia. Canberra: National Food Authority, 1992.Google Scholar
16Goodsell, C. Diet/1 Nutrient Analysis Software. Version 3.10. Brisbane: Xyris Software, 1991.Google Scholar
17SAS System for Windows. Version 6.12. Calgary: SAS Institute, Inc, 1989–1996.Google Scholar
18Kristal, AR, Feng, Z, Coates, RJ, Oberman, A, George, V.Associations of race/ethnicity, education and dietary intervention with the validity and reliability of a food frequency questionnaire. Am. J. Epidemiol. 1997; 146: 856–69.CrossRefGoogle ScholarPubMed
19Mannisto, S, Virtanen, M, Mikkonen, T, Pietinen, P.Reproducibility and validity of a food frequency questionnaire in a case–control study on breast cancer. J. Clin. Epidemiol. 1996; 49(4): 401–9.CrossRefGoogle Scholar
20Rimm, E, Giovannucci, E, Stampfer, M, Colditz, G, Litin, L, Willett, W.Reproducibility and validity of an expanded, self-administered, semi-quantitative food frequency questionnaire among male health professionals. Am. J. Epidemiol. 1992; 135: 1114–26.CrossRefGoogle Scholar
21Feskanich, D, Marshall, J, Rimm, E, Litin, L, Willett, W.Simulated validation of a brief food frequency questionnaire. Ann. Epidemiol. 1994; 4: 181–7.CrossRefGoogle ScholarPubMed
22Thompson, RL, Margetts, BM. Comparison of a food frequency questionnaire with a 10-day weighed record in cigarette smokers. Int. J. Epidemiol. 1993; 22(5): 824–33.CrossRefGoogle ScholarPubMed
23Patterson, RE, Neuhouser, ML, White, E, Hunt, JR, Kristal, AR. Cancer-related behaviour of vitamin supplement users. Cancer Epidemiol. Biomark. Prev. 1998; 7(1): 79–81.Google ScholarPubMed
24Lissner, L, Heitman, BL, Lindroos, AK. Measuring intake in free-living human subjects: a question of bias. Proc. Nutr. Soc. 1998; 57: 333–9.CrossRefGoogle ScholarPubMed
25Johansson, L, Solvoll, K, Bjorneboe, GEA, Drevon, CA. Under- and overreporting of energy intake related to weight status and lifestyle in a nationwide sample. Am. J. Clin. Nutr. 1998; 68: 266–74.CrossRefGoogle ScholarPubMed
26Hebert, JR, Thurley, TG, Chiriboga, DE, Barone, J.comparison of selected nutrient intakes derived from three diet assessment methods used in a low-fat maintenance trial. Public Health Nutr. 1998; 1(3): 207–14.CrossRefGoogle Scholar
27Harlan, L, Block, G.Use of adjustment factors with a brief food frequency questionnaire to obtain nutrient values. Epidemiology 1990; 1: 224–31.CrossRefGoogle ScholarPubMed
28Munger, R, Folsom, A, Kushi, L, Kaye, S, Sellers, T.Dietary assessment of older Iowa women with a food frequency questionnaire: nutrient intake, reproducibility, and comparison with 24-hour dietary recall interviews. Am. J. Epidemiol. 1992; 136: 192–200.CrossRefGoogle ScholarPubMed
29Kohlmeier, L.Overview of validity, quality control and measurement error issues in nutritional epidemiology. Eur. J. Clin. Nutr. 1993; 47(Suppl. 2): S1–5.Google ScholarPubMed