Hostname: page-component-78c5997874-j824f Total loading time: 0 Render date: 2024-11-10T09:07:57.883Z Has data issue: false hasContentIssue false

“Do I Have a Memory Problem? I Can’t Recall”: An Evaluation of Measurement Invariance in Subjective Reporting of Memory Symptoms among Persons with and without Objective HIV-Associated Memory Impairment

Published online by Cambridge University Press:  06 May 2021

David P. Sheppard
Affiliation:
Department of Psychology, University of Houston, Houston, USA Veterans Affairs (VA) Northwest Network (VISN 20) Mental Illness, Research, Education, and Clinical Care (MIRECC), Veterans Affairs Puget Sound Health Care System, Seattle, WA, USA
Matthew W. Gallagher
Affiliation:
Department of Psychology, University of Houston, Houston, USA
Erin E. Morgan
Affiliation:
Department of Psychiatry, University of California, San Diego, USA
Angulique Y. Outlaw
Affiliation:
Department of Family Medicine & Public Health Sciences, Wayne State University, Detroit, MI, USA
Sylvie Naar
Affiliation:
Department of Behavioral Sciences & Social Medicine, Florida State University, Tallahassee, FL, USA
Steven Paul Woods*
Affiliation:
Department of Psychology, University of Houston, Houston, USA
*
Correspondence and reprint requests to: Steven Paul Woods, Department of Psychology, Heyne Building Suite 239d, University of Houston, Houston, TX77004, USA. Tel: 713 743 6415; Fax: 713 743 8588; Email: spwoods@uh.edu.

Abstract

Objective:

Memory symptoms and objective impairment are common in HIV disease and are associated with disability. A paradoxical issue is that objective episodic memory failures can interfere with accurate recall of memory symptoms. The present study assessed whether responses on a self-report scale of memory symptoms demonstrate measurement invariance in persons with and without objective HIV-associated memory impairment.

Method:

In total, 505 persons with HIV completed the Prospective and Retrospective Memory Questionnaire (PRMQ). Objective memory impairment (n = 141) was determined using a 1-SD cutoff on clinical tests of episodic memory. PRMQ measurement invariance was assessed by confirmatory factor analyses examining a one-factor model with increasing cross-group equality constraints imposed on factor loadings and item thresholds (i.e., configural, weak, and strong invariance).

Results:

Configural model fit indicated that identical items measured a one-factor model for both groups. Comparison to the weak model indicated that factor loadings were equivalent across groups. However, there was evidence of partial strong invariance, with two PRMQ item thresholds differing across memory impairment groups. Post hoc analyses using a 1.5-SD memory impairment cutoff (n = 77) revealed both partial weak and partial strong invariance, such that PRMQ item loadings differed across memory groups for three items.

Conclusions:

The PRMQ demonstrated a robust factor structure among persons with and without objective HIV-associated memory impairment. However, on select PRMQ items, individuals with memory impairment reported observed scores that were relatively higher than their latent score, while items were more strongly associated with the memory factor in a group with greater memory impairment.

Type
Regular Research
Copyright
Copyright © INS. Published by Cambridge University Press, 2021

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

REFERENCES

Antinori, A., Arendt, G., Becker, J. T., Brew, B. J., Byrd, D. A., Cherner, M., … Wojna, V. E. (2007). Updated research nosology for HIV-associated neurocognitive disorders. Neurology, 69(18), 17891799. doi: 10.1212/01.WNL.0000287431.88658.8b CrossRefGoogle ScholarPubMed
Avila, J. F., Rentería, M. A., Witkiewitz, K., Verney, S. P., Vonk, J., & Manly, J. J. (2020). Measurement invariance of neuropsychological measures of cognitive aging across race/ethnicity by sex/gender groups. Neuropsychology, 34(1), 314. doi: 10.1037/neu0000584 CrossRefGoogle Scholar
Benedict, R.H.B. (1997). Brief Visuospatial Memory Test-Revised. Lutz, FL: Psychological Assessment Resources.Google Scholar
Bondi, M. W., Edmonds, E. C., Jak, A. J., Clark, L. R., Delano-Wood, L., McDonald, C. R., … Salmon, D. P. (2014). Neuropsychological criteria for mild cognitive impairment improves diagnostic precision, biomarker associations, and progression rates. Journal of Alzheimer’s Disease: JAD, 42(1), 275289. doi: 10.3233/JAD-140276 CrossRefGoogle ScholarPubMed
Brandt, J., & Benedict, R.H.B. (2001). Hopkins Verbal Learning Test—Revised. Professional manual. Lutz, FL: Psychological Assessment Resources, Inc.Google Scholar
Byrne, B. M. (2012). Structural equation modeling with Mplus: Basic concepts, applications and programming. New York, NY: Taylor & Francis.Google Scholar
Byrne, B.M., Baron, P., & Campbell, T.L. (1993). Measuring Adolescent Depression: Factorial Validity and Invariance of the Beck Depression Inventory Across Gender. Journal of Research of Adolescence, 3(2), 127143. doi: 10.1207/s15327795jra0302_2 CrossRefGoogle Scholar
Carey, C. L., Woods, S. P., Gonzalez, R., Conover, E., Marcotte, T. D., Grant, I., … HNRC Group. (2004). Predictive validity of global deficit scores in detecting neuropsychological impairment in HIV infection. Journal of Clinical and Experimental Neuropsychology, 26(3), 307319. doi: 10.1080/13803390490510031 CrossRefGoogle ScholarPubMed
Casaletto, K. B., Doyle, K. L., Weber, E., Woods, S. P., & HIV Neurobehavioral Research Program (HNRP) Group. (2014). Self-predictions of prospective memory in HIV-associated neurocognitive disorders: evidence of a metamemory deficit. Archives of Clinical Neuropsychology: The Official Journal of the National Academy of Neuropsychologists, 29(8), 818827. doi: 10.1093/arclin/acu061 CrossRefGoogle ScholarPubMed
Castelo, J. M. B., Sherman, S. J., Courtney, M. G., Melrose, R. J., & Stern, C. E. (2006). Altered hippocampal-prefrontal activation in HIV patients during episodic memory encoding. Neurology, 66(11), 16881695. doi: 10.1212/01.wnl.0000218305.09183.70 CrossRefGoogle ScholarPubMed
Chen, F.F. (2007). Sensitivity of Goodness of Fit Indexes to Lack of Measurement Invariance. Structural Equation Modeling: A Multidisciplinary Journal, 14(3), 464504. doi: 10.1080/10705510701301834 CrossRefGoogle Scholar
Cheung, G.W., & Rensvold, R.B. (2000). Assessing Extreme and Acquiescence Response Sets in Cross-Cultural Research Using Structural Equation Modeling. Journal of Cross-Cultural Psychology, 31(2), 187212. doi: 10.1177/0022022100031002003 CrossRefGoogle Scholar
Clare, L., Whitaker, C. J., & Nelis, S. M. (2010). Appraisal of memory functioning and memory performance in healthy ageing and early-stage Alzheimer’s disease. Neuropsychology, Development, and Cognition. Section B, Aging, Neuropsychology and Cognition, 17(4), 462491. doi: 10.1080/13825580903581558 CrossRefGoogle ScholarPubMed
Collie, A., Maruff, P., Darby, D. G., & McStephen, M. (2003). The effects of practice on the cognitive test performance of neurologically normal individuals assessed at brief test-retest intervals. Journal of the International Neuropsychological Society: JINS, 9(3), 419428. doi: 10.1017/S1355617703930074 CrossRefGoogle ScholarPubMed
Cook, S., & Marsiske, M. (2006). Subjective memory beliefs and cognitive performance in normal and mildly impaired older adults. Aging & Mental Health, 10(4), 413423. doi: 10.1080/13607860600638487 CrossRefGoogle ScholarPubMed
Crawford, J. R., Henry, J. D., Ward, A. L., & Blake, J. (2006). The Prospective and Retrospective Memory Questionnaire (PRMQ): latent structure, normative data and discrepancy analysis for proxy-ratings. The British Journal of Clinical Psychology, 45(Pt 1), 83104. doi: 10.1348/014466505X28748 CrossRefGoogle ScholarPubMed
Crawford, J. R., Smith, G., Maylor, E. A., Della Sala, S., & Logie, R. H. (2003). The Prospective and Retrospective Memory Questionnaire (PRMQ): Normative data and latent structure in a large non-clinical sample. Memory (Hove, England), 11(3), 261275. doi: 10.1080/09658210244000027 CrossRefGoogle Scholar
de Mendonça, A., Felgueiras, H., Verdelho, A., Câmara, S., Grilo, C., Maroco, J., … Guerreiro, M. (2018). Memory complaints in amnestic Mild Cognitive Impairment: More prospective or retrospective? International Journal of Geriatric Psychiatry, 33(8), 10111018. doi: 10.1002/gps.4886 CrossRefGoogle ScholarPubMed
Delis, D.C., Kramer, J.H., Kaplan, E., & Ober, B.A. (2000). The California verbal learning test. 2nd ed. San Antonio: The Psychological Corporation.Google Scholar
Dhillon, S., Videla-Nash, G., Foussias, G., Segal, Z. V., & Zakzanis, K. K. (2020). On the nature of objective and perceived cognitive impairments in depressive symptoms and real-world functioning in young adults. Psychiatry Research, 287, 112932. doi: 10.1016/j.psychres.2020.112932 CrossRefGoogle ScholarPubMed
Doyle, K., Weber, E., Atkinson, J. H., Grant, I., Woods, S. P., & HIV Neurobehavioral Research Program (HNRP) Group. (2012). Aging, prospective memory, and health-related quality of life in HIV infection. AIDS and Behavior, 16(8), 23092318. doi: 10.1007/s10461-011-0121-x CrossRefGoogle ScholarPubMed
Faytell, M. P., Doyle, K. L., Naar-King, S., Outlaw, A. Y., Nichols, S. L., Casaletto, K. B., & Woods, S. P. (2017). Visualisation of future task performance improves naturalistic prospective memory for some younger adults living with HIV disease. Neuropsychological Rehabilitation, 27(8), 11421155. doi: 10.1080/09602011.2015.1122636 CrossRefGoogle ScholarPubMed
Filshtein, T., Chan, M., Mungas, D., Whitmer, R., Fletcher, E., DeCarli, C., & Farias, S. (2020). Differential Item Functioning of the Everyday Cognition (ECog) Scales in Relation to Racial/Ethnic Groups. Journal of the International Neuropsychological Society: JINS, 26(5), 515526. doi: 10.1017/S1355617719001437 CrossRefGoogle ScholarPubMed
Gregorich, S. E. (2006). Do self-report instruments allow meaningful comparisons across diverse population groups? Testing measurement invariance using the confirmatory factor analysis framework. Medical Care, 44(11 Suppl 3), S78S94. doi: 10.1097/01.mlr.0000245454.12228.8f CrossRefGoogle ScholarPubMed
Guerdoux-Ninot, E., Martin, S., Jailliard, A., Brouillet, D., & Trouillet, R. (2019). Validity of the French Prospective and Retrospective Memory Questionnaire (PRMQ) in healthy controls and in patients with no cognitive impairment, mild cognitive impairment and Alzheimer disease. Journal of Clinical and Experimental Neuropsychology, 41(9), 888904. doi: 10.1080/13803395.2019.1625870 CrossRefGoogle ScholarPubMed
Gupta, S., Woods, S. P., Weber, E., Dawson, M. S., Grant, I., & HIV Neurobehavioral Research Center (HNRC) Group. (2010). Is prospective memory a dissociable cognitive function in HIV infection? Journal of Clinical and Experimental Neuropsychology, 32(8), 898908. doi: 10.1080/13803391003596470 CrossRefGoogle ScholarPubMed
Hertzog, C., Park, D.C., Morrell, R.W., & Martin, M. (2000). Ask and Ye Shall Receive: Behavioural Specificity in the Accuracy of Subjective Memory Complaints. Applied Cognitive Psychology, 14, 257275. doi: 10.1002/(SICI)1099-0720(200005/06)14:3<257:AID-ACP651>3.0.CO;2-O 3.0.CO;2-O>CrossRefGoogle Scholar
Heaton, R. K., Franklin, D. R., Ellis, R. J., McCutchan, J. A., Letendre, S. L., Leblanc, S., … HNRC Group. (2011). HIV-associated neurocognitive disorders before and during the era of combination antiretroviral therapy: differences in rates, nature, and predictors. Journal of Neurovirology, 17(1), 316. doi: 10.1007/s13365-010-0006-1 CrossRefGoogle ScholarPubMed
Hinkin, C. H., van Gorp, W. G., Satz, P., Marcotte, T., Durvasula, R. S., Wood, S., … Baluda, M. R. (1996). Actual versus self-reported cognitive dysfunction in HIV-1 infection: memory-metamemory dissociations. Journal of Clinical and Experimental Neuropsychology, 18(3), 431443. doi: 10.1080/01688639608408999 CrossRefGoogle ScholarPubMed
Jessen, F., Amariglio, R. E., van Boxtel, M., Breteler, M., Ceccaldi, M., Chételat, G., … Subjective Cognitive Decline Initiative (SCD-I) Working Group. (2014). A conceptual framework for research on subjective cognitive decline in preclinical Alzheimer’s disease. Alzheimer’s & Dementia: The Journal of the Alzheimer’s Association, 10(6), 844852. doi: 10.1016/j.jalz.2014.01.001 CrossRefGoogle ScholarPubMed
Lee, S., Ong, B., Pike, K. E., Mullaly, E., Rand, E., Storey, E., … Kinsella, G. J. (2016). The Contribution of Prospective Memory Performance to the Neuropsychological Assessment of Mild Cognitive Impairment. The Clinical Neuropsychologist, 30(1), 131149. doi: 10.1080/13854046.2015.1135983 CrossRefGoogle Scholar
Lehrner, J., Kogler, S., Lamm, C., Moser, D., Klug, S., Pusswald, G., … Auff, E. (2015). Awareness of memory deficits in subjective cognitive decline, mild cognitive impairment, Alzheimer’s disease and Parkinson’s disease. International Psychogeriatrics, 27(3), 357366. doi: 10.1017/S1041610214002245 CrossRefGoogle ScholarPubMed
Loft, S., Doyle, K. L., Naar-King, S., Outlaw, A. Y., Nichols, S. L., Weber, E., … Woods, S. P. (2014). Allowing brief delays in responding improves event-based prospective memory for young adults living with HIV disease. Journal of Clinical and Experimental Neuropsychology, 36(7), 761772. doi: 10.1080/13803395.2014.942255 CrossRefGoogle ScholarPubMed
Marcone, S., Gagnon, J.-F., Desjardins, C., David, A.-C., Postuma, R. B., Montplaisir, J., … Rouleau, I. (2019). Prospective memory in idiopathic REM sleep behavior disorder with or without mild cognitive impairment: A preliminary study. The Clinical Neuropsychologist, 33(3), 571593. doi: 10.1080/13854046.2018.1435825 CrossRefGoogle ScholarPubMed
McAlister, C., & Schmitter-Edgecombe, M. (2016). Everyday functioning and cognitive correlates in healthy older adults with subjective cognitive concerns. The Clinical Neuropsychologist, 30(7), 10871103. doi: 10.1080/13854046.2016.1190404 CrossRefGoogle ScholarPubMed
Muthén, L.K. and Muthén, B.O. (1998-2017). Mplus User’s Guide (8th ed.). Los Angeles, CA: Muthén & Muthén.Google Scholar
Obermeit, L. C., Morgan, E. E., Casaletto, K. B., Grant, I., Woods, S. P., & HIV Neurobehavioral Research Program Group. (2015). Antiretroviral Non-Adherence is Associated With a Retrieval Profile of Deficits in Verbal Episodic Memory. The Clinical Neuropsychologist, 29(2), 197213. doi: 10.1080/13854046.2015.1018950 CrossRefGoogle ScholarPubMed
Ottenbacher, K. J. (1998). Quantitative evaluation of multiplicity in epidemiology and public health research. American Journal of Epidemiology, 147(7), 615619. doi: 10.1093/oxfordjournals.aje.a009501 CrossRefGoogle ScholarPubMed
Psychological Corporation (1997). WAIS-III and WMS-III technical manual. San Antonio, TX: Author.Google Scholar
Psychological Corporation. (2001). Manual for the Wechsler Test of Adult Reading (WTAR). San Antonio: Author.Google Scholar
Reid, L. M., & Maclullich, A. M. J. (2006). Subjective memory complaints and cognitive impairment in older people. Dementia and Geriatric Cognitive Disorders, 22(5–6), 471485. doi: 10.1159/000096295 CrossRefGoogle ScholarPubMed
Rippeth, J. D., Heaton, R. K., Carey, C. L., Marcotte, T. D., Moore, D. J., Gonzalez, R., … HNRC Group. (2004). Methamphetamine dependence increases risk of neuropsychological impairment in HIV infected persons. Journal of the International Neuropsychological Society: JINS, 10(1), 114. doi: 10.1017/S1355617704101021 CrossRefGoogle ScholarPubMed
Robertson, K. R., Smurzynski, M., Parsons, T. D., Wu, K., Bosch, R. J., Wu, J., … Ellis, R. J. (2007). The prevalence and incidence of neurocognitive impairment in the HAART era. AIDS (London, England), 21(14), 19151921. doi: 10.1097/QAD.0b013e32828e4e27 CrossRefGoogle ScholarPubMed
Rönnlund, M., Mäntylä, T., & Nilsson, L.-G. (2008). The Prospective and Retrospective Memory Questionnaire (PRMQ): factorial structure, relations to global subjective memory ratings, and Swedish norms. Scandinavian Journal of Psychology, 49(1), 1118. doi: 10.1111/j.1467-9450.2007.00600.x CrossRefGoogle ScholarPubMed
Ryu, S. Y., Lee, S. B., Kim, T. W., & Lee, T. J. (2016). Memory complaints in subjective cognitive impairment, amnestic mild cognitive impairment and mild Alzheimer’s disease. Acta Neurologica Belgica, 116(4), 535541. doi: 10.1007/s13760-016-0604-7 CrossRefGoogle ScholarPubMed
Sass, D.A., Schmitt, T.A., & Marsh, H.W. (2014). Evaluating model fit with ordered categorical data within a measurement invariance framework: a comparison of estimators. Structural Equation Modeling: A Multidisciplinary Journal, 21(2), 167180. doi: 10.1080/10705511.2014.882658 CrossRefGoogle Scholar
Sheppard, D. P., Woods, S. P., Massman, P. J., & Gilbert, P. E. (2019). Frequency and correlates of subjective cognitive impairment in HIV disease. AIDS and Behavior, 23(3), 617626. doi: 10.1007/s10461-018-2297-9 CrossRefGoogle ScholarPubMed
Siedlecki, K. L., Manly, J. J., Brickman, A. M., Schupf, N., Tang, M.-X., & Stern, Y. (2010). Do neuropsychological tests have the same meaning in Spanish speakers as they do in English speakers? Neuropsychology, 24(3), 402411. doi: 10.1037/a0017515 CrossRefGoogle ScholarPubMed
Smith, G., Della Sala, S., Logie, R. H., & Maylor, E. A. (2000). Prospective and retrospective memory in normal ageing and dementia: a questionnaire study. Memory (Hove, England), 8(5), 311321. doi: 10.1080/09658210050117735 CrossRefGoogle ScholarPubMed
Sugden, N., Thomas, M., & Kiernan, M. (2021). A scoping review of the utility of self-report and informant-report prospective memory measures. Neuropsychological Rehabilitation, 1–31. doi: 10.1080/09602011.2021.1875851 CrossRefGoogle Scholar
Tierney, S. M., Sheppard, D. P., Kordovski, V. M., Faytell, M. P., Avci, G., & Woods, S. P. (2017). A comparison of the sensitivity, stability, and reliability of three diagnostic schemes for HIV-associated neurocognitive disorders. Journal of Neurovirology, 23(3), 404421. doi: 10.1007/s13365-016-0510-z CrossRefGoogle ScholarPubMed
Tsutsumimoto, K., Makizako, H., Doi, T., Hotta, R., Nakakubo, S., Makino, K., … Suzuki, T. (2017). Subjective memory complaints are associated with incident dementia in cognitively intact older people, but not in those with cognitive impairment: a 24-month prospective cohort study. The American Journal of Geriatric Psychiatry: Official Journal of the American Association for Geriatric Psychiatry, 25(6), 607616. doi: 10.1016/j.jagp.2016.12.008 CrossRefGoogle Scholar
Vandenberg, R.J., & Lance, C.E. (2000). A review and synthesis of the measurement invariance literature: suggestions, practices, and recommendations for organizational research. Organizational Research Methods, 2, 469. doi: 10.1177/109442810031002 CrossRefGoogle Scholar
Vaskivuo, L., Hokkanen, L., Hänninen, T., Antikainen, R., Bäckman, L., Laatikainen, T., … Ngandu, T. (2018). Associations between prospective and retrospective subjective memory complaints and neuropsychological performance in older adults: the finger study. Journal of the International Neuropsychological Society: JINS, 24(10), 10991109. doi: 10.1017/S135561771800053X CrossRefGoogle ScholarPubMed
Wang, Y., Liu, M., Lu, Q., Farrell, M., Lappin, J. M., Shi, J., … Bao, Y. (2020). Global prevalence and burden of HIV-associated neurocognitive disorder: a meta-analysis. Neurology. doi: 10.1212/WNL.0000000000010752 CrossRefGoogle Scholar
Weintraub, S., Dikmen, S. S., Heaton, R. K., Tulsky, D. S., Zelazo, P. D., Bauer, P. J., … Gershon, R. C. (2013). Cognition assessment using the NIH Toolbox. Neurology, 80(11 Suppl 3), S54S64. doi: 10.1212/WNL.0b013e3182872ded CrossRefGoogle ScholarPubMed
WHO ASSIST Working Group (2002). The Alcohol, Smoking and Substance Involvement Screening Test (ASSIST): development, reliability and feasibility. Addiction, 97(9), 11831194. doi: 10.1046/j.1360-0443.2002.00185.x CrossRefGoogle Scholar
Woods, S. P., Carey, C. L., Moran, L. M., Dawson, M. S., Letendre, S. L., Grant, I., & HIV Neurobehavioral Research Center (HNRC) Group. (2007). Frequency and predictors of self-reported prospective memory complaints in individuals infected with HIV. Archives of Clinical Neuropsychology: The Official Journal of the National Academy of Neuropsychologists, 22(2), 187195. doi: 10.1016/j.acn.2006.12.006 CrossRefGoogle ScholarPubMed
Woods, S. P., Iudicello, J. E., Moran, L. M., Carey, C. L., Dawson, M. S., Grant, I., & HIV Neurobehavioral Research Center Group. (2008). HIV-associated prospective memory impairment increases risk of dependence in everyday functioning. Neuropsychology, 22(1), 110117. doi: 10.1037/0894-4105.22.1.110 CrossRefGoogle ScholarPubMed
Woods, S. P., Moran, L. M., Carey, C. L., Dawson, M. S., Iudicello, J. E., Gibson, S., … HIV Neurobehavioral Research Center Group. (2008). Prospective memory in HIV infection: is “remembering to remember” a unique predictor of self-reported medication management? Archives of Clinical Neuropsychology: The Official Journal of the National Academy of Neuropsychologists, 23(3), 257270. doi: 10.1016/j.acn.2007.12.006 CrossRefGoogle Scholar
Woods, S. P., Morgan, E. E., Loft, S., Matchanova, A., Verduzco, M., & Cushman, C. (2020). Supporting strategic processes can improve time-based prospective memory in the laboratory among older adults with HIV disease. Neuropsychology, 34(3), 249263. doi: 10.1037/neu0000602 CrossRefGoogle ScholarPubMed
Woods, S. P., Scott, J. C., Dawson, M. S., Morgan, E. E., Carey, C. L., Heaton, R. K., … HIV Neurobehavioral Research Center (HNRC) Group. (2005). Construct validity of Hopkins Verbal Learning Test-Revised component process measures in an HIV-1 sample. Archives of Clinical Neuropsychology: The Official Journal of the National Academy of Neuropsychologists, 20(8), 10611071. doi: 10.1016/j.acn.2005.06.007 CrossRefGoogle Scholar
Wu, P. (2010). Measurement invariance and latent mean differences of the beck depression inventory II across gender groups. Journal of Psychoeducational Assessment, 28(6), 551563. doi: 10.1177/0734282909360772 CrossRefGoogle Scholar
Yoo-Jeong, M., Anderson, A., Rahman, A. F., Baumann, M., McBroom, J., & Waldrop-Valverde, D. (2018). Associations of Mood on Objective and Subjective Cognitive Complaints in Persons Living with HIV/AIDS. Journal of HIV and AIDS, 4(1). doi: 10.16966/2380-5536.146 CrossRefGoogle Scholar
Zimprich, D., Kliegel, M., & Rast, P. (2011). The factorial structure and external validity of the prospective and retrospective memory questionnaire in older adults. European Journal of Ageing, 8(1), 3948. doi: 10.1007/s10433-011-0174-8 CrossRefGoogle ScholarPubMed
Supplementary material: File

Sheppard et al. supplementary material

Sheppard et al. supplementary material 1

Download Sheppard et al. supplementary material(File)
File 24.9 KB
Supplementary material: File

Sheppard et al. supplementary material

Sheppard et al. supplementary material 2

Download Sheppard et al. supplementary material(File)
File 20.4 KB
Supplementary material: File

Sheppard et al. supplementary material

Sheppard et al. supplementary material 3

Download Sheppard et al. supplementary material(File)
File 20.4 KB
Supplementary material: File

Sheppard et al. supplementary material

Sheppard et al. supplementary material 4

Download Sheppard et al. supplementary material(File)
File 24.9 KB