97 Evaluation of Video and Telephone-Based Administration of the Uniform Data Set Version 3 (UDS v3.0) Teleneuropsychological Measures

Abstract

Objective:

Telecommunication-assisted neuropsychological assessment (teleNP) has become more widespread, particularly in response to the COVID-19 pandemic. However, comparatively few studies have evaluated in-home teleNP testing and none, to our knowledge, have evaluated the National Alzheimer’s Coordinating Center’s (NACC) Uniform Data Set version 3 tele-adapted test battery (UDS v3.0 t-cog). The current study compares in-home teleNP administration of the UDS v3.0, acquired while in-person activities were suspended due to COVID-19, with a prior in-person UDS v3.0 evaluation.

Participants and Methods:

210 participants from the Michigan Alzheimer’s Disease Research Center’s longitudinal study of memory and aging completed both an in-person UDS v3.0 and a subsequent teleNP UDS v3.0 evaluation. The teleNP UDS v3.0 was administered either via video conference (n = 131), telephone (n = 75), or hybrid format (n = 4) with approximately 16 months between evaluations (mean = 484.7 days; SD = 122.4 days; range = 320-986 days). The following clinical phenotypes were represented at the initial assessment period (i.e., the most recent in-person UDS v3.0 evaluation prior to the teleNP UDS v3.0): cognitively healthy (n = 138), mild cognitive impairment (MCI; n = 60), dementia (n = 11), and impaired not MCI (n = 1). Tests included both the in-person and teleNP UDS v3.0 measures, as well as the Hopkins Verbal Learning Test-Revised (HVLT-R) and Letter “C” Fluency.

Results:

We calculated intraclass correlation coefficients (ICC) with raw scores from each time point for the entire sample. Sub-analyses were conducted for each phenotype among participants with an unchanged consensus research diagnosis: cognitively healthy (n = 122), MCI (n = 47), or cognitively impaired (i.e., MCI, dementia, and impaired not MCI) (n = 66). Test-retest reliability across modalities and clinical phenotypes was, in general, moderate. The poorest agreement was associated with the Trail Making Test (TMT) - A (ICC = 0.00; r = 0.027), TMT - B (ICC = 0.26; r = 0.44), and Number Span Backward (ICC = 0.49). The HVLT-R demonstrated moderate reliability overall (ICC = 0.51-0.68) but had notably weak reliability for cognitively healthy participants (ICC = 0.12-0.36). The most favorable reliability was observed in Craft Story 21 Recall - Delayed (ICC = 0.77), Letter Fluency (C, F, and L) (ICC = 0.74), Multilingual Naming Test (MINT) (ICC = 0.75), and Benson Complex Figure – Delayed (ICC = 0.79).

Conclusions:

Even after accounting for the inherent limitations of this study (e.g., significant lapse of time between testing intervals), our findings suggest that the UDS v3.0 teleNP battery shows only modest relationships with its in-person counterpart. Particular caution should be used when interpreting measures showing questionable reliability, though we encourage further investigation of remote vs. in-person testing under more controlled conditions.