The psychometric rigor of unsupervised, smartphone-based assessments and factors that impact remote protocol engagement is critical to evaluate prior to the use of such methods in clinical contexts. We evaluated the validity of a high-frequency, smartphone-based cognitive assessment protocol, including examining convergence and divergence with standard cognitive tests, and investigating factors that may impact adherence and performance (i.e., time of day and anticipated receipt of feedback vs. no feedback).

Cognitively unimpaired participants (N = 120, Mage = 68.8, 68.3% female, 87% White, Meducation = 16.5 years) completed 8 consecutive days of the Mobile Monitoring of Cognitive Change (M2C2), a mobile app-based testing platform, with brief morning, afternoon, and evening sessions. Tasks included measures of working memory, processing speed, and episodic memory. Traditional neuropsychological assessments included measures from the Preclinical Alzheimer’s Cognitive Composite battery.

Findings showed overall high compliance (89.3%) across M2C2 sessions. Average compliance by time of day ranged from 90.2% for morning sessions, to 77.9% for afternoon sessions, and 84.4% for evening sessions. There was evidence of faster reaction time and among participants who expected to receive performance feedback. We observed excellent convergent and divergent validity in our comparison of M2C2 tasks and traditional neuropsychological assessments.

This study supports the validity and reliability of self-administered, high-frequency cognitive assessment via smartphones in older adults. Insights into factors affecting adherence, performance, and protocol implementation are discussed.

Intraindividual variability (IIV) is defined as fluctuations in an individual’s cognitive performance over time1. IIV has been identified as a marker of neurobiological disturbance making it a useful method for detecting changes in cognition among cognitively healthy individuals as well as those with prodromal syndromes2. IIV on laboratory-based computerized tasks has been linked with cognitive decline and conversion to mild cognitive impairment (MCI) and/or dementia (Haynes et al., 2017). Associations between IIV and AD risk factors including apolipoprotein (APOE) ε4 carrier status, neurodegeneration seen on brain imaging, and amyloid (Aß) Positron emission tomography (PET) scan status have also been observed1. Recent studies have demonstrated that evaluating IIV on smartphone-based digital cognitive assessments is feasible, has the capacity to differentiate between cognitively normal (CN) and MCI individuals, and may reduce barriers to cognitive assessment3. This study sought to evaluate whether such differences could be detected in CN participants with and without elevated AD risk.

Participants (n=57) were cognitively normal older adults who previously received an Aß PET scan through the Butler Hospital Memory and Aging Program. The sample consisted of primarily non-Hispanic (n=49, 86.0%), White (n=52, 91.2%), college-educated (M=16.65 years), females (n=39, 68.4%). The average age of the sample was 68 years old. Approximately 42% of the sample (n=24) received a positive PET scan result. Participants completed brief cognitive assessments (i.e., 3-4 minutes) three times per day for eight days (i.e., 24 sessions) using the Mobile Monitoring of Cognitive Change (M2C2) application, a mobile app-based cognitive testing platform developed as part of the National Institute of Aging’s Mobile Toolbox initiative (Sliwinski et al., 2018). Participants completed visual working memory, processing speed, and episodic memory tasks on the M2C2 platform. Intraindividual standard deviations (ISDs) across trials were computed for each person at each time point (Hultsch et al., 2000). Higher ISD values indicate more variability in performance. Linear mixed effects models were utilized to examine whether differences in IIV existed based on PET scan status while controlling for age, sex at birth, and years of education.

n interaction between PET status and time was observed on the processing speed task such that Aß- individuals were less variable over the eight assessment days compared to Aß + individuals (B= -5.79, SE=2.67, p=.04). No main or interaction effects were observed on the visual working memory task or episodic memory task.

Our finding that Aß- individuals demonstrate less variability over time on a measure of processing speed is consistent with prior work. No associations were found between IIV in other cognitive domains and PET status. As noted by Allaire and Marsiske (2005), IIV is not a consistent phenomenon across different cognitive domains. Therefore, identifying which tests are the most sensitive to early change is crucial. Additional studies in larger, more diverse samples are needed prior to widespread clinical use for early detection of AD.

Smartphones have the potential for capturing subtle changes in cognition that characterize preclinical Alzheimer’s disease (AD) in older adults. The Ambulatory Research in Cognition (ARC) smartphone application is based on principles from ecological momentary assessment (EMA) and administers brief tests of associative memory, processing speed, and working memory up to 4 times per day over 7 consecutive days. ARC was designed to be administered unsupervised using participants’ personal devices in their everyday environments.

We evaluated the reliability and validity of ARC in a sample of 268 cognitively normal older adults (ages 65–97 years) and 22 individuals with very mild dementia (ages 61–88 years). Participants completed at least one 7-day cycle of ARC testing and conventional cognitive assessments; most also completed cerebrospinal fluid, amyloid and tau positron emission tomography, and structural magnetic resonance imaging studies.

First, ARC tasks were reliable as between-person reliability across the 7-day cycle and test-retest reliabilities at 6-month and 1-year follow-ups all exceeded 0.85. Second, ARC demonstrated construct validity as evidenced by correlations with conventional cognitive measures (r = 0.53 between composite scores). Third, ARC measures correlated with AD biomarker burden at baseline to a similar degree as conventional cognitive measures. Finally, the intensive 7-day cycle indicated that ARC was feasible (86.50% approached chose to enroll), well tolerated (80.42% adherence, 4.83% dropout), and was rated favorably by older adult participants.

Overall, the results suggest that ARC is reliable and valid and represents a feasible tool for assessing cognitive changes associated with the earliest stages of AD.

The current study examined whether self-reported memory problems among cognitively intact older adults changed concurrently with, preceded, or followed depressive symptoms over time.

Data were collected annually via in-person comprehensive medical and neuropsychological examinations as part of the Einstein Aging Study.

Community-dwelling older adults in an urban, multi-ethnic area of New York City were interviewed.

The current study included a total of 1,162 older adults (Mage = 77.65, SD = 5.03, 63.39% female; 74.12% White). Data were utilized from up to 11 annual waves per participant.

Multilevel modeling tested concurrent and lagged associations between three types of memory self-report (frequency of memory problems, perceived one-year decline, and perceived ten-year decline) and depressive symptoms.

Results showed that self-reported frequency of memory problems covaried with depressive symptoms only in participants who were older at baseline. Changes in perceived one-year and ten-year memory decline were related to changes in depressive symptoms across all ages. Depressive symptoms increased the likelihood of perceived ten-year memory decline the next year; however, perceived ten-year memory decline did not predict future depressive symptoms. Additionally, no significant temporal relationship was observed between depressive symptoms and self-reported frequency of memory problems or perceived one-year memory decline.

Our findings highlight the importance of testing the unique associations of different types of self-reported memory problems with depressive symptoms.