People living with younger onset neurocognitive disorders (YOND) experience significant delays in receiving an accurate diagnosis. Although neuropsychological assessment can help assist in a timely diagnosis of YOND, several barriers limit the accessibility of these services. Utilising teleneuropsychology may assist with the service access gap. This study aimed to investigate whether similar results were found on neuropsychological tests administered using videoconference and in person in a sample of people living with YOND.

Participants with a diagnosis of YOND were recruited from the Royal Melbourne Hospital (RMH) Neuropsychiatry inpatient ward and outpatient clinic, and through community advertising. A randomised counterbalanced cross-over design was used where participants completed 14 tests, across two administration sessions: one in person and one using videoconference. There was a two-week interim between the administration sessions. The videoconference sessions were set up across two laptops using the Healthdirect Video Call platform and Q-Global. Repeated measures t-tests, intraclass correlation coefficients (ICC) and Bland-Altman plots were calculated to compare results across the test administration sessions.

Thirty participants (Mage = 60.23, SD = 7.05) completed both sessions. Huntington's disease was the most common YOND diagnosis (n = 8), followed by Alzheimer's disease (n = 6), mild cognitive impairment (n = 6) and frontotemporal dementia (n = 4). Preliminary results from the current study indicate no statistically significant differences, and small effect sizes, between the in-person or videoconference sessions. ICC estimates range from .69 to .97 across neuropsychological tests.

This study provides preliminary evidence that performances are comparable between in-person and videoconferencemediated assessments for most neuropsychological tasks evaluated in people living with YOND. Should further research confirm these preliminary results, findings will support the provision of teleneuropsychology to address the current service gaps experienced by people with YOND.

Early detection of mild cognitive impairment (MCI) and dementia is crucial for initiation of treatment and access to appropriate care. While comprehensive neuropsychological assessment is often an intrinsic part of the diagnostic process, access to services may be limited and cannot be utilized effectively on a large scale. For these reasons, cognitive screening instruments are used as brief and cost-effective methods to identify individuals who require further evaluation. Novel technologies and automated software systems to screen for cognitive changes in older individuals are evolving as new avenues for early detection. The present study presents preliminary data on a new technology that uses automated linguistic analysis software to screen for MCI and dementia.

Data were collected from 148 Spanish-speaking individuals recruited in Spain (MAge=74.4, MEducation=12.93, 56.7% females) of whom 78 were diagnosed as cognitively normal [CN; Mmmse = 28.51 (1.39)], 49 as MCI [MMMSE = 25.65 (2.94)], and 21 as all-cause dementia [MMMSE = 22.52 (2.06)]. Participants were recorded performing various verbal tasks [Animal fluency, phonemic (F) fluency, Cookie Theft Description, and CERAD list learning task]. Recordings were processed via text-transcription and sound signal processing techniques to capture neuropsychological variables and audio characteristics. Features from each task were used in the development of an algorithm (for that task) to compute a score between 0 or 1 (healthy to more impairment), and a fifth algorithm was constructed using audio characteristics from all tasks. These five classifiers were combined algorithmically to provide the final algorithm. Receiver Operating Characteristic (ROC) analysis was conducted to determine sensitivity and specificity of predicted algorithm performance [CN vs. impaired (MCI or dementia)] against clinical diagnoses, and additional general linear modeling was used to test whether age, sex, education, and multilingualism significantly predicted logistically transformed weighted algorithm scores.

Scores were transformed to logit scores, with significant differences in mean logit scores between all groups (p <.001). Logit-inverse transformation of mean logit scores (possible range 0 -1) resulted in values of 0.06 for CN, 0.90 for MCI, and 0.99 for all-cause dementia groups. ROC curve analyses revealed the algorithm obtained a total area under the curve of 0.92, with an overall accuracy of 86.8%, a sensitivity of 0.92, and specificity of 0.82. Age was identified as a significant predictor (beta = 0.22; p <0.01) of algorithm output, whereas years of education (beta = -0.04; p = 0.64), sex (beta = 0.38; p = 0.02, did not survive correction for type-1 error), and multilingualism (beta = -0.24; p = 0.22) were non-significant.

These findings provide initial support for the utility of an automated speech analysis algorithm to detect cognitive impairment quickly and efficiently in a Spanish-speaking population. Although sociodemographic variables were not included in the algorithm, age significantly predicted algorithm output, and should be further explored to determine if age-adjusted formulas would improve algorithm accuracy for younger versus older individuals. Additional research is needed to validate this novel methodology in other languages, as this may represent a promising cross-cultural screening method for MCI and dementia detection.

Ecological momentary assessment (EMA) allows for tracking participant responses across multiple timepoints within the context of typical daily experiences. This study used EMA delivered via smartwatches to investigate dynamic associations between older adults’ fluctuations in cognitive performance as measured by an n-back test and self-reports of current internal (i.e., mental sharpness, fatigue, stress) and external (i.e., environmental distractions, time of day) contextual states over seven days. We hypothesized that 1) cognitive test fluctuations throughout the week would be meaningful beyond average cognitive test scores and 2) cognitive test scores would fluctuate in response to internal and external contexts.

Participants were 28 community-dwelling older adults recruited for a larger clinical trial assessing the influence of lifestyle factors and compensatory strategy use on cognitive health. During week one of the trial, participants received a smartwatch which sent prompts four times a day for seven consecutive days. The prompts included a 45-second one-back shape test, along with Likert-style questions about their current experience. Questions assessing participants’ internal contexts asked about participants’ experience “right now” of mental sharpness, physical fatigue, and stress. External context was assessed via the EMA prompt, “Right now my environment is distracting,” and time of day of the response.

Data was screened such that all data points outside the 7-day prompt window were removed, one participant who did not respond to any prompts was removed, and participants who responded to less than 60% of the shape test prompts were removed (n = 10). The sample used for this preliminary analysis included 17 participants (Age, M = 71.94 years; Education, M = 14 years; 88% Female; 88% White) with an average compliance of 75% (Range = 17 - 26 shape test responses) and an average shape test accuracy of > 92%. Hypothesis 1 was supported by the large fluctuations of the average cognitive test scores across timepoints (M = 24.35, Min = 16, Max = 27, SD = 2.54) and by repeated-measures ANOVA of average cognitive test scores by day (F(1,7) = 5.24, p < 0.01). Hypothesis 2: Cross-correlation lags 0 to 4 were assessed. For internal contexts, cross-correlation showed a medium correlation between mental sharpness and cognition for lags 0 (r = 0.46) and 1 (r = 0.4); a small to medium correlation between physical fatigue and cognition for lags 0 (r = -0.51) and 1 (r = -0.31); and no correlation between stress and cognition (r < 0.2). For external contexts, cross-correlation revealed no correlation between environmental distraction and cognition (r < 0.3), and repeated measures ANOVA revealed no effect of time of day on cognition scores (p > 0.05).

Older adults’ cognitive performance on an n-back shape test varied over time with internal contextual states. Cognitive performance was positively associated with feelings of mental sharpness and negatively associated with physical fatigue. Current external environmental distractions and time of day were less influential on cognitive performance. As more data is collected, influences of individual fluctuations in cognitive performance will be investigated.

In the aftermath and continuance of the COVID-19 pandemic, the field of neuropsychology has experienced a burgeoning literature base on remote telehealth practices. These practices include both videoconference and telephone modalities. Several studies to date have proposed evidence suggesting that inperson and remote telehealth assessments demonstrate comparable results. One of the major limitations to telehealth practices is the scarcity of measures of processing speed. A widely used measure is the Oral Trail Making Test, which has two trials (A & B). Oral Trails B is often conceptualized as a measure of set-shifting and cognitive flexibility. And validity studies support Oral Trails B having strong test-retest reliability and correlation to its written counterpart. In contrast, there is contention as to whether Oral Trails A can be conceptualized as a measure of basic attention and speed versus simple numerical automaticity. Importantly, to our knowledge, the test-retest reliability of Oral Trails A administered specifically via telephone has never been reported in a healthy sample. The following study presents test-retest reliability for the Oral Trails A and B (in a healthy control group) administered as part of a larger study investigating the effects of deep diaphragmatic breathing on cognitive functioning.

Eighty healthy young adults with elevated stress levels were recruited from a major metropolitan city at a major university. The subjects had to be between the ages of 18 to 29 and self-reported Perceived Stress Scale score >13. The subjects could not practice any form of meditation, yoga, or breathing exercise regularly. Additionally, they could not have any severe medical or psychiatric disorder, be actively suicidal; have a substance use disorder within the past year, or use of medication with a known negative impact on cognition or autonomic nervous system (ANS) arousal. Participants were randomized to a waitlist control group or an intervention group. Cognitive assessments were administered over the phone to both groups (pre and post-treatment) and self-report measures were completed online due to quarantine restrictions.

Among participants in the waitlist control group, the mean difference (MD) between time points on OTMT-A (MD= -0.17, SD= 1.69) was small and not significant (p>0.05). The mean difference for OTMT-B (MD= -13.06, SD=26.99) was large and significant (p=0.01). Bivariate Pearson correlations were computed revealing a significant moderate strength relationship between OTMT-A performance across time points (r=0.6, p<0.001). In contrast, performance on OTMT-B across time points revealed a nonsignificant, weak relationship (r=0.2, p=1.94).

These results do not support literature demonstrating strong test-retest reliability for OTMT-B. Furthermore, this is the first study establishing test-retest reliability for the OTMT-A as administered via a novel telephonic modality. Given the novel and non-standardized method of administration, the data should be interpreted with caution. Nonetheless, given the weak relationship in OTMT-B performance and the only moderate relationship of OTMT-A performance across time points, the results suggest that the OTMT may not be highly reliable as administered via a telephonic modality.

Gaining access to specialty care services, including neuropsychology, can be challenging, especially for older adults and individuals who live in rural areas. In addition to these barriers, the ongoing COVID-19 pandemic further disrupted patient access to essential healthcare services. Telehealth, which underwent rapid expansion in response to service disruptions due to COVID-19, offers opportunities to prevent or reduce disruptions in patient care, including neuropsychological assessment. Here we describe the development and implementation of a teleneuropsychology (telenp) clinic within a major VA medical center and discuss salient clinical observations and patient feedback gathered during telenp evaluations.

A hybrid telenp clinic was developed at the Tennessee Valley VA Healthcare system to serve patients referred for neuropsychological evaluations whose access to services was impacted by the COVID-19 pandemic. Patients presented to the VA and were connected to neuropsychology providers seated in separate rooms of the hospital through synchronous video. Test batteries were created to closely approximate in-person evaluations while allowing for minor procedural modifications so tests could be administered virtually. All tests were administered by on-site trained staff. After the evaluation, anecdotal information about patient experiences and satisfaction and salient clinical observations were gathered to elucidate potential benefits and shortcomings of hybrid telenp model.

65 telenp neuropsychological evaluations were conducted between December 2020 and April 2021. Overall, patients consistently and strikingly reported a high degree of openness and acceptance towards telenp services, even despite initial technological apprehension. Importantly, patients ubiquitously reported believed they were able to adequately engage in telenp assessments, and no perceptible barriers were identified. Clinically, examiners consistently expressed surprise at the relative ease with which the evaluations could be adapted to a telenp program. Additionally, clinicians generally felt confident in the validity of the results and that the data gathered were sufficient to answer the referral question and make salient treatment recommendations and referrals. Importantly, there were some notable limitations to telenp assessment and not all patients were testable via telehealth.

Qualitatively, hybrid telenp evaluations are feasible and acceptable, and appear to be a valid alternative to face to face neuropsychological assessments. Future research should focus on establishing the reliability and validity of telenp testing compared to face-to-face testing, collective quantitative data regarding patient and clinician experiences of telenp and identify methods for implementing telenp in clinics in rural catchment areas to increase access to neuropsychological services.

During the COVID-19 pandemic, many neuropsychological services shifted from an in-person assessment to a tele-neuropsychological assessment format. Prior research studies support the use of telemedicine assessments but have also noted some limitations (i.e., tasks involving direct manipulation of physical stimuli and visuospatial tasks). We sought to examine the relationship between the same neuropsychological tasks administered via a telemedicine versus inperson format in a treatment seeking clinical sample of Veterans with history of TBI.

Veterans with history of mild to severe TBI (predominantly mild TBI) referred to the TBI Cognitive Rehabilitation Clinic within the San Diego Veterans Affairs Medical Center completed a comprehensive neuropsychological assessment to help inform diagnosis and treatment recommendations. 515 Veterans completed traditional in-person assessment (pre-pandemic) and 45 Veterans completed neuropsychological assessment via a telemedicine platform during the pandemic (Veteran was in their home and examiner was in their home or facility office). The total sample consisted of 93% male and 7% female, average age of 33, 13 years of education, 63% White, 13% Other/Non-reported, 12% Black, 6% Asian, 6% Pacific Islander, 2% Alaskan Native, and 1% Multi-Racial, 73% Non-Hispanic, and 27% Hispanic. For the purposes of this study, we used age-corrected subtest scores from the Delis-Kaplan Executive Function System (D-KEFS): Color Word Interference (CWI) and Verbal Fluency (VF), WASI-II Matrix Reasoning, California Verbal Learning Test (CVLT-II), Wechsler Memory Scale (WMS-IV): Logical Memory, and WRAT-IV Reading. We also examined symptoms of anxiety (BAI), sleep quality (PSQI), neurological symptoms (NSI), and symptoms of PTSD (PCL-5). ANOVAs were used to analyze the relationship between tele-neuropsychological versus in-person administration. Additionally, we controlled for performance validity failure.

Tele-neuropsychological task results were comparable to in-person assessment across all tasks, except for D-KEFS CWI color naming subtest where individuals completing the task via telemedicine performed approximately 2 scaled scores below the in-person assessment group, F (1, 278)=6.44, p=.012. Individuals who completed the tele-neuropsychological assessment during the COVID-pandemic did not differ on scores of self-reported symptoms of PTSD or neuropsychological symptoms when compared to in-person assessment of pre-pandemic individuals within our clinic. However, the telemedicine group reported better sleep quality (F (1, 377)=11.94, p=.001) but a trend towards more symptoms of anxiety (F (1, 552)=2.90, p=.089.

These results suggest that many of the verbal memory, language, premorbid functioning, and verbal/visual tasks of executive function can be adequately administered via telemedicine. Substantial variability may exist on measures of processing speed administered via telemedicine, however. Additionally, changes in lifestyle and daily demands during the COVID-19 pandemic may have created unique circumstances that benefited sleep quality for some individuals but also increased symptoms of anxiety/uncertainty.

Unsupervised remote digital cognitive assessment makes frequent testing feasible and allows for measurement of learning across days on participants’ own devices. More rapid detection of diminished learning may provide a potentially valuable metric that is sensitive to cognitive change over short intervals. In this study we examine feasibility and predictive validity of a novel digital assessment that measures learning of the same material over 7 days in older adults.

The Boston Remote Assessment for Neurocognitive Health (BRANCH) (Papp et al., 2021) is a web-based assessment administered over 7 consecutive days repeating the same stimuli each day to capture multi-day-learning slopes. The assessment includes Face-Name (verbal-visual associative memory), Groceries-Prices (numeric-visual associative memory), and Digits-Signs (speeded processing of numeric-visual associations). Our sample consisted of200 cognitively unimpaired older adults enrolled in ongoing observational studies (mean age=74.5, 63% female, 87% Caucasian, mean education=16.6) who completed the tasks daily, at home, on their own digital devices. Participants had previously completed in-clinic paper-and-pencil tests to compute a Preclinical Alzheimer’s Cognitive Composite (PACC-5). Mixed-effects models controlling for age, sex, and education were used to observe the associations between PACC-5 scores and both initial performance and multi-day learning on the three BRANCH measures.

Adherence was high with 96% of participants completing all seven days of consecutive assessment; demographic factors were not associated with differences in adherence. Younger participants had higher Day 1 scores all three measures, and learning slopes on Digit-Sign. Female participants performed better on Face-Name (T=3.35, p<.001) and Groceries-Prices (T=2.00, p=0.04) on Day 1 but no sex differences were seen in learning slopes; there were no sex differences on Digit-Sign. Black participants had lower Day 1 scores on Face-Name (T=-3.34, p=0.003) and Digit Sign (T=3.44, p=0.002), but no racial differences were seen on learning slopes for any measure. Education was not associated with any measure. First day performance on Face-Name (B=0.39, p<.001), but not learning slope B=0.008, p=0.302) was associated with the PACC5. For Groceries-Prices, both Day 1 (B=0.27, p<.001) and learning slope (B=0.02, p=0.03) were associated with PACC-5. The Digit-Sign scores at Day 1 (B=0.31, p<.001) and learning slope (B=0.06, p<.001) were also both associated with PACC-5.

Seven days of remote, brief cognitive assessment was feasible in a sample of cognitively unimpaired older adults. Although various demographic factors were associated with initial performance on the tests, multi-day-learning slopes were largely unrelated to demographics, signaling the possibility of its utility in diverse samples. Both initial performance and learning scores on an associative memory and processing speed test were independently related to baseline cognition indicating that these tests’ initial performance and learning metrics are convergent but unique in their contributions. The findings signal the value of measuring differences in learning across days as a means towards sensitively identifying differences in cognitive function before signs of frank impairment are observed. Next steps will involve identifying the optimal way to model multi-day learning on these subtests to evaluate their potential associations with Alzheimer’s disease biomarkers.

Korsakoff’s syndrome (KS) is a neuropsychiatric disorder, caused by malnutrition. Central to KS are severe amnesia and executive dysfunctions. KS patients often fail to remember future intentions (prospective memory),and rely heavily on external support by caregivers. Recently, specialized smartwatches have been developed to support prospective memory verbally and by displaying pictures of future events. We investigated the benefit of a smartwatch and smartphone compared to no aid in supporting time accuracy and the ability to carry out future intentions in one case study. In three subsequent case studies, we investigated the possible benefits of a smartwatch aid for prospective memory (PM) compared to verbal in-person reminders.

In the first case study, one high-functioning KS patient with a WAIS IQ of 127 points, performed a total of 36 novel prospective memory tasks in three conditions (smartwatch, smartphone and no-aid).

In the second case series, three KS patients with average IQ performed 30 everyday PM tasks in two conditions (smartwatch, in-person).

Two dependent variables were indexed in both studies: PM time accuracy (in minutes), this was calculated as minutes difference from the assigned time, and precision of the PM task (correct or incorrect).

In the first study, time accuracy was improved with a smartwatch compared to a smartphone and no-aid condition. Furthermore, the smartwatch and smartphone conditions were more effective than no aid in assisting memory for task content. In the second study, both the smartwatch and in-person instructions were equally effective in supporting prospective memory tasks.

Since prospective memory is compromised in KS, patients require assistance throughout the day in performing everyday and non-everyday tasks. The results of our case studies suggest that a smartwatch that gives specific verbal and visual reminders can be particularly helpful in supporting prospective memory for KS patients. Giving in-person instructions was equally effective as the use of this smartwatch, highlighting the possibility to support KS patients with less intensive everyday coaching. Together, these results are promising in applying smartwatches clinically to support prospective memory.

The objective of this study was to examine whether novel pandemic-related stressors have any effect on cognitive functioning. This study aimed to examine whether the overall number of pandemic-related stressors, and whether stressor type, are associated with cognitive problems. The coronavirus pandemic, and societal changes to prevent and respond to it, have created novel stressors, including unemployment, social isolation, and health risks. While prior research has focused on the physical and psychological consequences of these stressors, these stressors may also be associated with cognitive impairments. Individuals who have been infected with SARS-CoV-2 and individuals who experience chronic stress are at risk for cognitive impairments, however, research has not yet examined whether pandemic-related stressors not specifically related to infection but to the experience of the pandemic overall, are associated with cognitive deficits. This study evaluated whether pandemic-related psychosocial stressors (financial, health, role/responsibility, and social) were related to cognitive functioning. We hypothesized that individuals with a higher number of pandemic-related stressors will perform worse on cognitive domains of attention, memory, and executive functions, than those with fewer stressors.

An online survey recruited participants (A/=19), of whom 89.5% were female, and the average age was 34 years (SD=15.7), to complete an online neuropsychological battery. Participants first completed questionnaires on the coronavirus pandemic, demographic characteristics, and completed the BDI-II and the BAI. An online neuropsychological battery was administered to participants over Zoom consisting of various neuropsychological tests, including the RAVLT, story memory, digit span, FAS, animal fluency, a go-no/go task, the Stroop, and the NAART-R.

A majority of participants (89.5%) experienced one or more coronavirus pandemic stressors, with only two participants reporting no coronavirus stressors. A majority of participants experienced at least one social stressor (57.9%), role/responsibility stressor (63.2%), and health stressor (52.6%), with financial stressors (47.4%) experienced by just fewer than half of participants. Pearson’s correlations showed significant negative correlations between stressors and performance on several neuropsychological tests. Specifically, social, health, and total stressors were associated with significantly poorer performance on digit span backwards and trials of the RAVLT (i.e., Trials 15, delayed recall, recognition) (ps<.05). Social stressors, health stressors, and total pandemic stressors were significantly associated with poorer performance on measures of working memory, processing speed, verbal learning, and verbal memory.

While small sample size limits the power and generalizability of these findings, this study highlights the need to investigate the cognitive effects of pandemic-related stressors. An expanded coronavirus questionnaire would be beneficial as the current questionnaire may have not captured all stressors of the pandemic, or level of severity, that could potentially contribute to changes in neuropsychological function. Pandemic-related stressors have spread into many areas of everyday life and the consequences that have stemmed from these stressors seem to play a negative role on the general wellbeing of individuals and also show an effect on psychological and neuropsychological functioning. This study illustrates the need for an expanded response to health crises, as the negative results of this pandemic have not been solely affecting physical health.

Driving is a cognitively demanding activity commonly affected by brain injury and illness. Accurate driving assessment is essential for reducing risk, optimizing independence, and informing driving-related interventions. Virtual reality driving simulation (VRDS) enables safe, sensitive, objective, and standardized measurement of driving abilities. VRDS has been validated in relation to self-reports and driver records. However, self-reports are subjective, and driver records include only major events (collisions, violations). Video telematics platforms can measure naturalistic driving in a more objective and sensitive manner. The present study used video telematics to examine relationships between VRDS performance and directly observed naturalistic driving.

20 healthy adult drivers (ages 23-61, mean age=36; 75% women) completed a VRDS assessment that included 1) driving on a straight road, 2) following a truck on a highway, and 3) reacting to a child running into a street to retrieve a ball. Primary VRDS measures were 1) speed and lane management on the straight road; 2) speed and following distance management in the truck-following task; and 3) reaction time, stopping, and distance from the child in the child-ball task. Participants also completed 28 days of naturalistic driving with a video telematics platform in their vehicle. Driving events were detected automatically using accelerometer, GPS, and video data, and driving behaviors were coded by driving risk analysts. The primary naturalistic measure was the number of unsafe driving behaviors per hour driven; specific driving behaviors served as exploratory variables. We examined correlations between VRDS and naturalistic driving variables. Given limited statistical power, we reported correlations that were small-to-medium or greater (r>.2) in primary analyses and medium-to-large or greater (r>.4) in exploratory analyses.

On average, drivers exhibited approximately one unsafe driving behavior per hour (M=0.9, SD=0.9, range=0.1-2.7). Common behaviors were failing to stop, unsafe following distance, speeding, and cell phone use. No collisions occurred. Average lane position in VRDS (specifically, leftward deviation from the center of the lane) was correlated with more real-world unsafe driving behaviors per hour (r=.35, p=.13), as were higher average straight road speed (r=.26, p=.27), greater straight road speed variability (r=.28, p=.24), and failing to stop for the child in the child-ball task (r=.22, p=.36). In exploratory analyses, failing to stop for the child was associated with real-world distracted driving (r=.45, p=.047), greater lane position variability in VRDS was associated with real-world unsafe following distance (r=.57, p=.009), and greater speed variability in VRDS was associated with real-world seat belt non-use/misuse (r=.49, p=.03).

The present findings provide preliminary evidence that VRDS variables are related to directly observed naturalistic driving, supporting the potential utility of VRDS as a sensitive, ecologically valid driving evaluation tool. As the present study used a small sample of healthy drivers, further research will explore this topic in larger samples and in clinical populations, such as acquired brain injury. Future work will also investigate whether incorporating VRDS with conventional driving evaluation tools (e.g., neuropsychological tests, behind-the-wheel assessments) can enhance the ability of clinical driving evaluations to predict real-world risky driving.

Stroke results in various cognitive and motor impairments. The most frequent cognitive problem is spatial and non-spatial attention, typically caused by unilateral brain lesion. Attention is typically assessed with several different paper-and-pencil tests, which have long been criticized for their lack of theoretical basis, their limited ecological validity to deficits experienced in daily life, and their lack of measurement sensitivity (Appelros et al., 2004; Azouvi, 2017). Here, our global aim was to develop an innovative integrative serious game in an immersive environment. The REASmash, combines the evaluation of spatial attention, non-spatial attention, and motor performance. We present the spatial and non-spatial cognitive attention evaluation results.

Eighteen first stroke individuals and 40 age-match healthy controls were assessed on the REASmash. They were instructed to find a target mole presented amongst distractor moles. The stimulus array consisted of a grid of 6 columns and 4 rows of molehills, from which the target and 11, 17 and 23 distractors moles could randomly appear, in two search conditions (single feature condition and saliency condition). Responses were made with the ipsilesional hand for individuals with stroke and with the dominant hand for the healthy controls. Participants were evaluated also with two standardized clinical tests of attention; the hearts cancellation task of the Oxford Cognitive Screen, and the visual scanning subtest of the Test for Attentional Performance.

Validation results showed significant and strong correlations between the REASmash and the two reference tests, with the REASmash showing high sensitivity and specificity (i.e., the correct identification of the post-stroke vs. control individuals). The REASmash also showed significant and strong test/re-test reliability. We additionally evaluated user experience using the UEQ, and the results showed excellent attractiveness and novelty, and good stimulation and efficiency.

In conclusion, the REASmash is a novel immersive virtual environment serious game that is valid, sensitive, and usable. It provides a new diagnosis measure spatial and non-spatial attention impairment.

Mobile, valid, and engaging cognitive assessments are essential for detecting and tracking change in research participants and patients at risk for Alzheimer’s Disease and Related Dementias (ADRDs). The mobile cognitive app performance platform (mCAPP) includes memory and executive functioning tasks to remotely detect cognitive changes associated with aging and preclinical Alzheimer’s disease. This study assesses participants’ comfort and subjective experiences with mCAPP as the potential utility and advantage of mobile app-based assessments for remote monitoring among older adults will depend upon usability and adoptability of such technology.

The mCAPP includes three gamified tasks: (1) a memory task involving learning and matching hidden card pairs (“Concentration”) (2) a stroop-like task (“Brick Drop”), and (3) a digit-symbol coding-like task (“Space Imposters”). Participants included 37 older adults (60% female; age=72±4.4; years of education=17±2.5; 67% White) with normal cognition enrolled in the Penn ADRC cohort. Participants completed one baseline session of mCAPP in-person, followed by two weeks of at-home use with eight scheduled sessions. Information on prior experience with mobile technology and games was collected, and usability of mCAPP was measured at baseline and after 2-weeks of use with the IBM Computer Usability Satisfaction Questionnaire and the mHeath App Usability Questionnaire (MAUQ) respectively. Feedback on perceived difficulty, enjoyment, and likelihood to play mCAPP games again on their own was collected.

Participants completed on average 11±4.9 sessions over 2 weeks, with each session lasting 11.5±2.5 minutes. 59% of participants reported using their mobile device to play games (“mobile game players”). Performance on mCAPP tasks was slower at baseline for non-players, with trend-level differences on higher-load blocks of Space Imposters (p=.057 and .059). No differences in game performance were seen between groups after playing 8 sessions at-home. There were no differences in usability of mCAPP between groups, with average usability 8.2±1.5 (IBM, 0-9 scale) at T1 and 6.2±0.8 (MAUQ, 1-7 scale) after completion of two weeks of at-home use (TLast). Reported enjoyment was moderate to high for both groups at baseline and increased over time. Likelihood to play Concentration and Brick Drop again trended lower among nonplayers at T1 (p=.061 and .054), but not at TLast. Further, change in likelihood to play mCAPP from T1 to TLast was positive among non-players, with change for Concentration significantly higher for non-players than for players (p=.037).

Participants were willing and able to complete at-home cognitive testing and most completed more than the assigned sessions. While participants who do not play games on their own mobile device were slower on some tasks at baseline, these differences dissipated with further play at-home. Usability and enjoyment of mCAPP games were high regardless of mobile game-playing status, and non-players demonstrated increased willingness to play mCAPP games again at the end of participation compared to baseline. This pilot study shows preliminary feasibility and adoptability of mobile app-based assessment regardless of prior experience with mobile games.

Frequent and remote cognitive assessment may improve sensitivity to subtle cognitive decline associated with preclinical Alzheimer’s disease (AD). The objective of this study was to evaluate the feasibility and acceptability of repeated remote memory assessment in late middle-aged and older adults.

We recruited participants from a longitudinal aging cohort to complete three medial temporal lobe-based memory paradigms (Object-In-Room Recall [ORR], Mnemonic Discrimination for Objects and Scenes [MDT-OS], Complex Scene Recognition [CSR]) using the neotiv application at repeated intervals over one year. We conducted initial telephone calls to perform screening, consent, and download instructions. Participants were assigned 24 remote sessions on a smartphone or tablet and were alerted via push notification when an assignment was ready to complete. Participants were randomly assigned to: (1) complete memory tests every other week or (2) complete memory tests for multiple days within one week every other month. Each remote session lasts approximately 10 minutes and includes one memory paradigm and brief usability/acceptability questionnaires followed by a delayed retrieval session 90 minutes later. Feasibility metrics examined included participation, retention, compliance, and usability/acceptability.

Of 150 participants recruited, 113 consented and were enrolled into the study (participation rate = 75%). Current retention rate is 75%, with 85/113 currently active (n=73) or completed (n=12). Of the 85 active or completed participants, the mean age is 68.7 (range = 4882), 64% are women, 70% used a smartphone (30% tablet), 84 are cognitively unimpaired and 1 has mild cognitive impairment. The primary threat to retention was participants consenting into the study but never registering in the app or completing their first scheduled assignment. After enrollment, 130 telephone calls were made by study staff to facilitate registration into the app or to remind participants to complete tasks. 74-80% of participants completed delayed retrieval tasks within 30 minutes of push notification, but average retrieval time was 125137 minutes post-learning trials. Regarding acceptability/usability, 94% agreed the application was easy to use, 56% enjoyed completing the mobile memory tests (36% felt neutral), 40% prefer remote mobile memory tests to standard in-person paper and pencil tests, and 50% understood the test instructions. 87% felt the frequency of tests assigned was “just right” (13% “too often”) and 90% felt the test length was “just right” (7% too short, 3% too long). Participants who completed all 24 sessions to date (n=12) all endorsed being “satisfied” or “very satisfied” with the platform and visit schedule, as well as recommended continued use of this type of cognitive testing.

Remote memory assessment using smartphones and tablets is feasible and acceptable for cognitively unimpaired late middle-aged and older adults. Follow-up by study staff was needed to ensure adequate retention. Comprehension of instructions and compliance with completing delayed retrieval tasks within the expected timeframe was lower than expected. These feedback will be incorporated into an updated version of the app to improve compliance and retention. Longitudinal data collection is ongoing and results will be updated with a larger sample. Results will be compared across frequency schedule groups.

Routine cognitive screening in the elderly may facilitate earlier diagnosis of neurodegenerative diseases and access to care and resources for patients and families. However, despite growing rates of Alzheimer's and related disorders (ADRD), the availability and implementation of cognitive screening for older adults in the US remains quite limited. Remote cognitive assessment via smartphone app may reduce several barriers to more widespread screening. We examined the validity of a remote app-based cognitive screening protocol in healthy older adults by examining remote task convergence with standard-person assessments and cerebral amyloid (Aß) status as an AD biomarker.

Participants (N =117) were cognitively unimpaired adults aged 60-80 years (67.5% female, 88% White, 75% education > 16 years). A portion had Aß PET imaging results available from prior research participation [(Aß positive (Aß+) n =26, and Aß negative (Aß-) n = 44]. A modified Telephone Interview for Cognitive Status (TICSm) cutoff score of >34 was used to establish unimpaired cognition. Participants completed 8 consecutive assessment days using Mobile Monitoring of Cognitive Change (M2C2), a smartphone app-based testing platform developed as part of the National Institute of Aging's Mobile Toolbox initiative. Brief (i.e., 3-4 minute) M2C2 sessions were assigned daily within morning, afternoon, and evening time windows. Tasks included measures of visual working memory (WM), processing speed (PS), and episodic memory (EM) (see Thompson et al., 2022). Participants then completed a battery of standard neuropsychological assessments in-person at a follow-up visit.

Participants completed 22.6 (SD = 2.6) out of 24 assigned sessions (3 sessions x 8 days) on average. Performance on all M2C2 tasks decreased significantly with age. Women performed significantly better on WM and EM tasks relative to men. There were no detectable significant differences in performance by race or education. Shorter mean reaction time on M2C2 PS trials predicted faster Trails A and B completion (ß = .26, p < .01, 95% CI [3.8, 23.3] and ß = .20, p < .05, 95% CI [.23, 6.8], respectively). Greater mean M2C2 WM accuracy predicted longer maximum backward digital span (ß = .24, p = .01, 95% CI [.02, .16]). Greater mean M2C2 EM accuracy predicted stronger Logical Memory delayed recall (ß = .33, p < .001, 95% CI [.004, .012]) and total immediate recall on the Free and Cued Selective Reminding Test (ß = .19, p < .05, 95% CI [.000, .006]). Moreover, EM significantly distinguished Aß- and Aß+ individuals (t (68) = 3.0, p < .01) with fair accuracy (AUC = .72).

Mean performance across 8-days on each M2C2 task predicted same-domain cognitive task performance on a standard assessment battery, with medium effect sizes. Performance on the EM task was also sensitive to cerebral Aß status, consistent with subtle memory changes implicated in the preclinical stage of AD. These findings support the validity of this remote testing protocol in healthy older adults, with implications for future efforts to facilitate accessible and sensitive cognitive screening for early detection of ADRD. Limitations include the restricted generalizability of this primarily white and college educated sample.

Vascular complications, including elevated body mass index (BMI), are known risk factors for cognitive impairment. Obtaining a cognitive baseline is commonplace in pre-surgical protocols, including for Parkinson’s disease and epilepsy. Currently, routine evaluations for bariatric surgery candidates do not include neuropsychological assessment. This setting provides a unique opportunity to identify cognitive profiles of younger individuals at risk for cognitive impairment. Here, we argue for the standard implementation of a brief, online cognitive battery via telemedicine, to enhance existing protocols of bariatric pre-surgical evaluations.

Nineteen bariatric surgery candidates were referred to a private neuropsychological assessment practice for pre-surgical cognitive/psychological evaluation. Assessments were conducted by a neuropsychologist and a psychology graduate student, via remote video conferencing, between April 2020 and June 2022. Candidates completed a clinical interview, intake form, and the Behavior Rating Inventory of Executive Function for Adults (BRIEF-A), and were administered a battery of cognitive measures: Wechsler Test of Adult Reading (WTAR), Hopkins Verbal Learning Test-Revised (HVLT-R); and select subtests from the TestMyBrain Digital Neuropsychology Toolkit: Trail Making Tests A and B (TMT-A/B), Matrix Reasoning (MR), Digit Span Forward and Backward (DSF, DSB), Gradual Onset Continuous Performance Test (CPT), and Simple and Choice Reaction Time (SRT, CRT). Descriptive statistics were conducted to analyze sample demographics. Raw scores on cognitive measures were converted to z-scores and averaged across the sample.

The average age at evaluation was 38.2 (9.6) years and average pre-surgical BMI was 46.6k/m2 (9.3), indicating morbid obesity (BMI>40k/ m2). Ten (52.6%) candidates identified as female, 10 (52.6%) identified as White, 8 (42.1%) had 12 years of education or less, 4 (21.1%) were unemployed, and 9 (47.4%) had comorbid psychiatric diagnoses. BRIEF-A sub-scales were within the average range (T’s= 47.9 - 52.9, SD’s [10.1 - 12.8]). Estimated premorbid IQ was average at 102.7 (11.4). Neuropsychological data revealed group performance within the average range on DSF and DSB (z’s= 0.00), TMT-A (z= -0.16), MR (z= -0.53), CPT (z= -0.39), and HVLT-R False Positives (z= 0.05) and Recognition Discriminability (z= -0.44). SRT (z= -0.70), CRT Accuracy (z= -1.37), TMT-B (z= -0.79), HVLT-R Total Recall and Percent Retained (z’s= -0.88), and Delayed Recall and True Positives (z’s= -1.27) were low average.

In this sample of pre-surgical bariatric candidates with average intelligence, baseline evaluations revealed mild deficits in reaction time accuracy, visual motoric set-shifting, and verbal learning/memory. These deficits may be the result of microvascular changes in the brain secondary to physical compromise. Results provide additional insight into potential early-onset executive dysfunction, psychomotor slowing, and verbal learning/memory difficulties. In addition to these relative areas of neuropsychological weakness, candidates demonstrated relative strengths in attention, working memory, and visuospatial functioning. These insights provide pre-surgical evaluators with additional information to tailor recommendations and treatment approaches that foster surgical success. With a remote, concise, easy-to-administer battery of tests, routine neuropsychological assessment for bariatric surgery candidates is both a feasible and a useful tool for identifying areas of cognitive strengths and weaknesses. Documenting a patients’ cognitive baseline can assist with monitoring long-term vascular risk-factors and potential cognitive impairment.

Neuropsychological (NP) tests are increasingly computerized, which automates testing, scoring, and administration. These innovations are well-suited for use in resource-limited settings, such as low- to middle- income countries (LMICs), which often lack specialized testing resources (e.g., trained staff, forms, norms, equipment). Despite this, there is a dearth of research on their acceptability and usability which could affect performance, particularly in LMICs with varying levels of access to computer technology. NeuroScreen is a tablet-based battery of tests assessing learning, memory, working memory, processing speed, executive functions, and motor speed. This study evaluated the acceptability and usability of NeuroScreen among two groups of LMIC adolescents with and without HIV from Cape Town, South Africa and Kampala, Uganda.

Adolescents in Cape Town (n=131) and Kampala (n=80) completed NeuroScreen and questions about their use and ownership of, as well as comfort with computer technology and their experiences completing NeuroScreen. Participants rated their technology use -comfort with and ease-of-use of computers, tablets, smartphones, and NeuroScreen on a Likert-type scale: (1) Very Easy/Very Comfortable to (6) Very Difficult/Very Uncomfortable. For analyses, responses of Somewhat Easy/Comfortable to Very Easy/Comfortable were collapsed to codify comfort and ease. Descriptive statistics assessed technology use and experiences of using the NeuroScreen tool. A qualitative question asked how participants would feel receiving NeuroScreen routinely in the future; responses were coded as positive, negative, or neutral (e.g., “I would enjoy it”). Chi-squares assessed for group differences.

South African adolescents were 15.42 years on average, 50.3% male, and 49% were HIV-positive. Ugandan adolescents were 15.64 years on average, 50.6% male, and 54% HIVpositive. South African participants were more likely than Ugandan participants to have ever used a computer (71% vs. 49%; p<.005), or tablet (58% vs. 40%; p<.05), whereas smartphone use was similar (94% vs 87%). South African participants reported higher rates of comfort using a computer (86% vs. 46%; p<.001) and smartphone (96% vs. 88%; p<.05) compared to Ugandan participants. Ugandan adolescents rated using NeuroScreen as easier than South African adolescents (96% vs. 87%; p<.05).). Regarding within-sample differences by HIV status, Ugandan participants with HIV were less likely to have used a computer than participants without HIV (70% vs. 57%; p<.05, respectively).The Finger Tapping test was rated as the easiest by both South African (73%) and Ugandan (64%) participants. Trail Making was rated as the most difficult test among Ugandan participants (37%); 75% of South African participants reported no tasks as difficult followed by Finger Tapping as most difficult (8%). When asked about completing NeuroScreen at routine doctor’s visits, most South Africans (85%) and Ugandans (72%) responded positively.

This study found that even with low prior tablet use and varying levels of comfort in using technology, South African and Ugandan adolescents rated NeuroScreen with high acceptability and usability. These data suggest that scaling up NeuroScreen in LMICs, where technology use might be limited, may be appropriate for adolescent populations. Further research should examine prior experience and comfort with tablets as predictors NeuroScreen test performance.

Virtual testing can reduce cost and burdens, as well as increase access to clinical care. Few studies have examined the equivalency of virtual and in-person administration of standardized measures of executive functioning in children. During the COVID-19 pandemic, we utilized virtual administration of the Delis-Kaplan Executive Function System, Color-Word Interference Test (DKEFS-CW) in our ongoing longitudinal research study exploring outcomes in children clinically recovered from concussion compared to never-concussed peers. In the current study, we explore the equivalence of scores obtained via in-person and virtual administration of the DKEFS-CW in youth recovered from concussion and never-concussed controls.

Participants included 112 youth ages 10-18 (Mage=14.05 years, SD=2.296; 53.5 % Male) who completed the DKEFS-CW in-person (n=63) or virtually (n=49) as part of their involvement in the parent study. Of these, 38 were recovered from concussion (Mdays since injury— 91.21, SD=88.91), and 74 were never-injured controls. Virtual administration was done via Zoom by presenting digital scans of the DKEFS stimulus book using the screen-sharing function. Participants set up and joined the Zoom call from a secondary device (cell phone) that was set in a stable position to provide a view of their screen, mouse and keyboard setup. Group (in-person vs remote) differences in DKEFS-CW scores were examined using independent-samples t-tests for all subtest conditions (color naming, word reading, inhibition, and inhibition/switching). T-tests/chi-square tests were used to examine between-group differences in demographic variables (i.e., age, sex maternal education, IQ, concussion history). Demographic variables that were significantly different by group were then included as covariates in ANCOVA models examining the effect of administration context on performance.

There were no significant differences in DKEFS-CW scaled scores between those who were administered the measure in-person or virtually (Color Naming: Min-person=10.78, Mvirtual=10.08, t(110)=1.634, p=.105; Word Reading: Min-person=11.25, Mvirtual=10.92, t(110)=.877, p=.382; Inhibition: M in-person= 11.70, Mvirtual=11.24, t(110)=1.182, p=.240; Inhibition/Switching: Mi n-person= 11.29, Mvirtual=10.82, t(110)=1.114, p=.268). There were no significant between-group differences in concussion history, sex, maternal education or IQ. However, those who were administered the DKEFS-CW in-person (Mage=13.55) were significantly younger than those who were administered the measure virtually (Mage=14.69), t(110)=-2.777, p=.006. After controlling for age, there remained no significant relationship between administration context (in-person vs. virtual) and DKEFS-CW performance for any subtest condition (Color Naming: F(1,30)=.016, p=.889; Word Reading: F(1,76)=.655, p=.421; Inhibition: F(1,30)=.038, p=.847; Inhibition/Switching: F(1,30)=.015, p=.902).

The recommended practice for remote administration of DKEFS-CW is to have test stimuli presented flat on a table by a trained facilitator present with the examinees. Here, we provide preliminary evidence of equivalence between DKEFS-CW scores from tests completed in-person and those completed virtually with stimuli presented on a computer screen. Future studies are needed to replicate these findings in clinical populations with greater variability in executive function. Some clinical populations may also require more in-person support. Likewise, future studies may examine the role of trained facilitators or caregivers in the virtual testing process.

The COVID-19 pandemic created barriers to healthcare that necessitated changes in services to meet needs of individuals. With these changes, technological advances in computerized cognitive testing became critical. As researchers and clinicians accelerated adaptation of computerized testing formats, considerations for development and interpretation of such tools have proved imperative. One such computerized tool, RC21X, utilizes performance measurement software comprising 15 modules to evaluate an individual’s processing speed, memory, executive functions, and neuromotor coordination. Although initial data has revealed strong psychometric properties (Saganis et al., 2020), a need to explore various attributes of this web-based tool has emerged. The current study examined impact of dominant handedness on an RC21X neuromotor task.

The sample consisted of 602 participants: 553 (91.86%) were right-hand dominant and 49 (8.14%) were left-hand dominant. Of participants who identified their sex, 81.2% were male, 18.3% were female; 0.5% chose not to identify. Age ranged from 7-95 years (M = 41.21, SD = 18.81). This study focused on the RC21X Eye-Hand Coordination subtest. Using a Fitts’ Law paradigm, the module provided instruction for participants to alternately press the “A” and “L” keys on a keyboard as quickly and accurately as possible using only one upper extremity (UE) at a time (tested separately for right then left UE). We computed a one-way between groups multivariate analysis of variance (MANOVA) to investigate handedness differences on task performance. Dependent variables were individuals’ performances on right- and left-UE tasks; the independent variable was dominant handedness. We conducted preliminary assumption testing with no serious violations noted. We also separated the sample by dominant handedness to compare right versus left-hand performance using paired samples t-tests within each group. There were no significant differences between the two groups on either age or sex.

There was a statistically significant difference between right-hand dominant and left-hand dominant participants on the dependent variables, F (2, 599) = 8.84, p < .001, Wilks’ Lambda = .971. Mean scores indicated that right-hand dominant participants (M = 52.87, SD = 20.42) outperformed their left-hand dominant counterparts (M = 46.30, SD = 12.79) when using their right UE, though both groups performed similarly when using their left UE (right-hand dominant M = 48.55, SD = 17.81; left-hand dominant M = 49.70, SD = 14.13). These findings were present despite expected results from paired samples t-tests that revealed individuals performed best with their dominant hand.

Results revealed that handedness is necessary to consider in design and utilization of computerized neuropsychological tests. The large proportion of right-hand dominant individuals may have affected our results; however, our sample is representative of handedness distribution in the general population. Although our paired samples t-tests support validity of RC21X, continued investigation of computerized performance measurement tools is necessary. Future research must explore the possibility of an ordering effect (i.e., right-handed participants starting with their dominant UE, but left-handed participants starting with their nondominant UE) or due to construction of everyday items (e.g., computer keyboards) primarily for right-hand dominant people.

There are numerous adverse health outcomes associated with dementia caregiving, including increased stress and depression. Caregivers often face time-related, socioeconomic, geographic, and pandemic-related barriers to treatment. Thus, implementing mobile health (mHealth) interventions is one way of increasing caregivers’ access to supportive care. The objective of the current study was to collect data from a 3-month feasibility trial of a multicomponent mHealth intervention for dementia caregivers.

40 community-dwelling dementia caregivers were randomized to receive the CARE-Well (Caregiver Assessment, Resources, and Education) App or internet links connected to caregiver education, support, and resources. Caregivers were encouraged to use the App or links at least 4 times per week for 3 months. The App consisted of self-assessments, caregiver and stress reduction education, behavior problem management, calendar reminders, and online social support. Caregivers completed measures of burden, depression, and desire to institutionalize at baseline and post-intervention. Feasibility data included App usage, retention and adherence rates, and treatment satisfaction. Data were analyzed via descriptive statistics.

Caregivers were mostly white (95%), female (68%), in their mid-60s, (M= 66.38, SD= 10.64), and well-educated (M= 15.52 years, SD= 2.26). Caregivers were mainly spouses (68%) or adult children (30%). Care recipients were diagnosed with mild (60%) or moderate (40%) dementia, with 80% diagnosed as having Alzheimer’s disease. Overall, the study had an 85% retention rate (80% for App group; 90% for links group). 58% of caregivers in the App group were considered high users, using the App >120 minutes over the course of 3 months (M= 362.42, SD= 432.68), and an average of 16.44 days (SD= 15.51). 15% of the sample was non-adherent due to time constraints, disinterest, and/or technology issues. Most participants (75%) using the App were mostly or very satisfied, about 87% would be likely or very likely to seek similar programs in the future, and 93% found the App mostly or very understandable. Groups did not significantly differ on clinical outcomes, although the study was not powered for an efficacy analysis. Within groups analysis revealed significant increases in depressive symptoms at post-treatment for caregivers in both groups.

This study demonstrated initial feasibility of the CARE-Well App for dementia caregivers. App use was lower than expected, however, high satisfaction, ease of use, and willingness to use similar programs in the future were endorsed. Some caregivers did not complete the intervention due to caregiving responsibilities, general disinterest, and/or technology issues. Although the study was not designed to assess clinical outcomes, we found that both groups reported higher depressive symptoms at post-treatment. This finding was unexpected and might reflect pandemic-related stress, which has been shown to particularly impact dementia caregivers. Future studies should address the efficacy of multicomponent mHealth interventions for dementia caregivers and the effects of increased dose on clinical outcomes. mHealth interventions should be refined to cater to varying levels of technology literacy among caregivers, and further research should aim to better integrate interventions into caregivers’ routines to enhance treatment engagement.

Telecommunication-assisted neuropsychological assessment (teleNP) has become more widespread, particularly in response to the COVID-19 pandemic. However, comparatively few studies have evaluated in-home teleNP testing and none, to our knowledge, have evaluated the National Alzheimer’s Coordinating Center’s (NACC) Uniform Data Set version 3 tele-adapted test battery (UDS v3.0 t-cog). The current study compares in-home teleNP administration of the UDS v3.0, acquired while in-person activities were suspended due to COVID-19, with a prior in-person UDS v3.0 evaluation.

210 participants from the Michigan Alzheimer’s Disease Research Center’s longitudinal study of memory and aging completed both an in-person UDS v3.0 and a subsequent teleNP UDS v3.0 evaluation. The teleNP UDS v3.0 was administered either via video conference (n = 131), telephone (n = 75), or hybrid format (n = 4) with approximately 16 months between evaluations (mean = 484.7 days; SD = 122.4 days; range = 320-986 days). The following clinical phenotypes were represented at the initial assessment period (i.e., the most recent in-person UDS v3.0 evaluation prior to the teleNP UDS v3.0): cognitively healthy (n = 138), mild cognitive impairment (MCI; n = 60), dementia (n = 11), and impaired not MCI (n = 1). Tests included both the in-person and teleNP UDS v3.0 measures, as well as the Hopkins Verbal Learning Test-Revised (HVLT-R) and Letter “C” Fluency.

We calculated intraclass correlation coefficients (ICC) with raw scores from each time point for the entire sample. Sub-analyses were conducted for each phenotype among participants with an unchanged consensus research diagnosis: cognitively healthy (n = 122), MCI (n = 47), or cognitively impaired (i.e., MCI, dementia, and impaired not MCI) (n = 66). Test-retest reliability across modalities and clinical phenotypes was, in general, moderate. The poorest agreement was associated with the Trail Making Test (TMT) - A (ICC = 0.00; r = 0.027), TMT - B (ICC = 0.26; r = 0.44), and Number Span Backward (ICC = 0.49). The HVLT-R demonstrated moderate reliability overall (ICC = 0.51-0.68) but had notably weak reliability for cognitively healthy participants (ICC = 0.12-0.36). The most favorable reliability was observed in Craft Story 21 Recall - Delayed (ICC = 0.77), Letter Fluency (C, F, and L) (ICC = 0.74), Multilingual Naming Test (MINT) (ICC = 0.75), and Benson Complex Figure – Delayed (ICC = 0.79).

Even after accounting for the inherent limitations of this study (e.g., significant lapse of time between testing intervals), our findings suggest that the UDS v3.0 teleNP battery shows only modest relationships with its in-person counterpart. Particular caution should be used when interpreting measures showing questionable reliability, though we encourage further investigation of remote vs. in-person testing under more controlled conditions.