Technologies for Functionally Relevant Neuropsychological Assessment

Author(s):  
Maria T. Schultheis ◽  
Matthew Doiron

Over the course of its history, the field of neuropsychology has shifted its focus to meet the demands of the medical landscape. Before the advent of neuroimaging, neuropsychologists were relied on to determine brain lesion location and to diagnose brain-behavior pathologies. As time progressed, neuroimaging was able to provide faster and more consistent lesion identification and neuropsychology began to adapt its skills and services for other related fields, such as education, law, and rehabilitation. As a result, some neuropsychological methods were adapted to assess broader cognitive functions in a variety of populations and the general public; however, these assessments have been heavily rooted in the field’s diagnostically focused past, which creates limitations in the ecological validity of this approach. Ecological validity can be generally defined as a measure’s ability to predict functional performance or mimic activities of everyday living (i.e., performance at work, driving). For example, batteries of neuropsychological tests and questionnaires have been used to infer level of function and general performance at work or school. These batteries were developed due their statistical associations with different populations, concordance with neurological theories and constructs, and general face validity. However, very few assessments resembled any activity a person would perform in daily life. For many measures, ecological validity was defined by correlating performance with everyday functioning (verdicality; Franzen & Wilhelm, 1996). In contrast, another approach to ecological validity involved designing measures to resemble or mimic an everyday function (verisimilitude; Franzen & Wilhelm, 1996). The major difference between the two approaches determines the primary goal of designing the measure at the onset. It must be decided if the measure will prioritize construct validity at the onset and subsequently infer a link to everyday function, or vice versa. Many researchers interested in predicting functional outcome have relied on verisimilitude, as it more closely resembles “real-world” performance; however, it often comes at a cost of interpretability within the context of current neuropsychological frame­works and models.

2019 ◽  
Vol 25 (10) ◽  
pp. 1035-1043
Author(s):  
Erica Weber ◽  
Nancy D. Chiaravalloti ◽  
John DeLuca ◽  
Yael Goverover

AbstractObjective:Persons with multiple sclerosis (MS) often report prospective memory (PM) failures that directly impact their everyday life. However, it is not known whether PM deficits confer an increased risk of poorer everyday functioning. The aims of this study were to: (1) compare time- (Time-PM) and event-based PM (Event-PM) performance between persons with MS and healthy controls (HCs), (2) examine the neuropsychological correlates of PM in MS, and (3) examine the relationship between PM and everyday functioning in MS.Method:A between-subjects design was used to examine 30 adults with MS and 30 community-dwelling HC. Participants were administered the Memory for Intentions Screening Test (MIST) to assess PM skills, the Actual Reality™ (AR) to assess everyday functioning, and a battery of cognitive tests.Results:The MS group performed significantly worse on Time-PM compared to HC but not on Event-PM tasks. While both Time-PM and Event-PM subscales were correlated with retrospective learning and memory, the MIST Time-PM subscale was correlated with executive functions. Significant correlations were observed between AR and the MIST Time-PM, but not Event-PM, subscales.Conclusions:The results highlight the role of executive functions on Time-PM. Furthermore, significant relationships with AR extend the ecological validity of the MIST to MS populations.


Crisis ◽  
2001 ◽  
Vol 22 (1) ◽  
pp. 12-14 ◽  
Author(s):  
Darryl Watson ◽  
Robert Goldney ◽  
Laura Fisher ◽  
Michael Merritt

A four-item suicidal ideation subscale of the GHQ-28 has been used previously to assess suicidal ideation on the basis of its face validity. In order to further validate its use, this study compared scores on this scale with scores on a well-established suicidal intent scale. There was a significant correlation between scores of that subscale and the self-report component as well as the overall score of the suicidal intent scale, thereby confirming its validity in providing a standardized method for comparing suicidal ideation in different populations.


2021 ◽  
Author(s):  
Polly V Peers ◽  
Sarah F Punton ◽  
Fionnuala C Murphy ◽  
Peter Watson ◽  
Andrew Bateman ◽  
...  

Cognitive difficulties are common following stroke and can have widespread impacts on everyday functioning. Technological advances offer the possibility of individualised cognitive training for patients at home, potentially providing a low-cost, low-intensity adjunct to rehabilitation services. Using this approach, we have previously demonstrated post-training improvements in attention and everyday functioning in fronto-parietal stroke patients. Here we examine whether these benefits are observed more broadly in a community stroke sample. Patients were randomised to either 4 weeks of online adaptive attention training (SAT), working memory training (WMT) or waitlist (WL). Cognitive and everyday function measures were collected before and after intervention, and after 3months. During training, weekly measures of patients' subjective functioning were collected. The training was well received and compliance good. No differences in standardised cognitive tests were observed for either intervention relative to controls. However, on patient reported outcomes, SAT participants showed greater levels of improvement in everyday functioning than WMT or WL participants. In line with our previous work, everyday functioning improvements were greatest for patients with spatial impairments and those who received SAT training. Whether attention training can be recommended for stroke survivors depends on whether cognitive test performance or everyday functioning is considered more relevant.


2017 ◽  
Vol 40 (1) ◽  
pp. 29-37 ◽  
Author(s):  
Charles Cotrena ◽  
Laura Damiani Branco ◽  
Rochele Paz Fonseca

Abstract Introduction: Decision making (DM) is among the most important abilities for everyday functioning. However, the most widely used measures of DM come from behavioral paradigms, whose ecological validity and standalone use has been criticized in the literature. Though these issues could be addressed by the use of DM questionnaires as a complementary assessment method, no such instruments have been validated for use in Brazilian Portuguese. Therefore, the aim of this study was to conduct the translation and validation of the Melbourne Decision Making Questionnaire (MDMQ) for use in a Brazilian population. Methods: The adaptation of the MDMQ involved the following steps: translation, back-translation, expert review and pilot study. These steps were followed by factor analysis and internal consistency measurements, which led to the exclusion of 4 items from the scale. The 18-item version of the MDMQ was then administered to a validation sample consisting of healthy adults, as well as patients with bipolar disorder (BD) and major depressive disorder (MDD). Results: The instrument displayed good internal consistency, with the hypervigilance subscale showing the lowest, though still acceptable, Cronbach's alpha value. Its factor structure was comparable to that of the original MDMQ according to confirmatory factor analysis. Nevertheless, the MDMQ was sensitive to both depression severity and the presence of MDD and BD, both of which are known to have an impact on DM ability. Conclusion: The version of the MDMQ produced in the present study may be an important addition to neuropsychological assessment batteries with a focus on DM and related abilities


2010 ◽  
Vol 4 (4) ◽  
pp. 268-276 ◽  
Author(s):  
Benito Pereira Damasceno

Abstract Research on cognitive disorders is challenging due to the complexity of functions studied and to the numerous variables involved. First, the concept of cognition as a mediated (semiotic) and systemic activity is reviewed. According to this concept, the result of a local lesion is not an isolated symptom but a syndrome, and the best neuropsychological approach is an analysis based on appropriate tests to disclose double dissociations and thereby provide clues to brain-behavior relationships. This approach takes into account the influence of task-relevant variables (confounders) related to the patient (e.g., age, education), to the lesion (size, etiology), and to the tests and testing conditions (ecological validity, examiner's experience), which need to be controlled and analyzed in multivariate statistical analyses, as illustrated in research on medial temporal lobe epilepsy. Other controversial issues such as single and double dissociations, single-case versus group studies, and the lesion method are also examined.


2019 ◽  
Vol 3 (Supplement_1) ◽  
pp. S938-S939
Author(s):  
Alicia G Carmichael ◽  
Maren Wisniewski ◽  
Karen Nielsen ◽  
Natalie M Leonard ◽  
Marianthie Wank ◽  
...  

Abstract Homelike research spaces provide a unique context for studying older adulthood by blurring the boundaries between the participant’s own home and traditional laboratories. Such intermediary spaces hold promise for developing measures of functional performance with increased ecological validity. While “home labs” are becoming more accessible at institutions around the world, the research design process in these spaces contains hidden challenges that can be a barrier to entry for the uninitiated. We identify and reflect on these challenges through the lens of a recent protocol built to assess upper-body performance among older adults during activities of daily living. The U-M HomeLab served as a proving ground for four example tasks: opening a water bottle, sorting pills, tying an apron, and hanging laundry. The evolution of each task is traced through ideation, testing, and refinement, culminating in a pilot among nine community-dwelling volunteers aged 61 to 72 with upper-body pain. Based on this experience, we recommend that designers of naturalistic tasks in homelike environments give special consideration to (1) feasibility, (2) scorability, and (3) safety while carefully balancing standardization against verisimilitude. In turn, each of these elements must be grounded not only in the context of the facility itself but also in the population using that facility. Among older adults with upper body pain, considerations included remaining cognizant of fall risk, anticipating and capturing compensatory behaviors, tailoring task difficulty for a wide range of physical ability, and accounting for the impact of historically gendered divisions of labor on task performance.


Assessment ◽  
1996 ◽  
Vol 3 (4) ◽  
pp. 443-448 ◽  
Author(s):  
Deborah C. Koltai ◽  
Rosemarie M. Bowler ◽  
Rosemarie M. Bowler

Investigations questioning the ecological validity of standardized neuropsychological instruments have led to the development of tests that are purported to be relevant to everyday functioning. The present investigation examined the relationships of the Rivermead Behavioural Memory Test (RBMT) and the Wechsler Memory Scale-Revised (WMS-R) to estimates of everyday memory functioning, as measured by patient and relative ratings on the Everyday Memory Questionnaire (EMQ). The research participants consisted of a group allegedly exposed to neurotoxicants (n = 29), and a demographically similar comparison group ( n = 20). Results indicated that the two objective memory tests did not significantly differ in their relationships to estimates of everyday memory functioning, and that use of the tests together did not improve prediction of memory complaints over the use of one test alone. In addition, patient and relative ratings were highly correlated. These results are discussed within the context of the validity of patient and relative rating scales as estimates of everyday memory impairment.


2012 ◽  
Vol 31 (2) ◽  
pp. 157-170 ◽  
Author(s):  
William M. Randall ◽  
Nikki S. Rickard

The measurement of everyday music use remains a challenge for researchers, with many of the available methodologies limited by intrusiveness or lack of ecological validity. The Experience Sampling Method (ESM) addresses such limitations by assessing current subjective experience at various times throughout participants’ everyday functioning. The aim of the current project was to develop and trial a mobile ESM (m-ESM) capable of collecting event-related data during natural listening episodes. This methodology was designed to maintain a natural and familiar listening experience for participants, and to collect real-time data on personal music listening. An application (app) was created which utilized mobile-device technology, and allowed combination of experience sampling with a personal music player. Analyses were performed on trial data from 101 participants to determine the efficacy of the m-ESM. Results indicated that this methodology would maintain ecological validity and cause minimal intrusion into everyday activities of the listener. Questionnaires were answered immediately at the time of listening, minimizing the problem of retrospective recall biases. This innovative methodology allows for the collection of a wealth of listening data that will advance the accurate measurement of everyday, personal music listening.


Sign in / Sign up

Export Citation Format

Share Document