Assessment-2The Evolution of Ecological Validity within Neuropsychological Executive Function Measures

AbstractExecutive functions refer to a constellation of higher-level cognitive abilities that enable goal-oriented behavior. The NIH EXAMINER battery was designed to assess executive functions comprehensively and efficiently. Performance can be summarized by a single score, the “Executive Composite,” which combines measures of inhibition, set-shifting, fluency, and working memory. We evaluated the ecological validity of the Executive Composite in a sample of 225 mixed neurological patients and controls using the Frontal Systems Behavior Scale (FrSBe), an informant-based measure of real-world executive behavior. In addition, we investigated the neuroanatomical correlates of the Executive Composite using voxel-based morphometry in a sample of 37 participants diagnosed with dementia, mild cognitive impairment, or as neurologically healthy. The Executive Composite accounted for 28% of the variance in Frontal Systems Behavior Scale scores beyond age. Even after including two widely used executive function tests (Trails B and Stroop) as covariates, the Executive Composite remained a significant predictor of real-world behavior. Anatomically, poorer scores on the Executive Composite were associated with smaller right and left dorsolateral prefrontal volumes, brain regions critical for good executive control. Taken together, these results suggest that the Executive Composite measures important aspects of executive function not captured by standard measures and reflects the integrity of frontal systems. (JINS, 2013,19, 1–9)

Download Full-text

The ecological validity of tests of executive function

Journal of the International Neuropsychological Society ◽

10.1017/s1355617798466037 ◽

1998 ◽

Vol 4 (6) ◽

pp. 547-558 ◽

Cited By ~ 452

Author(s):

PAUL W. BURGESS ◽

NICK ALDERMAN ◽

JON EVANS ◽

HAZEL EMSLIE ◽

BARBARA A. WILSON

Keyword(s):

Executive Function ◽

Everyday Life ◽

Cognitive Processes ◽

Cognitive Deficits ◽

Neuropsychological Tests ◽

Ecological Validity ◽

Neuropsychological Measures ◽

Life Problems ◽

Neurological Patients ◽

Validity Of Tests

Ninety-two mixed etiology neurological patients and 216 control participants were assessed on a range of neuropsychological tests, including 10 neuropsychological measures of executive function derived from 6 different tests. People who knew the patients well (relatives or carers) completed a questionnaire about the patient's dysexecutive problems in everyday life, and this paper reports the extent to which the tests predicted the patients' everyday life problems. All of the tests were significantly predictive of at least some of the behavioral and cognitive deficits reported by patients' carers. However, factor analysis of the patients' dysexecutive symptoms suggested a fractionation of the dysexecutive syndrome, with neuropsychological tests loading differentially on 3 underlying cognitive factors (Inhibition, Intentionality, and Executive Memory), supporting the conclusions that different tests measure different cognitive processes, and that there may be limits to the fractionation of the executive system. (JINS, 1998, 4, 547–558.)

Download Full-text

Ecological validity of executive function tests in moderate traumatic brain injury in Ghana

The Clinical Neuropsychologist ◽

10.1080/13854046.2016.1172667 ◽

2016 ◽

Vol 30 (sup1) ◽

pp. 1517-1537 ◽

Cited By ~ 7

Author(s):

Samuel Adjorlolo

Keyword(s):

Traumatic Brain Injury ◽

Executive Function ◽

Brain Injury ◽

Ecological Validity ◽

Function Tests ◽

Moderate Traumatic Brain Injury

Download Full-text

The ecological validity of the behavior rating inventory of executive function (BRIEF) in attention deficit hyperactivity disorder: predicting academic achievement and social adaptive behavior in the subtypes of ADHD

10.17918/etd-845 ◽

2021 ◽

Author(s):

Marcos Di Pinto

Keyword(s):

Academic Achievement ◽

Attention Deficit Hyperactivity Disorder ◽

Executive Function ◽

Adaptive Behavior ◽

Attention Deficit ◽

Ecological Validity ◽

Behavior Rating ◽

Hyperactivity Disorder ◽

Behavior Rating Inventory

Download Full-text

Fifty Years of Prefrontal Cortex Research: Impact on Assessment

Journal of the International Neuropsychological Society ◽

10.1017/s1355617717000704 ◽

2017 ◽

Vol 23 (9-10) ◽

pp. 755-767 ◽

Cited By ~ 20

Author(s):

Paul W. Burgess ◽

Donald T. Stuss

Keyword(s):

Prefrontal Cortex ◽

Executive Function ◽

Functional Neuroimaging ◽

Ecological Validity ◽

Research Impact ◽

Brain Regions ◽

Human Cognition ◽

Assessment Practice ◽

Theoretical Frameworks ◽

The Impact

AbstractOur knowledge of the functions of the prefrontal cortex, often called executive, supervisory, or control, has been transformed over the past 50 years. After operationally defining terms for clarification, we review the impact of advances in functional, structural, and theoretical levels of understanding upon neuropsychological assessment practice as a means of identifying 11 principles/challenges relating to assessment of executive function. Three of these were already known 50 years ago, and 8 have been confirmed or emerged since. Key themes over this period have been the emergence of the use of naturalistic tests to address issues of “ecological validity”; discovery of the complexity of the frontal lobe control system; invention of new tests for clinical use; development of key theoretical frameworks that address the issue of the role of prefrontal cortex systems in the organization of human cognition; the move toward considering brain systems rather than brain regions; the advent of functional neuroimaging, and its emerging integration into clinical practice. Despite these huge advances, however, practicing neuropsychologists are still desperately in need of new ways of measuring executive function. We discuss pathways by which this might happen, including decoupling the two levels of explanation (information processing; brain structure) and integrating very recent technological advances into the neuropsychologist’s toolbox. (JINS, 2017,23, 755–767)

Download Full-text

Poster 83: Further Exploration of the Ecological Validity of Tests of Executive Function

Archives of Physical Medicine and Rehabilitation ◽

10.1016/j.apmr.2008.08.186 ◽

2008 ◽

Vol 89 (10) ◽

pp. e49

Author(s):

Melanie Andre ◽

Nicole Anderson ◽

Donald Stuss ◽

Deirdre Dawson

Keyword(s):

Executive Function ◽

Ecological Validity ◽

Validity Of Tests

Download Full-text

Preliminary Psychometrics for the Executive Function Challenge Task: A Novel, “Hot” Flexibility, and Planning Task for Youth

Journal of the International Neuropsychological Society ◽

10.1017/s135561772000017x ◽

2020 ◽

Vol 26 (7) ◽

pp. 725-732

Author(s):

Lauren Kenworthy ◽

Andrew Freeman ◽

Allison Ratto ◽

Katerina Dudley ◽

Kelly K. Powell ◽

...

Keyword(s):

Executive Function ◽

Ecological Validity ◽

Developmentally Appropriate ◽

Reliability And Validity ◽

Objective Measure ◽

Autism Spectrum ◽

Structure Reliability ◽

Appropriate Treatment ◽

Standardized Treatment ◽

Traditional Performance

AbstractObjective:Executive functions (EF) drive health and educational outcomes and therefore are increasingly common treatment targets. Most treatment trials rely on questionnaires to capture meaningful change because ecologically valid, pediatric performance-based EF tasks are lacking. The Executive Function Challenge Task (EFCT) is a standardized, treatment-sensitive, objective measure which assesses flexibility and planning in the context of provocative social interactions, making it a “hot” EF task.Method:We investigate the structure, reliability, and validity of the EFCT in youth with autism (Autism Spectrum Disorder; n = 129), or attention deficit hyperactivity disorder with flexibility problems (n = 93), and typically developing (TD; n = 52) youth.Results:The EFCT can be coded reliably, has a two-factor structure (flexibility and planning), and adequate internal consistency and consistency across forms. Unlike a traditional performance-based EF task (verbal fluency), it shows significant correlations with parent-reported EF, indicating ecological validity. EFCT performance distinguishes youth with known EF problems from TD youth and is not significantly related to visual pattern recognition, or social communication/understanding in autistic children.Conclusions:The EFCT demonstrates adequate reliability and validity and may provide developmentally appropriate, treatment-sensitive, and ecologically valid assessment of “hot” EF in youth. It can be administered in controlled settings by masked administrators.

Download Full-text