scholarly journals Multimodal immersive trail making-virtual reality paradigm to study cognitive-motor interactions

2021 ◽  
Vol 18 (1) ◽  
Author(s):  
Meir Plotnik ◽  
Oran Ben-Gal ◽  
Glen M. Doniger ◽  
Amihai Gottlieb ◽  
Yotam Bahat ◽  
...  
Keyword(s):  
Virtual Reality ◽  
Executive Function ◽  
Construct Validity ◽  
Repeated Measures ◽  
Discriminant Validity ◽  
Middle Aged ◽  
Retest Reliability ◽  
Pencil And Paper ◽  
Test Retest Reliability ◽  
Completion Times

Abstract Background Neuropsychological tests of executive function have limited real-world predictive and functional relevance. An emerging solution for this limitation is to adapt the tests for implementation in virtual reality (VR). We thus developed two VR-based versions of the classic Color-Trails Test (CTT), a well-validated pencil-and-paper executive function test assessing sustained (Trails A) and divided (Trails B) attention—one for a large-scale VR system (DOME-CTT) and the other for a portable head-mount display VR system (HMD-CTT). We then evaluated construct validity, test–retest reliability, and age-related discriminant validity of the VR-based versions and explored effects on motor function. Methods Healthy adults (n = 147) in three age groups (young: n = 50; middle-aged: n = 80; older: n = 17) participated. All participants were administered the original CTT, some completing the DOME-CTT (14 young, 29 middle-aged) and the rest completing the HMD-CTT. Primary outcomes were Trails A and B completion times (tA, tB). Spatiotemporal characteristics of upper-limb reaching movements during VR test performance were reconstructed from motion capture data. Statistics included correlations and repeated measures analysis of variance. Results Construct validity was substantiated by moderate correlations between the’gold standard’ pencil-and-paper CTT and the VR adaptations (DOME-CTT: tA 0.58, tB 0.71; HMD-CTT: tA 0.62, tB 0.69). VR versions showed relatively high test–retest reliability (intraclass correlation; VR: tA 0.60–0.75, tB 0.59–0.89; original: tA 0.75–0.85, tB 0.77–0.80) and discriminant validity (area under the curve; VR: tA 0.70–0.92, tB 0.71–0.92; original: tA 0.73–0.95, tB 0.77–0.95). VR completion times were longer than for the original pencil-and-paper test; completion times were longer with advanced age. Compared with Trails A, Trails B target-to-target VR hand trajectories were characterized by delayed, more erratic acceleration and deceleration, consistent with the greater executive function demands of divided vs. sustained attention; acceleration onset later for older participants. Conclusions The present study demonstrates the feasibility and validity of converting a neuropsychological test from two-dimensional pencil-and-paper to three-dimensional VR-based format while preserving core neuropsychological task features. Findings on the spatiotemporal morphology of motor planning/execution during the cognitive tasks may lead to multimodal analysis methods that enrich the ecological validity of VR-based neuropsychological testing, representing a novel paradigm for studying cognitive-motor interactions.

scholarly journals Multimodal immersive trail making – virtual reality paradigm to study cognitive-motor interactions

2020 ◽  
Author(s):  
Meir Plotnik ◽  
Oran Ben-Gal ◽  
Glen M. Doniger ◽  
Amihai Gottlieb ◽  
Yotam Bahat ◽  
...  
Keyword(s):  
Virtual Reality ◽  
Executive Function ◽  
Construct Validity ◽  
Repeated Measures ◽  
Discriminant Validity ◽  
Middle Aged ◽  
Retest Reliability ◽  
Pencil And Paper ◽  
Test Retest Reliability ◽  
Completion Times

ABSTRACTBackgroundNeuropsychological tests of executive function have limited real-world predictive and functional relevance. An emerging solution for this limitation is to adapt the tests for implementation in virtual reality (VR). We thus developed two VR-based versions of the classic Color-Trails Test (CTT), a well-validated pencil-and-paper executive function test assessing sustained (Trails A) and divided (Trails B) attention - one for a large-scale VR system (DOME-CTT) and the other for a portable head-mount display VR system (HMD-CTT). We then evaluated construct validity, test-retest reliability, and age-related discriminant validity of the VR-based versions and explored effects on motor function.MethodsHealthy adults (n=147) in three age groups (young: n=50; middle-aged: n=80; older: n=17) participated. All participants were administered the original CTT, some completing the DOME-CTT (14 young, 29 middle-aged) and the rest completing the HMD-CTT. Primary outcomes were Trails A and B completion times (tA, tB). Spatiotemporal characteristics of upper-limb reaching movements during VR test performance were reconstructed from motion capture data. Statistics included correlations and repeated measures analysis of variance.ResultsConstruct validity was substantiated by moderate correlations between the ‘gold standard’ pencil-and-paper CTT and the VR adaptations (DOME-CTT: tA 0.58, tB 0.71; HMD-CTT: tA 0.62, tB 0.69). VR versions showed relatively high test-retest reliability (intraclass correlation; VR: tA 0.60-0.75, tB 0.59-0.89; original: tA 0.75-0.85, tB 0.77-0.80) and discriminant validity (area under the curve; VR: tA 0.70-0.92, tB 0.71-0.92; original: tA 0.73-0.95, tB 0.77-0.95). VR completion times were longer than for the original pencil-and-paper test; completion times were longer with advanced age. Compared with Trails A, Trails B target-to-target VR hand trajectories were characterized by delayed, more erratic acceleration and deceleration, consistent with the greater executive function demands of divided vs. sustained attention; acceleration onset later for older participants.ConclusionsThe present study demonstrates the feasibility and validity of converting a neuropsychological test from two-dimensional pencil-and-paper to three-dimensional VR-based format while preserving core neuropsychological task features. Findings on the spatiotemporal morphology of motor planning/execution during the cognitive tasks may lead to multimodal analysis methods that enrich the ecological validity of VR-based neuropsychological testing, representing a novel paradigm for studying cognitive-motor interactions.

scholarly journals NIH Toolbox Cognitive Battery (NIHTB-CB): The NIHTB Pattern Comparison Processing Speed Test

2014 ◽  
Vol 20 (6) ◽  
pp. 630-641 ◽  
Author(s):  
Noelle E. Carlozzi ◽  
David S. Tulsky ◽  
Nancy D. Chiaravalloti ◽  
Jennifer L. Beaumont ◽  
Sandra Weintraub ◽  
...  
Keyword(s):  
Construct Validity ◽  
Processing Speed ◽  
Discriminant Validity ◽  
Composite Index ◽  
Good Test ◽  
Validation Data ◽  
Retest Reliability ◽  
Speed Test ◽  
Pattern Comparison ◽  
Test Retest Reliability

AbstractThe NIH Toolbox (NIHTB) Pattern Comparison Processing Speed Test was developed to assess processing speed within the NIHTB for the Assessment of Neurological Behavior and Function Cognition Battery (NIHTB-CB). This study highlights validation data collected in adults ages 18–85 on this measure and reports descriptive data, test–retest reliability, construct validity, and preliminary work creating a composite index of processing speed. Results indicated good test–retest reliability. There was also evidence for both convergent and discriminant validity; the Pattern Comparison Processing Speed Test demonstrated moderate significant correlations with other processing speed tests (i.e., WAIS-IV Coding, Symbol Search and Processing Speed Index), small significant correlations with measures of working memory (i.e., WAIS-IV Letter-Number Sequencing and PASAT), and non-significant correlations with a test of vocabulary comprehension (i.e., PPVT-IV). Finally, analyses comparing and combining scores on the NIHTB Pattern Comparison Processing Speed Test with other measures of simple reaction time from the NIHTB-CB indicated that a Processing Speed Composite score performed better than any test examined in isolation. The NIHTB Pattern Comparison Processing Speed Test exhibits several strengths: it is appropriate for use across the lifespan (ages, 3–85 years), it is short and easy to administer, and it has high construct validity. (JINS, 2014,20, 1–12)

scholarly journals Reliability and Construct Validity of Self-Report Questionnaires for Patients With Pelvic Girdle Pain

2012 ◽  
Vol 92 (1) ◽  
pp. 111-123 ◽  
Author(s):  
Margreth Grotle ◽  
Andrew M. Garratt ◽  
Hanne Krogstad Jenssen ◽  
Britt Stuge
Keyword(s):  
Construct Validity ◽  
Internal Consistency ◽  
Discriminant Validity ◽  
Pelvic Girdle ◽  
Self Report ◽  
Pelvic Girdle Pain ◽  
Consistency Test ◽  
Retest Reliability ◽  
Sf 36 ◽  
Test Retest Reliability

Background There is little evidence for the measurement properties of instruments commonly used for women with pelvic girdle pain. Objective The aim of this study was to examine the internal consistency, test-retest reliability, and construct validity of instruments used for women with pelvic girdle pain. Design This was a cross-sectional methodology study, including test-retest reliability assessment. Methods Women with pelvic girdle pain in pregnancy and after delivery participated in a postal survey that included the Pelvic Girdle Questionnaire (PGQ), Oswestry Disability Index (ODI), Disability Rating Index (DRI), Fear-Avoidance Beliefs Questionnaire (FABQ), Pain Catastrophizing Scale (PCS), and 8-item version of the Medical Outcomes Study 36-Item Short-Form Health Survey questionnaire (SF-36). Test-retest reliability was assessed with a random subsample 1 week later. Internal consistency was assessed with the Cronbach alpha, and test-retest reliability was assessed with the intraclass correlation coefficient (ICC) and minimal detectable change (MDC). Construct validity based on hypotheses was assessed by correlation analysis. Discriminant validity was assessed with the area under the receiver operating characteristic curve. Results All participants responded to the main (N=87) and test-retest (n=42) surveys. Cronbach alpha values ranged from .88 to .94, and ICCs ranged from .78 to .94. The MDC at the individual level constituted about 7% to 14% of total scores for the 8-item version of the SF-36, ODI, and PGQ activity subscale; about 18% to 22% for the DRI, PGQ symptom subscale, and PCS; and about 25% for the FABQ. Hypotheses were mostly confirmed by correlations between the instruments. The PGQ was the only instrument that significantly discriminated participants who were pregnant from participants who were not pregnant as well as pain locations. Limitations A comparison of responsiveness to change of the various instruments used in this study was not undertaken, but will be carried out in a future study. Conclusions Self-report instruments for assessing health showed good internal consistency, test-retest reliability, and construct validity for women with pelvic girdle pain. The PGQ was the only instrument with satisfactory discriminant validity, thus, it is recommended for evaluating symptoms and disability in patients with pelvic girdle pain.

scholarly journals Reliability and Structural and Construct Validity of the Functional Strength Measurement in Children Aged 4 to 10 Years

2016 ◽  
Vol 96 (6) ◽  
pp. 888-897 ◽  
Author(s):  
Wendy F.M. Aertssen ◽  
Gillian D. Ferguson ◽  
Bouwien C.M. Smits-Engelsman
Keyword(s):  
Factor Analysis ◽  
Muscle Strength ◽  
Construct Validity ◽  
Exploratory Factor Analysis ◽  
Convergent Validity ◽  
Discriminant Validity ◽  
Structural Validity ◽  
Strength Measurement ◽  
Retest Reliability ◽  
Test Retest Reliability

Background Adequate muscle strength, power, and endurance are important in children's daily activities and sports. Various instruments have been developed for the assessment of muscle function; each measures different aspects. The Functional Strength Measurement (FSM) was developed to measure performance in activities in which strength is required. Objective The study objective was to establish the test-retest reliability and structural and construct validity of the FSM. Design A cross-sectional descriptive study was conducted. Methods The performance of 474 children with typical development on the FSM was examined. Test-retest reliability (n=47) was calculated with the intraclass correlation coefficient (2.1A) for agreement. Structural validity was examined with exploratory factor analysis, and internal consistency was established with the Cronbach alpha. Construct validity was determined by calculating correlations between FSM scores and scores obtained with a handheld dynamometer (HHD) (n=252) (convergent validity) and between FSM scores and scores on the Movement Assessment Battery for Children–2 (MABC-2) (n=77) (discriminant validity). Results The test-retest reliability of the FSM total score ranged from .91 to .94. The structural validity revealed one dimension, containing all 8 FSM items. The Cronbach alpha was .74. The convergent validity with the HHD ranged from .42 to .74. The discriminant validity with MABC-2 items revealed correlations that were generally lower than .39, and most of the correlations were not significant. Exploratory factor analysis of a combined data set (FSM, HHD, and MABC-2; n=77) revealed 2 factors: muscle strength/power and muscle endurance with an agility component. Limitations Discriminant validity was measured only in children aged 4 to 6 years. Conclusions The FSM, a norm-referenced test for measuring functional strength in children aged 4 to 10 years, has good test-retest reliability and good construct validity.

scholarly journals Psychometric properties of the perceived stress scale (PSS): measurement invariance between athletes and non-athletes and construct validity

2016 ◽  
Author(s):  
Yi-Hsiang Chiu ◽  
Frank Jing-Horng Lu ◽  
Ju-Han Lin ◽  
Chiao-Lin Nien ◽  
Ya-Wen Hsu ◽  
...  
Keyword(s):  
Construct Validity ◽  
Measurement Invariance ◽  
Perceived Stress ◽  
Convergent Validity ◽  
Student Athletes ◽  
Discriminant Validity ◽  
Perceived Stress Scale ◽  
Retest Reliability ◽  
Stress Scale ◽  
Test Retest Reliability

Background: Although Perceived Stress Scale (PSS, Cohen, Kamarack, Mermelstein, 1983) has been validated and widely used in many domains, there is still no validation in sports by comparing athletes and non-athletes and examining related psychometric indices. Purpose: The purpose of this study was to examine the measurement invariance of PSS between athletes and non-athletes, and examine construct validity and reliability in the sports contexts. Methods: Study 1 sampled 359 college student-athletes (males = 233; females = 126) and 242 non-athletes (males=124; females=118) and examined factorial structure, measurement invariance and internal consistency. Study 2 sampled 196 student-athletes (males = 139, females = 57, Mage =19.88 yrs, SD = 1.35) and examined discriminant validity and convergent validity of PSS. Study 3 sampled 37 student-athletes to assess test-retest reliability of PSS. Results: Results found that 2-factor PSS-10 fitted the model the best and had appropriate reliability. Also, there was a measurement invariance between athletes and non-athletes; and PSS positively correlated with athletic burnout and life stress but negatively correlated with coping efficacy provided evidence of discriminant validity and convergent validity. Further, the test-retest reliability for PSS subscales was significant (r=.66 and r=.50). Discussion: It is suggested that 2-factor PSS-10 can be a useful tool in assessing perceived stress either in sports or non-sports settings. We suggest future study may use 2-factor PSS-10 in examining the effects of stress on the athletic injury, burnout, and psychiatry disorders.

scholarly journals Psychometric properties of the Perceived Stress Scale (PSS): measurement invariance between athletes and non-athletes and construct validity

PeerJ ◽  
2016 ◽  
Vol 4 ◽  
pp. e2790 ◽  
Author(s):  
Yi-Hsiang Chiu ◽  
Frank Jing-Horng Lu ◽  
Ju-Han Lin ◽  
Chiao-Lin Nien ◽  
Ya-Wen Hsu ◽  
...  
Keyword(s):  
Construct Validity ◽  
Measurement Invariance ◽  
Perceived Stress ◽  
Convergent Validity ◽  
Student Athletes ◽  
Discriminant Validity ◽  
Perceived Stress Scale ◽  
Retest Reliability ◽  
Stress Scale ◽  
Test Retest Reliability

BackgroundAlthough Perceived Stress Scale (PSS, Cohen, Kamarack & Mermelstein, 1983) has been validated and widely used in many domains, there is still no validation in sports by comparing athletes and non-athletes and examining related psychometric indices.PurposeThe purpose of this study was to examine the measurement invariance of PSS between athletes and non-athletes, and examine construct validity and reliability in the sports contexts.MethodsStudy 1 sampled 359 college student-athletes (males = 233; females = 126) and 242 non-athletes (males = 124; females = 118) and examined factorial structure, measurement invariance and internal consistency. Study 2 sampled 196 student-athletes (males = 139, females = 57,Mage = 19.88 yrs, SD = 1.35) and examined discriminant validity and convergent validity of PSS. Study 3 sampled 37 student-athletes to assess test-retest reliability of PSS.ResultsResults found that 2-factor PSS-10 fitted the model the best and had appropriate reliability. Also, there was a measurement invariance between athletes and non-athletes; and PSS positively correlated with athletic burnout and life stress but negatively correlated with coping efficacy provided evidence of discriminant validity and convergent validity. Further, the test-retest reliability for PSS subscales was significant (r = .66 andr = .50).DiscussionIt is suggested that 2-factor PSS-10 can be a useful tool in assessing perceived stress either in sports or non-sports settings. We suggest future study may use 2-factor PSS-10 in examining the effects of stress on the athletic injury, burnout, and psychiatry disorders.

The Dance Functional Outcome Survey (DFOS) is Reliable, Valid, and Responsive in Pediatric Dancers

2021 ◽  
Vol 25 (1) ◽  
pp. 9-17
Author(s):  
Teresa Smith ◽  
Alyson Filipa ◽  
Samantha Riveron ◽  
Melissa Strzelinski ◽  
Mark Paterno ◽  
...  
Keyword(s):  
Construct Validity ◽  
Functional Outcome ◽  
Internal Consistency ◽  
Repeated Measures ◽  
Correlation Coefficients ◽  
Cronbach’S Alpha ◽  
Retest Reliability ◽  
Cronbach's Alpha ◽  
Test Retest Reliability ◽  
Responsiveness To Change

The Dance Functional Outcome Survey (DFOS) is a dance-specific questionnaire developed for use with ballet and modern dancers at all training levels. To date, no study has assessed the psychometric properties of the DFOS in pediatric dancers. The purposes of this study were to determine: 1. the reliability of the DFOS when used with healthy and injured pediatric dancers; 2. the validity of the DFOS com- pared to a well-established generic scale, the Pediatric Quality of Life Inventory Physical Function Scale (PedsQL-PFS); and 3. the sensitivity and responsiveness to change of the DFOS in injured dancers. One hundred and two dancers completed the DFOS twice within 10 days. Intra-class correlation coefficients (ICCs) were used to assess test-retest reliability. In a sample of 148 dancers, construct validity was explored by comparing the DFOS to the PedsQL-PFS using Pearson correlations, and Exploratory Factor Analysis (EFA) and Cronbach's alpha were used for internal consistency analyses. A sub-set of 22 injured dancers was employed to examine responsiveness using repeated measures analysis of variance (p < 0.05). The DFOS demonstrated high test-retest reliability (ICC ≥ 0.90). The DFOS total score, activities of daily living (ADL), and dance technique sub-scores had strong construct validity compared to the PedsQL-PFS (r ≥ 0.79). Cronbach's alpha was high ( α = 0.92), indicating excellent internal consistency. There were significant differences across time in DFOS scores (p < 0.001), demonstrating responsiveness to change. There were no floor or ceiling effects. Thus, the DFOS demonstrates excellent reliability, strong validity, and good responsiveness over time and is a viable tool for assessing function in pediatric dancers.

scholarly journals Psychometric properties of the perceived stress scale (PSS): measurement invariance between athletes and non-athletes and construct validity

2016 ◽  
Author(s):  
Yi-Hsiang Chiu ◽  
Frank Jing-Horng Lu ◽  
Ju-Han Lin ◽  
Chiao-Lin Nien ◽  
Ya-Wen Hsu ◽  
...  
Keyword(s):  
Construct Validity ◽  
Measurement Invariance ◽  
Perceived Stress ◽  
Convergent Validity ◽  
Student Athletes ◽  
Discriminant Validity ◽  
Perceived Stress Scale ◽  
Retest Reliability ◽  
Stress Scale ◽  
Test Retest Reliability

Background: Although Perceived Stress Scale (PSS, Cohen, Kamarack, Mermelstein, 1983) has been validated and widely used in many domains, there is still no validation in sports by comparing athletes and non-athletes and examining related psychometric indices. Purpose: The purpose of this study was to examine the measurement invariance of PSS between athletes and non-athletes, and examine construct validity and reliability in the sports contexts. Methods: Study 1 sampled 359 college student-athletes (males = 233; females = 126) and 242 non-athletes (males=124; females=118) and examined factorial structure, measurement invariance and internal consistency. Study 2 sampled 196 student-athletes (males = 139, females = 57, Mage =19.88 yrs, SD = 1.35) and examined discriminant validity and convergent validity of PSS. Study 3 sampled 37 student-athletes to assess test-retest reliability of PSS. Results: Results found that 2-factor PSS-10 fitted the model the best and had appropriate reliability. Also, there was a measurement invariance between athletes and non-athletes; and PSS positively correlated with athletic burnout and life stress but negatively correlated with coping efficacy provided evidence of discriminant validity and convergent validity. Further, the test-retest reliability for PSS subscales was significant (r=.66 and r=.50). Discussion: It is suggested that 2-factor PSS-10 can be a useful tool in assessing perceived stress either in sports or non-sports settings. We suggest future study may use 2-factor PSS-10 in examining the effects of stress on the athletic injury, burnout, and psychiatry disorders.

Development and Evaluation of an Ecological Task to Assess Executive Functioning Post Childhood TBI: The Children's Cooking Task

2010 ◽  
Vol 11 (2) ◽  
pp. 125-143 ◽  
Author(s):  
Mathilde P. Chevignard ◽  
Cathy Catroppa ◽  
Jane Galvin ◽  
Vicki Anderson
Keyword(s):  
Executive Function ◽  
Executive Functioning ◽  
Executive Functions ◽  
Concurrent Validity ◽  
Discriminant Validity ◽  
Ecological Validity ◽  
Retest Reliability ◽  
Behavior Rating Inventory ◽  
Severe Tbi ◽  
Test Retest Reliability

AbstractPurpose:Traumatic brain injury (TBI) often leads to executive functions deficits, which may be responsible for severe and longstanding disabilities in everyday activities. Sensitivity and ecological validity of neuropsychological tests of executive functions have been questioned. The aims of this study were to pilot an ecological open-ended assessment of executive functions in children, the ‘Children's Cooking Task’ (CCT), specifically to report its reliability, discriminant validity and concurrent validity.Methods:Twenty-five children with mild (n= 10) or moderate-to-severe TBI (n= 15), and 21 matched controls (aged 8 to 20 years) participated in the study. An open-ended cooking task was designed to test multi-tasking abilities. It required the preparation of two simple recipes using specific instructions. Outcome measures included the number of errors and an overall qualitative analysis of the task. Validating measures of executive functions included the Delis Kaplan Executive Function System, the Six-Part Test and two questionnaires completed by the child's primary care-giver: the Behavior Rating Inventory of Executive Function and the Dysexecutive Questionnaire for Children.Results:Internal consistency of the Children's Cooking Task was high (Cronbach's alpha = .86), as was test–retest reliability (ICC = .89). Children with moderate-to-severe TBI, as well as children with mild TBI made significantly more errors in the Children's Cooking Task in comparison to controls (p< .001). The CCT was correlated with several tests and one questionnaire of executive functioning (Trails, verbal fluency, sorting, 20 questions, Dysexecutive Questionnaire).Discussion and Conclusion:The Children's Cooking Task has good interrater and test–retest reliability, as well as good discriminant and concurrent validity.

Sign in / Sign up

Export Citation Format

Share Document