Development and Evaluation of an Ecological Task to Assess Executive Functioning Post Childhood TBI: The Children's Cooking Task

AbstractPurpose:Traumatic brain injury (TBI) often leads to executive functions deficits, which may be responsible for severe and longstanding disabilities in everyday activities. Sensitivity and ecological validity of neuropsychological tests of executive functions have been questioned. The aims of this study were to pilot an ecological open-ended assessment of executive functions in children, the ‘Children's Cooking Task’ (CCT), specifically to report its reliability, discriminant validity and concurrent validity.Methods:Twenty-five children with mild (n= 10) or moderate-to-severe TBI (n= 15), and 21 matched controls (aged 8 to 20 years) participated in the study. An open-ended cooking task was designed to test multi-tasking abilities. It required the preparation of two simple recipes using specific instructions. Outcome measures included the number of errors and an overall qualitative analysis of the task. Validating measures of executive functions included the Delis Kaplan Executive Function System, the Six-Part Test and two questionnaires completed by the child's primary care-giver: the Behavior Rating Inventory of Executive Function and the Dysexecutive Questionnaire for Children.Results:Internal consistency of the Children's Cooking Task was high (Cronbach's alpha = .86), as was test–retest reliability (ICC = .89). Children with moderate-to-severe TBI, as well as children with mild TBI made significantly more errors in the Children's Cooking Task in comparison to controls (p< .001). The CCT was correlated with several tests and one questionnaire of executive functioning (Trails, verbal fluency, sorting, 20 questions, Dysexecutive Questionnaire).Discussion and Conclusion:The Children's Cooking Task has good interrater and test–retest reliability, as well as good discriminant and concurrent validity.

Download Full-text

Addicted to Exercise

European Journal of Psychological Assessment ◽

10.1027/1015-5759/a000084 ◽

2012 ◽

Vol 28 (1) ◽

pp. 3-10 ◽

Cited By ~ 9

Author(s):

Irini S. Parastatidou ◽

Georgios Doganis ◽

Yannis Theodorakis ◽

Symeon P. Vlachopoulos

Keyword(s):

Internal Consistency ◽

Concurrent Validity ◽

Discriminant Validity ◽

Factor Model ◽

Validity And Reliability ◽

Retest Reliability ◽

Confirmatory Factor ◽

Initial Support ◽

Dependence Scale ◽

Test Retest Reliability

The study examines the factor structure, internal consistency, concurrent and discriminant validity, and test-retest reliability of the Exercise Dependence Scale-Revised scores (EDS-R: Symons-Downs, Hausenblas, & Niggs, 2004 ) in a sample of Greek exercise participants. The Greek translation of the EDS-R was completed by 581 exercise participants along with measures of exercise addiction. Confirmatory factor analysis provided support for the hypothesized EDS-R correlated 7-factor model along with evidence for strong item loadings and factor discriminant validity. Further evidence emerged in favor of the internal consistency, concurrent validity, and test-retest reliability of the translated EDS-R scores. The results provide initial support for various aspects of the validity and reliability of the translated-into-Greek EDS-R scores.

Download Full-text

Multimodal immersive trail making – virtual reality paradigm to study cognitive-motor interactions

10.1101/2020.05.27.118760 ◽

2020 ◽

Author(s):

Meir Plotnik ◽

Oran Ben-Gal ◽

Glen M. Doniger ◽

Amihai Gottlieb ◽

Yotam Bahat ◽

...

Keyword(s):

Virtual Reality ◽

Executive Function ◽

Construct Validity ◽

Repeated Measures ◽

Discriminant Validity ◽

Middle Aged ◽

Retest Reliability ◽

Pencil And Paper ◽

Test Retest Reliability ◽

Completion Times

ABSTRACTBackgroundNeuropsychological tests of executive function have limited real-world predictive and functional relevance. An emerging solution for this limitation is to adapt the tests for implementation in virtual reality (VR). We thus developed two VR-based versions of the classic Color-Trails Test (CTT), a well-validated pencil-and-paper executive function test assessing sustained (Trails A) and divided (Trails B) attention - one for a large-scale VR system (DOME-CTT) and the other for a portable head-mount display VR system (HMD-CTT). We then evaluated construct validity, test-retest reliability, and age-related discriminant validity of the VR-based versions and explored effects on motor function.MethodsHealthy adults (n=147) in three age groups (young: n=50; middle-aged: n=80; older: n=17) participated. All participants were administered the original CTT, some completing the DOME-CTT (14 young, 29 middle-aged) and the rest completing the HMD-CTT. Primary outcomes were Trails A and B completion times (tA, tB). Spatiotemporal characteristics of upper-limb reaching movements during VR test performance were reconstructed from motion capture data. Statistics included correlations and repeated measures analysis of variance.ResultsConstruct validity was substantiated by moderate correlations between the ‘gold standard’ pencil-and-paper CTT and the VR adaptations (DOME-CTT: tA 0.58, tB 0.71; HMD-CTT: tA 0.62, tB 0.69). VR versions showed relatively high test-retest reliability (intraclass correlation; VR: tA 0.60-0.75, tB 0.59-0.89; original: tA 0.75-0.85, tB 0.77-0.80) and discriminant validity (area under the curve; VR: tA 0.70-0.92, tB 0.71-0.92; original: tA 0.73-0.95, tB 0.77-0.95). VR completion times were longer than for the original pencil-and-paper test; completion times were longer with advanced age. Compared with Trails A, Trails B target-to-target VR hand trajectories were characterized by delayed, more erratic acceleration and deceleration, consistent with the greater executive function demands of divided vs. sustained attention; acceleration onset later for older participants.ConclusionsThe present study demonstrates the feasibility and validity of converting a neuropsychological test from two-dimensional pencil-and-paper to three-dimensional VR-based format while preserving core neuropsychological task features. Findings on the spatiotemporal morphology of motor planning/execution during the cognitive tasks may lead to multimodal analysis methods that enrich the ecological validity of VR-based neuropsychological testing, representing a novel paradigm for studying cognitive-motor interactions.

Download Full-text

A New Measurement of Activities of Daily Living for Thai Elderly With Dementia

International Psychogeriatrics ◽

10.1017/s1041610203008822 ◽

2003 ◽

Vol 15 (2) ◽

pp. 135-148 ◽

Cited By ~ 11

Author(s):

Vorapun Senanarong ◽

Kamolthip Harnphadungkit ◽

Naraporn Prayoonwiwat ◽

Niphon Poungvarin ◽

Nopwan Sivasariyanonds ◽

...

Keyword(s):

Activities Of Daily Living ◽

Barthel Index ◽

Concurrent Validity ◽

Daily Living ◽

Discriminant Validity ◽

High Reliability ◽

Intraclass Correlation ◽

Retest Reliability ◽

Medicine Physician ◽

Test Retest Reliability

Background: Activities of daily living (ADL) vary across cultures, and measure of ADL needs to be specific to the population under study. We developed an ADL measure for Thai elderly with dementia and investigated the reliability and validity of this instrument. Materials and Methods: Item construction was accomplished with a panel of neurologists and a rehabilitation medicine physician. One hundred eighty-one subjects were interviewed using the Thai ADL measure. Of this sample, one hundred fifty-nine had dementia according to the Diagnosic and Statistical Manual of Mental Disorders, fourth edition criteria. These data were analyzed for internal consistency; concurrent validity was determined by comparison with the Barthel Index, Functional Assessment Questionnaire (FAQ), Thai Mental State Exam (TMSE), and Clinical Dementia Rating (CDR) scale; and discriminant validity was determined by comparison with the Neuropsychiatric Inventory (NPI). Thirty subjects were tested to determine interrater and test-retest reliability. Results: Thai ADL measure was composed of six basic ADL and seven instrumental ADL. It had high correlation with TMSE scores (r = −.69), CDR scores (r = .81), Barthel Index scores (r = −.08), and FAQ scores (r = .88), and moderate correlation with NPI scores (r = .46). The instrument had high test-retest reliability (intraclass correlation coefficient [ICC] = .92, .89) and high interrater reliability (ICC = .96, .93). Conclusion: The Thai ADL scale is easy to use and it has high reliability. It had high concurrent validity with previously published ADL scales. The methodology used to develop the Thai ADL scale can provide a model for creating culturally competent ADL scales.

Download Full-text

Catch the ruler: concurrent validity and test–retest reliability of the ReacStick measures of reaction time and inhibitory executive function in older people

Aging Clinical and Experimental Research ◽

10.1007/s40520-018-1050-6 ◽

2018 ◽

Vol 31 (8) ◽

pp. 1147-1154 ◽

Cited By ~ 4

Author(s):

Kimberley S. van Schooten ◽

Lionne Duran ◽

Maike Visschedijk ◽

Mirjam Pijnappels ◽

Stephen R. Lord ◽

...

Keyword(s):

Executive Function ◽

Reaction Time ◽

Older People ◽

Concurrent Validity ◽

Retest Reliability ◽

Test Retest Reliability

Download Full-text

Further Support for the Psychometric Properties of the Farsi Version of Perth Alexithymia Questionnaire

Frontiers in Psychology ◽

10.3389/fpsyg.2021.657660 ◽

2021 ◽

Vol 12 ◽

Author(s):

Arezou Lashkari ◽

Mohsen Dehghani ◽

Vahid Sadeghi-Firoozabadi ◽

Mahmood Heidari ◽

Ali Khatibi

Keyword(s):

Psychometric Properties ◽

Internal Consistency ◽

Concurrent Validity ◽

Discriminant Validity ◽

Factor Model ◽

Five Factor Model ◽

Retest Reliability ◽

Good Internal Consistency ◽

Test Retest Reliability ◽

Farsi Version

Alexithymia is defined as the lack of words to describe emotions and is associated with different psychopathologies. Various tools have been developed for measuring alexithymia; each has its limitations. A new questionnaire, Perth Alexithymia Questionnaire (PAQ), was developed to simultaneously assess positive and negative dimensions. Validation of such a tool in different cultures allows cross-cultural health psychology studies and facilitates knowledge transfer in the field. We aimed to examine the psychometric features of the PAQ in the Farsi-speaking population in Iran. Four-hundred-twenty-nine university students were asked to complete the PAQ, the Toronto Alexithymia Scale (TAS-20), Beck Depression Inventory (BDI-II), Beck Anxiety Inventory (BAI), and emotion regulation questionnaire (ERQ). Concurrent validity, discriminant validity, internal consistency, and test-retest reliability and factor structure were investigated. Confirmatory factor analysis showed a five-factor model identical to the original questionnaire. The questionnaire indicated good internal consistency (0.82 < α < 0.94). Test-retest reliability was acceptable for all subscales. The correlations between PAQ and its subscales with BDI-II, BAI, and TAS, and expression suppression subscale of ERQ were strong for concurrent validity. Concerning the discriminant validity, PAQ and its subscales were not correlated with reappraisal subscales of ERQ. The present findings suggest that the Farsi version of PAQ has strong psychometric properties and is appropriate for use in the Farsi-speaking population.

Download Full-text

Multimodal immersive trail making-virtual reality paradigm to study cognitive-motor interactions

Journal of NeuroEngineering and Rehabilitation ◽

10.1186/s12984-021-00849-9 ◽

2021 ◽

Vol 18 (1) ◽

Author(s):

Meir Plotnik ◽

Oran Ben-Gal ◽

Glen M. Doniger ◽

Amihai Gottlieb ◽

Yotam Bahat ◽

...

Keyword(s):

Virtual Reality ◽

Executive Function ◽

Construct Validity ◽

Repeated Measures ◽

Discriminant Validity ◽

Middle Aged ◽

Retest Reliability ◽

Pencil And Paper ◽

Test Retest Reliability ◽

Completion Times

Abstract Background Neuropsychological tests of executive function have limited real-world predictive and functional relevance. An emerging solution for this limitation is to adapt the tests for implementation in virtual reality (VR). We thus developed two VR-based versions of the classic Color-Trails Test (CTT), a well-validated pencil-and-paper executive function test assessing sustained (Trails A) and divided (Trails B) attention—one for a large-scale VR system (DOME-CTT) and the other for a portable head-mount display VR system (HMD-CTT). We then evaluated construct validity, test–retest reliability, and age-related discriminant validity of the VR-based versions and explored effects on motor function. Methods Healthy adults (n = 147) in three age groups (young: n = 50; middle-aged: n = 80; older: n = 17) participated. All participants were administered the original CTT, some completing the DOME-CTT (14 young, 29 middle-aged) and the rest completing the HMD-CTT. Primary outcomes were Trails A and B completion times (tA, tB). Spatiotemporal characteristics of upper-limb reaching movements during VR test performance were reconstructed from motion capture data. Statistics included correlations and repeated measures analysis of variance. Results Construct validity was substantiated by moderate correlations between the’gold standard’ pencil-and-paper CTT and the VR adaptations (DOME-CTT: tA 0.58, tB 0.71; HMD-CTT: tA 0.62, tB 0.69). VR versions showed relatively high test–retest reliability (intraclass correlation; VR: tA 0.60–0.75, tB 0.59–0.89; original: tA 0.75–0.85, tB 0.77–0.80) and discriminant validity (area under the curve; VR: tA 0.70–0.92, tB 0.71–0.92; original: tA 0.73–0.95, tB 0.77–0.95). VR completion times were longer than for the original pencil-and-paper test; completion times were longer with advanced age. Compared with Trails A, Trails B target-to-target VR hand trajectories were characterized by delayed, more erratic acceleration and deceleration, consistent with the greater executive function demands of divided vs. sustained attention; acceleration onset later for older participants. Conclusions The present study demonstrates the feasibility and validity of converting a neuropsychological test from two-dimensional pencil-and-paper to three-dimensional VR-based format while preserving core neuropsychological task features. Findings on the spatiotemporal morphology of motor planning/execution during the cognitive tasks may lead to multimodal analysis methods that enrich the ecological validity of VR-based neuropsychological testing, representing a novel paradigm for studying cognitive-motor interactions.

Download Full-text

Psychometric properties of the critical thinking disposition assessment test amongst medical students in China: a cross-sectional study

BMC Medical Education ◽

10.1186/s12909-020-02437-2 ◽

2021 ◽

Vol 21 (1) ◽

Author(s):

Liyuan Cui ◽

Yaxin Zhu ◽

Jinglou Qu ◽

Liming Tie ◽

Ziqi Wang ◽

...

Keyword(s):

Factor Analysis ◽

Critical Thinking ◽

Medical Students ◽

Psychometric Properties ◽

Internal Consistency ◽

Discriminant Validity ◽

Retest Reliability ◽

Critical Thinking Disposition ◽

Thinking Disposition ◽

Test Retest Reliability

Abstract Background Critical thinking disposition helps medical students and professionals overcome the effects of personal values and beliefs when exercising clinical judgment. The lack of effective instruments to measure critical thinking disposition in medical students has become an obstacle for training and evaluating students in undergraduate programs in China. The aim of this study was to evaluate the psychometric properties of the CTDA test. Methods A total of 278 students participated in this study and responded to the CTDA test. Cronbach’s α coefficient, internal consistency, test-retest reliability, floor effects and ceiling effects were measured to assess the reliability of the questionnaire. Construct validity of the pre-specified three-domain structure of the CTDA was evaluated by explanatory factor analysis (EFA) and confirmatory factor analysis (CFA). The convergent validity and discriminant validity were also analyzed. Results Cronbach’s alpha coefficient for the entire questionnaire was calculated to be 0.92, all of the domains showed acceptable internal consistency (0.81–0.86), and the test-retest reliability indicated acceptable intra-class correlation coefficients (ICCs) (0.93, p < 0.01). The EFA and the CFA demonstrated that the three-domain model fitted the data adequately. The test showed satisfactory convergent and discriminant validity. Conclusions The CTDA is a reliable and valid questionnaire to evaluate the disposition of medical students towards critical thinking in China and can reasonably be applied in critical thinking programs and medical education research.

Download Full-text

Psychometric properties of instruments to measure parenting practices and children’s movement behaviors in low-income families from Brazil

BMC Medical Research Methodology ◽

10.1186/s12874-021-01320-y ◽

2021 ◽

Vol 21 (1) ◽

Author(s):

Widjane Sheila Ferreira Goncalves ◽

Rebecca Byrne ◽

Pedro Israel Cabral de Lira ◽

Marcelo Tavares Viana ◽

Stewart G. Trost

Keyword(s):

Physical Activity ◽

Internal Consistency ◽

Screen Time ◽

Parenting Practices ◽

Concurrent Validity ◽

Retest Reliability ◽

Culturally Adapted ◽

Total Movement ◽

Objectively Measured ◽

Test Retest Reliability

Abstract Background Childhood obesity has increased remarkably in low and middle-income (LMIC) countries. Movement behaviors (physical activity, screen time, and sleep) are crucial in the development of overweight and obesity in young children. Yet, few studies have investigated the relationship between children’s movement behaviors and parenting practices because validated measures for use among families from LMIC are lacking. This study evaluated the psychometric properties of previously validated measures of young children’s physical activity, screen time, and sleep and parenting practices, translated and culturally adapted to Brazilian families. Methods A total of 78 parent-child dyads completed an interviewer-administered survey twice within 7 days. Child physical activity, sedentary time and sleep were concurrently measured using a wrist-worn accelerometer. Internal consistency and test-retest reliability was assessed using McDonald’s Omega and Intraclass Correlation Coefficients (ICC’s). Concurrent validity was evaluated by calculating Spearman correlations between parent reported child behaviors and accelerometer measured behaviors. Results Seventeen of the 19 parenting practices scales exhibited acceptable internal consistency reliability (Ω ≥ 0.70). Test-retest reliability ICC’s were acceptable and ranged from 0.82 - 0.99. Parent reported child physical activity was positively correlated with objectively measured total movement (rho= 0.29 - 0.46, p < .05) and energetic play (rho= 0.29 – 0.40, p < .05). Parent reported child screen time was positively correlated with objectively measured sedentary time; (rho = 0.26, p < .05), and inversely correlated with total movement (rho = - 0.39 – - 0.41, p < .05) and energetic play (rho = - 0.37 – - 0.41, p < .05). Parent reported night-time sleep duration was significantly correlated with accelerometer measured sleep duration on weekdays (rho = 0.29, p < .05), but not weekends. Conclusions Measurement tools to assess children’s movement behaviors and parenting practices, translated and culturally adapted for use in Brazilian families, exhibited acceptable evidence of concurrent validity, internal consistency, and test-retest reliability.

Download Full-text

Psychometric Evaluation of the Persian Version of Barkley Adult Attention Deficit/Hyperactivity Disorder Screening Tool among the Elderly

Scientifica ◽

10.1155/2017/9109783 ◽

2017 ◽

Vol 2017 ◽

pp. 1-6 ◽

Cited By ~ 1

Author(s):

Mostafa Sadeghi ◽

Homayoun Sadeghi-Bazargani ◽

Shahrokh Amiri

Keyword(s):

Attention Deficit Hyperactivity Disorder ◽

Internal Consistency ◽

Attention Deficit ◽

Concurrent Validity ◽

Rating Scale ◽

Retest Reliability ◽

Hyperactivity Disorder ◽

Persian Version ◽

Test Retest Reliability ◽

Tabriz City

Background. The Barkley Adult Attention Deficit/Hyperactivity Disorder (ADHD) Rating Scale-IV (BAARS-IV) was developed, and it demonstrated good psychometric properties. The BAARS-IV includes 27 questions on the symptoms of adult ADHD. The purpose of the present study is to investigate the psychometric testing of the Persian version of BAARS-IV among the elderlies in Tabriz City. Method. This cross-sectional study was conducted in Tabriz City—in the west of Iran—in 2015 via enrolling of 121 old-aged people. We did the process of translation and adaptation of BAARS-IV and examined its concurrent validity, internal consistency, and test-retest reliability. Result. The BAARS-IV demonstrated good internal consistency and test-retest reliability. Correlations between the BAARS-IV and the CAARS-S: SV were high and evidence supporting concurrent validity was revealed. Cronbach’s alpha for the overall scale and subscales stood at 0.89, 0.81, 0.66, 0.56, and 0.82, respectively. Conclusion. The Persian BAARS-IV showed acceptable reliability and validity. BAARS-IV was determined to be composed of internally consistent and psychometrically sound items.

Download Full-text

Criterion validity and reliability of the International Physical Activity Questionnaire – Hungarian short form against the RM42 accelerometer

BMC Public Health ◽

10.1186/s12889-021-10372-0 ◽

2021 ◽

Vol 21 (S1) ◽

Author(s):

Pongrác Ács ◽

Réka Veress ◽

Paulo Rocha ◽

Tamás Dóczi ◽

Bence László Raposa ◽

...

Keyword(s):

Physical Activity ◽

Concurrent Validity ◽

International Physical Activity Questionnaire ◽

Short Form ◽

Sitting Time ◽

Validity And Reliability ◽

Retest Reliability ◽

Physical Activity Questionnaire ◽

Test Retest Reliability ◽

Activity Questionnaire

Abstract Background Physical inactivity is a global phenomenon in European welfare countries. Proper monitoring is essential to measure the physical activity level of the population. Methods In the Hungarian cohort of the European Physical Activity and Sport Monitoring System (EUPASMOS) project, our participants (N = 598) completed sociodemographic questions and the International Physical Activity Questionnaire – short form (IPAQ-SF) survey. The validity and reliability of the subjective measurement tool were examined, IPAQ-SF outcomes were contrasted against triaxial RM42 accelerometer wore for 7 consecutive days. Results The IPAQ-SF showed moderate internal consistency (Cronbach Alpha = 0.647). The concurrent validity of the IPAQ-SF to triaxial accelerometer indicated a significant weak-to-moderate correlation (R = 0.111–0.338, p = 0.042; p < 0.001). The test-retest reliability showed a significant correlation between two measurements (R = 0.788–0.981, p < 0.001). Conclusion The Hungarian version of the IPAQ-SF had excellent test-retest reliability, but low-to-fair concurrent validity for moderate and vigorous physical activity, walking and sitting time, as compared to the objective criterion measure among Hungarian adults.

Download Full-text