scholarly journals Construct Validity and Test–Retest Reliability of the Automated Vehicle User Perception Survey

2021 ◽  
Vol 12 ◽  
Author(s):  
Justin Mason ◽  
Sherrilene Classen ◽  
James Wersal ◽  
Virginia Sisiopiku

Fully automated vehicles (AVs) hold promise toward providing numerous societal benefits including reducing road fatalities. However, we are uncertain about how individuals’ perceptions will influence their ability to accept and adopt AVs. The 28-item Automated Vehicle User Perception Survey (AVUPS) is a visual analog scale that was previously constructed, with established face and content validity, to assess individuals’ perceptions of AVs. In this study, we examined construct validity, via exploratory factor analysis and subsequent Mokken scale analyses. Next, internal consistency was assessed via Cronbach’s alpha (α) and 2-week test–retest reliability was assessed via Spearman’s rho (ρ) and intraclass correlation coefficient (ICC). The Mokken scale analyses resulted in a refined 20-item AVUPS and three Mokken subscales assessing specific domains of adults’ perceptions of AVs: (a) Intention to use; (b) perceived barriers; and (c) well-being. The Mokken scale analysis showed that all item-coefficients of homogeneity (H) exceeded 0.3, indicating that the items reflect a single latent variable. The AVUPS indicated a strong Mokken scale (Hscale = 0.51) with excellent internal consistency (α = 0.95) and test–retest reliability (ρ = 0.76, ICC = 0.95). Similarly, the three Mokken subscales ranged from moderate to strong (range Hscale = 0.47–0.66) and had excellent internal consistency (range α = 0.84–0.94) and test–retest reliability (range ICC = 0.84–0.93). The AVUPS and three Mokken subscales of AV acceptance were validated in a moderate sample size (N = 312) of adults living in the United States. Two-week test–retest reliability was established using a subset of Amazon Mechanical Turk participants (N = 84). The AVUPS, or any combination of the three subscales, can be used to validly and reliably assess adults’ perceptions before and after being exposed to AVs. The AVUPS can be used to quantify adults’ acceptance of fully AVs.

PeerJ ◽  
2015 ◽  
Vol 3 ◽  
pp. e1264 ◽  
Author(s):  
Ahmed Waqas ◽  
Waqas Ahmad ◽  
Mark Haddad ◽  
Frances M. Taggart ◽  
Zerwah Muhammad ◽  
...  

Background.There is growing awareness of the public health importance of mental well-being both in the general population and in specific groups. The well-being of health professionals is likely to influence the quality of the care they deliver. This study was carried out to examine the well-being of Pakistani healthcare professionals, and to evaluate the psychometric performance of the Warwick–Edinburgh Mental Well-being Scale (WEMWBS) in this population.Methods.A cross-sectional survey was carried out from June, 2013 to December, 2014 among 1,271 Pakistani health care providers (HCPs) working in seven different cities in Punjab province, Pakistan, to examine the acceptability, internal consistency, test-retest reliability and content and construct validity of the English version of the WEMWBS in a Pakistani population sample. All data were analyzed in SPSS v. 21.Results.Our analysis demonstrated unidimensional construct validity, high internal consistency (0.89) and test-retest reliability, good validity and easy readability of WEMWBS in our sample of Pakistani HCPs. The mean WEMWBS score was 48.1 (SD 9.4), which is lower than in the general population in other countries. Male HCPs scored significantly higher on the WEMWBS than their female counterparts (P< 0.05), and older respondents had higher scores.Conclusion.The WEMWBS appears acceptable for use in Pakistani HCPs, and findings from this study verify its validity and internal consistency for this population sample. Our respondents had lower well-being scores than those reported in general population surveys in the UK.


2021 ◽  
Vol 19 (1) ◽  
Author(s):  
Marco Monticone ◽  
Cristiano Sconza ◽  
Igor Portoghese ◽  
Tomohiko Nishigami ◽  
Benedict M. Wand ◽  
...  

Abstract Background and aim Growing attention is being given to utilising physical function measures to better understand and manage knee osteoarthritis (OA). The Fremantle Knee Awareness Questionnaire (FreKAQ), a self-reported measure of body-perception specific to the knee, has never been validated in Italian patients. The aims of this study were to culturally adapt and validate the Italian version of the FreKAQ (FreKAQ-I), to allow for its use with Italian-speaking patients with painful knee OA. Methods The FreKAQ-I was developed by means of forward–backward translation, a final review by an expert committee and a test of the pre-final version to evaluate its comprehensibility. The psychometric testing included: internal structural validity by Rasch analysis; construct validity by assessing hypotheses of FreKAQ correlations with the knee injury and osteoarthritis outcome score (KOOS), a pain intensity numerical rating scale (PI-NRS), the pain catastrophising scale (PCS), and the Hospital anxiety and depression score (HADS) (Pearson’s correlations); known-group validity by evaluating the ability of FreKAQ scores to discriminate between two groups of participants with different clinical profiles (Mann–Whitney U test); reliability by internal consistency (Cronbach’s alpha) and test–retest reliability (intraclass correlation coefficient, ICC2.1); and measurement error by calculating the minimum detectable change (MDC). Results It took one month to develop a consensus-based version of the FreKAQ-I. The questionnaire was administered to 102 subjects with painful knee OA and was well accepted. Internal structural validity confirmed the substantial unidimensionality of the FreKAQ-I: variance explained was 53.3%, the unexplained variance in the first contrast showed an eigenvalue of 1.8, and no local dependence was detected. Construct validity was good as all of the hypotheses were met; correlations: KOOS (rho = 0.38–0.51), PI-NRS (rho = 0.35–0.37), PCS (rho = 0.47) and HADS (Anxiety rho = 0.36; Depression rho = 0.43). Regarding known-groups validity, FreKAQ scores were significantly different between groups of participants demonstrating high and low levels of pain intensity, pain catastrophising, anxiety, depression and the four KOOS subscales (p ≤ 0.004). Internal consistency was acceptable (α = 0.74) and test–retest reliability was excellent (ICC = 0.92, CI 0.87–0.94). The MDC95 was 5.22 scale points. Conclusion The FreKAQ-I is unidimensional, reliable and valid in Italian patients with painful knee OA. Its use is recommended for clinical and research purposes.


2017 ◽  
Vol 32 (2) ◽  
Author(s):  
Shannon Gwin ◽  
Paul Branscum ◽  
E. Laurette Taylor

The purpose of this study was to create a valid and reliable instrument to evaluate theory-basedbeliefs towards physical activity among clergy members. Data were collected from 174 clergy that par-ticipated in a 15-item online and paper-based survey. Psychometric properties of the instrument includedconfirmatory factor analysis (construct validity), and cronbach’s alpha (internal consistency reliability).In addition, the stability (test-retest reliability) of each subscale was evaluated with a sub-sample of 30participants. Results show the instrument was both valid and reliable, and will be useful in future studiestargeting this population. Future implications are discussed.


2021 ◽  
Vol 39 (15_suppl) ◽  
pp. e24027-e24027
Author(s):  
Jaba Kokhreidze ◽  
Veleka Allen ◽  
Cristina Ivanescu ◽  
Xiaopan Valerie Yao ◽  
Bin Zhang ◽  
...  

e24027 Background: The ongoing two-part phase 2/3 RESILIENT study (NCT03088813) is investigating the efficacy and safety of liposomal irinotecan monotherapy in patients with SCLC who have progressed on or after first line platinum-based chemotherapy. This exploratory analysis from RESILIENT part 1 was conducted to confirm the psychometric properties of established PRO instruments that had not previously been validated in patients with SCLC. Methods: Patients completed the European Organisation for Research and Treatment of Cancer Quality of Life Questionnaire (EORTC QLQ) Core 30 (C30) and the EORTC QLQ Lung Cancer 13 (LC13) before treatment assignment (baseline), every 6 weeks thereafter, at treatment discontinuation and at the 30-day follow-up visit. Psychometric methods included descriptive statistics (items and scales), correlations (item-to-item and item-to-total), internal consistency (Cronbach’s α), test-retest reliability (intraclass correlation coefficient [ICC], two-way random effects model), construct validity and sensitivity to change. The analysis included patients who received at least one dose of study drug and completed at least one PRO assessment. Results: Thirty patients were enrolled in RESILIENT part 1 and included in the analysis. At baseline, 68% of patients reported ‘not severe’ or ‘mild’ symptoms. Floor effects (i.e. more than 25% of responses of ‘not at all’) were observed for several of the functioning/impact and symptom scales of the EORTC QLQ C30 and LC13. Moderate to strong correlations were found among most questionnaire items within their respective scales. Acceptable evidence for internal consistency and good test-retest reliability were observed. Selected results for the EORTC QLQ LC13, including dyspnea scales, are shown in the Table. The magnitude of correlations among PRO instruments supported evidence for convergent validity in this sample. Conclusions: In RESILIENT part 1, patients experienced low and tolerable symptoms at enrollment, limiting the potential for further improvement. Overall, these PRO instruments had acceptable psychometric properties (e.g. construct validity, reliability and ability to detect change) in this sample. However, these analyses should be repeated in a larger sample using data from RESILIENT part 2. Clinical trial information: NCT03088813. [Table: see text]


2020 ◽  
Vol 18 (1) ◽  
Author(s):  
Tarek Mahmood ◽  
Minhaj Rahim Choudhury ◽  
Md Nazrul Islam ◽  
Syed Atiqul Haq ◽  
Md Abu Shahin ◽  
...  

Abstract Background This study was focused on translation and cultural adaptation of the English Lequesne Algofunctional index (LAI) into Bengali for patients with primary knee osteoarthritis (OA) and testing reliability and validity of the Bengali version of the LAI. Methods This study was carried out in the Department of Rheumatology, BSM Medical University, Dhaka, Bangladesh. Using the forward–backward method the English LAI was translated into Bengali including cultural adaptation. For pretesting, A sample of 40 patients with primary knee osteoarthritis were screened using the Bengali version of LAI. Following the pretest, 130 consecutive patients with symptomatic knee OA completed the interviewer administered Bengali LAI, the validated Bengali version of SF-36, Visual Analogue Scale for Pain, Distance Walked and Activities of Daily Living. For the retest 60 randomly selected patients from the cohort were administered the Bengali LAI 7 days later. An item by item analysis was performed. Internal consistency was assessed by Cronbach’s alpha, test–retest reliability by intraclass correlation coefficient (ICC) and Kappa coefficient, construct validity was measured using the Spearman rank correlation coefficient. Results It took 3.25 ± 0.71 min to complete the Bengali LAI and the mean score was 9.23 ± 4.58. For the Bengali LAI Cronbach’s alpha score was 0.88, test–retest reliability assessed by ICC was 0.97. For construct validity, excellent convergent validity was achieved (ρ = 0.93) but the divergent validity was moderate (ρ = 0.43). Conclusions The Bengali LAI showed excellent convergent validity, internal consistency and test–retest reliability, only the divergent validity was moderate. So, the Bengali LAI can be applied as a HRQoL assessment tool for primary knee OA patients.


2020 ◽  
pp. 156918612094453
Author(s):  
Eris CM Ho ◽  
Mona Dür ◽  
Tanja Stamm ◽  
Andrew MH Siu

Background Occupational balance, a fundamental concept in occupational therapy, is the arrangement of right amount and variety of occupations contributes to a person’s health and well-being. This study was aimed to investigate the reliability and validity of the Chinese version of the Occupational Balance Questionnaire (OB-Quest) for people with insomnia. Methods The OB-Quest was translated into traditional Chinese and reviewed by an expert panel for content validity, cultural relevance and translation accuracy. Internal consistency, factor analysis and convergent validity, as well as test–retest reliability, were explored. Results The participants (n = 205), 115 adults with insomnia and 90 adults without insomnia, completed a survey of demographic background, the Chinese version of OB-Quest and the Chinese Insomnia Severity Index (C-ISI). The Chinese version of OB-Quest demonstrated excellent test–retest reliability (ICC= 0.98) and good internal consistency (Cronbach’s α  =  0.80). Factor analysis indicated that a single-factor solution explained 42% of the variance, and 9 out of 10 items had a factor loading of 0.4 or above. The Chinese version of OB-Quest had significant correlations with C-ISI (r = –0.88; p < 0.001). A significant difference was found in occupational balance between groups with different levels of insomnia severity and without insomnia (F = 169.72; p < 0.001). As in a previous study, age, living environment and life role had no significant relationship with occupational balance. Conclusion The Chinese version of OB-Quest is a short, easy to understand and culturally relevant assessment for Chinese. It demonstrates satisfactory psychometric properties and had significant correlations with insomnia.


2004 ◽  
Vol 94 (2) ◽  
pp. 482-484 ◽  
Author(s):  
Greg E. Dear

The Holyoake Codependency Index is a 13-item self-report measure of three aspects of codependency: External Focus, Self-sacrifice, and a sense of being overwhelmed by another person's problematic behavior (termed Reactivity). Previous studies have supported internal validity and the internal consistency and construct validity of the subscales. The present scores for 59 students indicate full scale test-retest reliability of .88 and for subscales (.76 to .82) over a 3-wk. interval.


1998 ◽  
Vol 13 (5) ◽  
pp. 231-234 ◽  
Author(s):  
L Hansson ◽  
B Svensson ◽  
T Björkman

SummaryThere has been a growing interest in the quality of life (QoL) of the mentally ill, subsequently a number of instruments to measure QoL have been developed. One of the measures of QoL which has received considerable attention is the Lancashire QoL Profile (LQOLP). The present study investigated test-retest reliability and internal consistency in the Swedish translation of the LQOLP using a cross-sectional sample of 29 inpatients. The results showed that test-retest reliability of subjective life satisfaction in the nine life domains covered by the LQOLP was satisfactory in seven of the domains, and acceptable in two (social relations and religion). Test-retest reliability for total subjective satisfaction score, global well-being, and an interviewer rated QoL were all on a satisfactory level (r > 0.80). The internal consistency and homogeneity of the total subjective QoL scale and the nine life domain subscales was satisfactory except for the social relations scale, where it was somewhat low.


2019 ◽  
Vol 56 (9) ◽  
pp. 1195-1205 ◽  
Author(s):  
Rafael Denadai ◽  
Cassio Eduardo Raposo-Amaral ◽  
Anelise Sabbag ◽  
Rafael Andrade Ribeiro ◽  
Celso Luiz Buzzo ◽  
...  

Objective: To test the Brazilian Portuguese velopharyngeal insufficiency (VPI) Effects on Life Outcome (VELO) instrument for reliability and validity. Design: Cross-sectional methodological study. Setting: Tertiary craniofacial medical center. Participants: Participants with VPI (VPI group, n = 60), with cleft and without VPI (no VPI/cleft group, n = 60), and with no cleft nor VPI (no VPI/no cleft group, n = 60) and their parents (n = 180). Interventions: All patients with VPI 8+ years old and their parents completed the Brazilian–Portuguese VELO instrument and other questionnaires (Pediatric Quality of Life Inventory4.0, PedsQL4.0; Pediatric Voice-Related Quality of Life, PVRQOL; and Intelligibility in Context Scale, ICS) at baseline; patients with VPI and their parents completed the VELO instrument again 2 weeks later. Main Outcome Measures: The VELO instrument was tested for internal consistency, test–retest reliability, discriminant validity (participants with VPI against participants with no VPI), concurrent validity against other questionnaires, criterion validity against hypernasality severity, and construct validity against nasal air emission and overall velopharyngeal competence (speech construct) and velopharyngeal gap (anatomic construct). Results: The VELO had excellent internal consistency (Cronbach α 0.99 for parents and 0.98 for participants with VPI) and test–retest reliability (all intraclass correlation coefficient > 0.87). The VELO discriminated well between VPI group and unaffected groups (all P < .05). The VELO was significantly correlated with the PedsQL4.0, PVRQOL, and ICS (– r > 0.75; P < .001). The VELO met criterion validity, speech construct validity, and anatomic construct validity ( r > 0.7; P < .001). Conclusions: The Brazilian-Portuguese VELO instrument demonstrated reliability (internal consistency and test–retest) and validity (discriminant, concurrent, criterion, and construct).


2020 ◽  
Vol 9 (3) ◽  
Author(s):  
Anggi Setyowati ◽  
Min-Huey Chung ◽  
Ah. Yusuf ◽  
Setya Haksama

Background: Curiosity is a personality characteristic, which fits with wellbeing and positive functioning. The objective of this study was to assess the construct validity of the Curiosity and Exploration Inventory II (CEI-II) in Indonesia.Design and Methods: The study included 256 undergraduate students who lived in Indonesia, mean age 19.8 years old. The CEI-II measures stretching and embracing using 11 items. The English version of CEI-II was translated into Bahasa. The Cronbach’s alpha coefficient and intraclass correlation coefficient (ICC) were addressed to examine internal consistency reliability and the test-retest reliability. To evaluate construct validity, exploratory factor analysis (EFA) was used to assess factor structure and confirmatory factor analysis (CFA) was used to evaluate the structural model fit of the CEI-II Indonesia version.Results: The study showed Cronbach’s alpha for the internal consistency of the overall CEI-II Indonesia version was 0.77. The ICC for the test-retest reliability ranged between 0.753-0.829. EFA showed adequate with the Kaiser-Meyer-Olkin value of 0.86 and the Bartlett’s test of sphericity was statistically significant. CFA tested the second-order model with two-order factors and showed a model fit.Conclusions: The CEI-II Indonesia version indicated acceptable construct validity to evaluate curiosity in Indonesia.


Sign in / Sign up

Export Citation Format

Share Document