scholarly journals Positive bias in the ‘Trust in Automated Systems Survey’? An examination of the Jian et al. (2000) scale

Author(s):  
Robert S. Gutzwiller ◽  
Erin K. Chiou ◽  
Scotty D. Craig ◽  
Christina M. Lewis ◽  
Glenn J. Lematta ◽  
...  

Measuring trust in technology is a mainstay in Human Factors research. While trust may not perfectly predict reliance on technology or compliance with alarm signals, it is routinely used as a design consideration and assessment goalpost. Several methods of measuring trust have been employed in the past decades, but one self-report measure stands out due to its popular use, the Trust in Automated Systems Survey (Jian, Bisantz, & Drury, 2000). We conducted a study to assess whether the survey could create biased responses, and found evidence the original scale is in fact skewed toward positive ratings. Assessing the literature revealed the survey has been used in unaltered form across at least 100 different reports and remains frequently administered – therefore, the potential impact of this bias may be widespread. Future directions, considerations, and caveats for our assessment, and for using this scale, are discussed.

Author(s):  
Beth Blickensderfer ◽  
Lori J Brown ◽  
Alyssa Greenman ◽  
Jayde King ◽  
Brandon Pitts

When General Aviation (GA) pilots encounter unexpected weather hazards in-flight, the results are typically deadly. It is unsurprising that the National Transportation Safety Board repeatedly lists weather related factors in GA flight operations as an unsolved aviation safety challenge. Solving this problem requires multidisciplinary perspectives. Fortunately, in the past several years innovative laboratory research and industry products have become available. This panel discussion brings together Human Factors and Ergonomics researchers and practitioners to discuss and describe the current work and future directions to avoid weather related accidents in GA.


1982 ◽  
Vol 50 (1) ◽  
pp. 83-87 ◽  
Author(s):  
Michael R. Lowe

Previous research has provided support for the validity of the Social Performance Survey Schedule, a 100-item self-report measure of social skill. However, the scale has separate positive (Part A) and negative (Part B) behavior subscales, the validity of which has not been adequately assessed. The present study examined the validity of the Part A subscale with psychiatric inpatients by comparing scores with an objective measure of social activity, judges' ratings of social skill, and several self-report measures. The results generally supported Part A's validity. The influence of social desirability on Part A scores was discussed and future directions for research were suggested.


2016 ◽  
Vol 38 (1) ◽  
pp. 28-46 ◽  
Author(s):  
Trevor J. Buser ◽  
Christina Hamme Peterson ◽  
Tara M. Hill

The aim of this study was to develop and provide validation evidence for a self-report measure of nonsuicidal self-injury (NSSI), the Brief Severity Index for NSSI (BSI-NSSI). We developed items to tap the new diagnostic classification for NSSI in the Diagnostic and Statistical Manual of Mental Disorders (5th ed., DSM-5; American Psychiatric Association.[APA], 2013). We also designed the measure to distinguish among gradations of NSSI severity. Data were collected from a sample of 843 young adults, 72 of whom had performed NSSI in the past year. Using Rasch analysis, we reached initial support for the validity and reliability of the BSI-NSSI. Implications for counseling and research are discussed.


2016 ◽  
Vol 5 (1) ◽  
pp. 18-28
Author(s):  
Kaori Nakao ◽  

Loanwords are a growing component of the Japanese language. During the past six decades, the majority of new loanwords entering the Japanese language have come from the English language. For native Japanese speaking students, loanwords are a source of potential frustration and support, both within their L1 and L2 (English). Aims: To explore and further our understanding of students’ knowledge of high frequency loanwords. Sample: One hundred thirty undergraduate students of mixed major, studying in a compulsory course (Eigo/Eigokaiwa), at Kyushu Sangyo University, participated in this exploratory study. Methods: This study compares loanword self-reported difficulty (L2) with students’ productive knowledge in their L1. This study was undertaken with a group of first- and second-year students (n!130) enrolled in compulsory English classes. Results: For half of the loanwords examined, self-reported difficulty and students’ productive knowledge was consistent. The remaining words examined were inconsistent with self-report measures, generally underestimating students’ actual productive knowledge. Conclusions: Error analyses of students’ L1 sentences indicated that inconsistencies observed between self-report and productive knowledge may be due to students’ partial knowledge of words expressed through their reliance on katakana translations of the words tested. Implications for practice and future directions are discussed.


2016 ◽  
Vol 74 (2) ◽  
pp. 239-259 ◽  
Author(s):  
Heather J. Carmack ◽  
Jocelyn M. DeGroot

Two studies ( N = 621) were conducted to develop and initially validate the Communication Apprehension About Death Scale (CADS). In Study 1, 302 general public participants completed a preliminary list of 66 items. An exploratory factor analysis identified two distinct dimensions of communication apprehension about death: communication anxiety and communication avoidance. A different group of participants ( n = 319) participated in Study 2. Participants in Study 2 completed the CADS measure, a fear of death measure, and a general communication apprehension measure. Concurrent validity support was provided through the significant positive correlations between communication apprehension about death and fear of death as well as communication apprehension about death and general communication apprehension. Collectively, the results suggest that the CADS is a reliable and valid self-report measure of communication apprehension about death. We conclude with a discussion of the findings as well as future directions needed to more critically examine CADS.


Author(s):  
Benjamin F. Trump ◽  
Irene K. Berezesky ◽  
Raymond T. Jones

The role of electron microscopy and associated techniques is assured in diagnostic pathology. At the present time, most of the progress has been made on tissues examined by transmission electron microscopy (TEM) and correlated with light microscopy (LM) and by cytochemistry using both plastic and paraffin-embedded materials. As mentioned elsewhere in this symposium, this has revolutionized many fields of pathology including diagnostic, anatomic and clinical pathology. It began with the kidney; however, it has now been extended to most other organ systems and to tumor diagnosis in general. The results of the past few years tend to indicate the future directions and needs of this expanding field. Now, in addition to routine EM, pathologists have access to the many newly developed methods and instruments mentioned below which should aid considerably not only in diagnostic pathology but in investigative pathology as well.


2008 ◽  
Vol 24 (1) ◽  
pp. 22-26 ◽  
Author(s):  
Brian E. McGuire ◽  
Michael J. Hogan ◽  
Todd G. Morrison

Abstract. Objective: To factor analyze the Pain Patient Profile questionnaire (P3; Tollison & Langley, 1995 ), a self-report measure of emotional distress in respondents with chronic pain. Method: An unweighted least squares factor analysis with oblique rotation was conducted on the P3 scores of 160 pain patients to look for evidence of three distinct factors (i.e., Depression, Anxiety, and Somatization). Results: Fit indices suggested that three distinct factors, accounting for 32.1%, 7.0%, and 5.5% of the shared variance, provided an adequate representation of the data. However, inspection of item groupings revealed that this structure did not map onto the Depression, Anxiety, and Somatization division purportedly represented by the P3. Further, when the analysis was re-run, eliminating items that failed to meet salience criteria, a two-factor solution emerged, with Factor 1 representing a mixture of Depression and Anxiety items and Factor 2 denoting Somatization. Each of these factors correlated significantly with a subsample's assessment of pain intensity. Conclusion: Results were not congruent with the P3's suggested tripartite model of pain experience and indicate that modifications to the scale may be required.


2017 ◽  
Vol 33 (2) ◽  
pp. 97-103 ◽  
Author(s):  
Tíscar Rodríguez-Jiménez ◽  
Antonio Godoy ◽  
José A. Piqueras ◽  
Aurora Gavino ◽  
Agustín E. Martínez-González ◽  
...  

Abstract. Evidence-based assessment is necessary as a first step for developing psychopathological studies and assessing the effectiveness of empirically validated treatments. There are several measures of obsessive-compulsive disorder (OCD) and/or symptomatology in children and adolescents, but all of them present some limitations. The Obsessive-Compulsive Inventory-Revised (OCI-R) by Foa and her colleagues has showed to be a good self-report measure to capture the dimensionality of OCD in adults and adolescents. The child version of the OCI (OCI-CV) was validated for clinical children and adolescents in 2010, showing excellent psychometric properties. The objective of this study was to examine the factor structure and invariance of the OCI-CV in the general population. Results showed a six-factor structure with one second-order factor, good consistency values, and invariance across region, age, and sex. The OCI-CV is an excellent inventory for assessing the dimensions of OCD symptomatology in general populations of children and adolescents. The invariance across sex and age warrants its utilization for research purposes.


2019 ◽  
Vol 35 (4) ◽  
pp. 564-576 ◽  
Author(s):  
Tobias Ringeisen ◽  
Sonja Rohrmann ◽  
Anika Bürgermeister ◽  
Ana N. Tibubos

Abstract. By means of two studies, a self-report measure to assess self-efficacy in presentation and moderation skills, the SEPM scales, was validated. In study 1, factorial and construct validity were examined. A sample of 744 university students (41% females; more than 50% between 20 and 25 years) completed newly constructed self-efficacy items. Confirmatory factor analyses (CFAs) substantiated two positively correlated factors, presentation (SEPM-P) and moderation self-efficacy (SEPM-M). Each factor consists of eight items. The correlation patterns between the two SEPM subscales and related constructs such as extraversion, the preference for cooperative learning, and conflict management indicated adequate construct validity. In study 2, criterion validity was determined by means of latent change modeling. One hundred sixty students ( Mage = 24.40, SD = 4.04; 61% females) took part in a university course to foster key competences and completed the SEPM scales at the beginning and the end of the semester. Presentation and moderation self-efficacy increased significantly over time of which the latter was positively associated with the performance in a practical moderation exam. Across both studies, reliability of the scales was high, ranging from McDonald’s ω .80 to .88.


Sign in / Sign up

Export Citation Format

Share Document