The Clinician-reported Genetic testing Utility InDEx (C-GUIDE): Preliminary evidence of validity and reliability

The present study focused on the development of the Multidimensional Dream Inventory, an individual difference measure of dimensions of dreams. Items were administered to 151 college students. Consistent with expectations, results of an exploratory factor analysis of intercorrelations among items indicated a four-factor solution was appropriate. As a result, four dream-relevant scales were constructed, viz, Dream Importance, Dream Vividness, Dream Usefulness, and Dream Recall. In addition, these scales showed good internal consistency for research. Implications and uses for the Multidimensional Dream Inventory were discussed.

Download Full-text

The impact of auditors’ awareness of the profession’s reputation for independence on auditors’ ethical judgement

Social Responsibility Journal ◽

10.1108/srj-05-2018-0117 ◽

2019 ◽

Vol 16 (8) ◽

pp. 1087-1105

Author(s):

Damai Nasution ◽

Ralf Östermark

Keyword(s):

Design Methodology ◽

Reliability And Validity ◽

Positive Association ◽

Preliminary Evidence ◽

Survey Questionnaire ◽

Ethical Judgement ◽

Validity And Reliability ◽

Content Type ◽

The Impact ◽

Item Scale

Purpose The purpose of this paper is to develop and test the scale of auditors’ awareness of the profession’s reputation for independence, defined as the degree to which auditors recognise the importance of the reputation for independence and acknowledge the impact of their judgements and decisions on that reputation, and to provide preliminary evidence of an association between auditors’ awareness of the profession’s reputation and auditors’ ethical judgement. Design/methodology/approach A seven-item scale was developed to measure auditors’ awareness of the profession’s reputation for independence, and an auditing case was used to measure auditors’ ethical judgement. A survey questionnaire of practising auditors working in auditing firms in Indonesia provides data for testing the validity and reliability of the new scale and proposed hypothesis. Findings The findings show that the scale is unidimensional and has satisfied reliability and validity. Moreover, the preliminary evidence of a positive association between the new scale and auditors’ ethical judgement is provided. Research limitations/implications Further studies should test the validity and reliability of the scale of awareness of the profession’s reputation for independence with larger data and in different settings. Investigation of the antecedent factors of auditors’ awareness of the profession’s reputation for independence is suggested. Originality/value This paper develops a new measure, namely, the awareness of the profession’s reputation for independence. Preliminary evidence to establish an association between that awareness and auditor ethical judgement is provided.

Download Full-text

Psychometric assessment of the Instructional Materials Motivation Survey (IMMS) instrument in a remote learning environment

Revista Brasileira de Educação Médica ◽

10.1590/1981-5271v45.4-20210066.ing ◽

2021 ◽

Vol 45 (4) ◽

Author(s):

Aloísio Cardoso-Júnior ◽

Rosa Malena Delbone de Faria

Keyword(s):

Student Performance ◽

Principal Component ◽

Preliminary Evidence ◽

Instructional Materials ◽

Human Anatomy ◽

Validity And Reliability ◽

Cronbach’S Alpha ◽

Cross Sectional ◽

Cronbach's Alpha ◽

Belo Horizonte

Abstract: Introduction: Motivation contributes greatly to learning, being a predictor of student performance. Thus, instruments that assess motivation after exposure to different teaching strategies and materials can contribute to the analysis and decision on its effectiveness. In this sense, the Instructional Materials Motivation Survey (IMMS) instrument measures students’ motivation after instructional activities. Objective: This study aimed to evaluate the evidence of validity of the IMMS, previously translated and cross-culturally adapted to Brazilian Portuguese. Method: Cross-sectional study used to evaluate the psychometric properties of the IMMS questionnaire, applied to 211 students from the first, third and fourth semesters of the medical course at José do Rosário Vellano University (Unifenas - Campus Belo Horizonte). The principal component analysis (PCA) with Varimax rotation and Cronbach’s alpha coefficient were used to assess the validity and reliability of the instrument. Results: The PCA reduced the instrument’s items from 36 to 25 items, distributed in four dimensions. The saturation of the items in the dimensions ranged from 0.529 to 0.790 and the total explained variance was 63.12%. The reliability of the modified IMMS (IMMS-BRV), measured by Cronbach’s alpha, ranged from 0.76 (Attention dimension) to 0.93 (Interest dimension). Conclusion: The IMMS application in the remote education scenario, through asynchronous video lectures of human anatomy, resulted in an alternative instrument (IMMS-BRV), with fewer items (more parsimonious) and good internal consistency, demonstrating preliminary evidence of its validity and reliability adequacy.

Download Full-text

Measuring Engagement in Early Education: Preliminary Evidence for the Behavioral Observation of Students in Schools–Early Education

Assessment for Effective Intervention ◽

10.1177/1534508418820125 ◽

2018 ◽

Vol 45 (4) ◽

pp. 243-254

Author(s):

Robin L. Hojnoski ◽

Kristen N. Missall ◽

Brenna K. Wood

Keyword(s):

Young Children ◽

Early Education ◽

School Achievement ◽

Behavioral Observation ◽

Preliminary Evidence ◽

Measurement Development ◽

Validity And Reliability ◽

Target Behaviors ◽

Diverse Groups

Engagement in early childhood is defined as a child’s level of participation with the environment. Engagement is an important construct in assessment and intervention of social and early learning competence given its link to school achievement. Few tools exist to assess engagement of young children in early education, and there is a need for a systematic direct observation tool that can be applied universally (e.g., with all young children) in these settings. This article describes preliminary evidence of validity and reliability for the Behavioral Observation of Students in Schools–Early Education (BOSS-EE). Specifically, the article describes results from a survey of experts and practitioners in which feedback was solicited on target behaviors and operational definitions, presents reliability data (i.e., interobserver and test–retest), examines correlations with a criterion measure, and describes variability across settings, sites, and methods (i.e., video vs. in vivo). Next steps in measurement development are discussed with attention to the challenges of producing a tool that can be used in a range of early education settings with diverse groups of young children.

Download Full-text

Validity and reliability of a "simplified" version of the Taylor Complex Figure Test for the assessment of older adults with low formal education

Dementia & Neuropsychologia ◽

10.1590/s1980-57642016dn10100010 ◽

2016 ◽

Vol 10 (1) ◽

pp. 52-57 ◽

Cited By ~ 6

Author(s):

Jonas Jardim de Paula ◽

Mônica Vieira Costa ◽

Giovanna de Freitas de Andrade ◽

Rafaela Teixeira Ávila ◽

Leandro Fernandes Malloy-Diniz

Keyword(s):

Older Adults ◽

Formal Education ◽

Educational Background ◽

Preliminary Evidence ◽

Validity And Reliability ◽

Significant Group ◽

Neuropsychological Measures ◽

Visuospatial Abilities ◽

Complex Figure ◽

Low Educated

Objective : The assessment of visuospatial abilities and memory using tasks such as the Taylor Complex Figure Task (TCFT) is biased for older adults with low formal education. We devised a "Simplified" version of the TCFT designed to assess older adults with low educational background and provide preliminary evidence of its psychometric properties. Methods : We evaluated a heterogeneous sample of healthy older adults and patients with mild cognitive impairment and Alzheimer's disease dementia using the simplified TCFT and other neuropsychological measures. Results : Our results suggest that the test copy, immediate and delayed recall have high inter-rater agreement and internal consistency, significant correlations with other tests of visuospatial abilities, memory and intelligence, and also detected significant group differences between controls and patients. Conclusion : Our study presents a new measure for assessing low-educated elderly with promising evidence of validity and reliability.

Download Full-text

Inter-Agency Communication and Operations Capabilities during a Hospital Functional Exercise: Reliability and Validity of a Measurement Tool

Prehospital and Disaster Medicine ◽

10.1017/s1049023x00007664 ◽

2010 ◽

Vol 25 (1) ◽

pp. 52-58 ◽

Cited By ~ 3

Author(s):

Elena Savoia ◽

Paul D. Biddinger ◽

Jon Burstein ◽

Michael A. Stoto

Keyword(s):

Assessment Tool ◽

Reliability And Validity ◽

Preliminary Evidence ◽

Measurement Tool ◽

Rater Agreement ◽

Validity And Reliability ◽

The Public ◽

External Evaluators ◽

Functional Exercise ◽

Qualitative Performance

AbstractIntroduction:As proxies for actual emergencies, drills and exercises can raise awareness, stimulate improvements in planning and training, and provide an opportunity to examine how different components of the public health system would combine to respond to a challenge. Despite these benefits, there remains a substantial need for widely accepted and prospectively validated tools to evaluate agencies' and hospitals' performance during such events. Unfortunately, to date, few studies have focused on addressing this need. The purpose of this study was to assess the validity and reliability of a qualitative performance assessment tool designed to measure hospitals' communication and operational capabilities during a functional exercise.Methods:The study population included 154 hospital personnel representing nine hospitals that participated in a functional exercise in Massachusetts in June 2008. A 25-item questionnaire was developed to assess the following three hospital functional capabilities: (1) inter-agency communication; (2) communication with the public; and (3) disaster operations. Analyses were conducted to examine internal consistency, associations among scales, the empirical structure of the items, and inter-rater agreement.Results:Twenty-two questions were retained in the final instrument, which demonstrated reliability with alpha coefficients of 0.83 or higher for all scales. A three-factor solution from the principal components analysis accounted for 57% of the total variance, and the factor structure was consistent with the original hypothesized domains. Inter-rater agreement between participants' self-reported scores and external evaluators' scores ranged from moderate to good.Conclusions:The resulting 22-item performance measurement tool reliably measured hospital capabilities in a functional exercise setting, with preliminary evidence of concurrent and criterion-related validity.

Download Full-text

Assessing severity of epilepsy in children: Preliminary evidence of validity and reliability of a single-item scale

Epilepsy & Behavior ◽

10.1016/j.yebeh.2008.05.001 ◽

2008 ◽

Vol 13 (2) ◽

pp. 337-342 ◽

Cited By ~ 46

Author(s):

Kathy N. Speechley ◽

Xuelian Sang ◽

Simon Levin ◽

Guang Yong Zou ◽

Michael Eliasziw ◽

...

Keyword(s):

Preliminary Evidence ◽

Validity And Reliability ◽

Single Item ◽

Item Scale

Download Full-text

Psychometric Properties of the Academic Encouragement Scale in Chinese University Students

Journal of Psychoeducational Assessment ◽

10.1177/0734282920966821 ◽

2020 ◽

pp. 073428292096682

Author(s):

Hui Tang ◽

Zhongkai Huo ◽

Chaojie Liu ◽

Zhijun Liu ◽

Y. Joel Wong

Keyword(s):

University Students ◽

Factor Structure ◽

Preliminary Evidence ◽

Validity And Reliability ◽

Academic Context ◽

Structure Reliability ◽

Chinese University ◽

Two Factors ◽

Good Internal Consistency ◽

Test Retest Reliability

This study tested the factor structure, reliability, and criterion validity of the Academic Encouragement Scale (AES) in 690 university students in China. The AES displayed good internal consistency and test–retest reliability. The data provided evidence supporting a two-factor structure: challenge focused encouragement (CFE) and potential focused encouragement (PFE). The two factors were independent predictors of academic engagement. Hope was positively linked with PFE but not with CFE. By contrast, gratitude was positively correlated with CFE but not with PFE. The findings provide preliminary evidence to support the validity and reliability of the AES in an academic context in China.

Download Full-text

The Revised Conflict Tactics Scales (CTS2)

Journal of Family Issues ◽

10.1177/019251396017003001 ◽

1996 ◽

Vol 17 (3) ◽

pp. 283-316 ◽

Cited By ~ 3743

Author(s):

MURRAY A. STRAUS ◽

SHERRY L. HAMBY ◽

SUE BONEY-McCOY ◽

DAVID B. SUGARMAN

Keyword(s):

Content Validity ◽

Sexual Coercion ◽

Preliminary Evidence ◽

Physical Injury ◽

Validity And Reliability ◽

Response Sets ◽

Conflict Tactics Scales ◽

Conflict Tactics ◽

Revised Conflict Tactics Scales ◽

Dating Relationship

This article describes a revised Conflict Tactics Scales (the CTS2) to measure psychological and physical attacks on a partner in a marital, cohabiting, or dating relationship; and also use of negotiation. The CTS2 has (a) additional items to enhance content validity and reliability; (b) revised wording to increase clarity and specificity; (c) better differentiation between minor and severe levels of each scale; (d) new scales to measure sexual coercion and physical injury; and (e) a new format to simplify administration and reduce response sets. Reliability ranges from .79 to .95. There is preliminary evidence of construct validity.

Download Full-text

Development and validation of traditional & complementary medicine (TCM) scales for nurses: Using structural equation modelling (SEM)

BMC Complementary and Alternative Medicine ◽

10.1186/s12906-019-2733-z ◽

2019 ◽

Vol 19 (1) ◽

Cited By ~ 1

Author(s):

Hsiao-Yun Chang ◽

Chia-Lun Lo ◽

Yun-Ying Hung

Keyword(s):

Structural Equation ◽

Communicative Competence ◽

Preliminary Evidence ◽

Validity And Reliability ◽

Online Questionnaire ◽

Chi Square ◽

Convenience Sample ◽

Practice Nurses ◽

Convergent And Divergent Validity ◽

Development And Validation

Abstract Objectives This study aimed to develop and validate scales to assess attitudes towards patient’ s use of TCM (APUTCM) and to measure a communicative competence in TCM (CCTCM) among nurses. Methods The instrument development process was conducted from Sep 2013 to Jul 2014, using the following steps: 1) item development; 2) internal review and refinement; 3) face and content validation; 4) instrument administration to a development sample; and 5) evaluation of validity and reliability. A convenience sample was used to recruit registered and advanced practice nurses who worked in different regions throughout Taiwan. A total of 755 respondents completed the online questionnaire. Statistical analyses were performed using the software of SPSS Version 21.0 and Analysis of Moment Structures (AMOS) version 24.0. Results The scale-level indexes (S-CVI) of content validity for both scales were over 80%. The reliabilities for the 13-item APUTCM scale and for the five-item CCTCM scale were 0.88 and 0.84, respectively. The model suitability for both scales was assessed, and the findings revealed suitable parameters for all indicators: GFI = 0.954, AGFI = 0.932, CFI = 0.959, RMSEA = 0.62, and chi-square/df = 3.891 for APUTCM; and GFI = 0.992, AGFI = 0.969, CFI = 0.992, RMSEA = 0.63, and chi-square/df = 4.04 for CCTCM. The convergent and divergent validity of scores on both scales provided evidence in the expected direction. Conclusion This scale development study provides preliminary evidence that suggests that the 13-item APUTCM and the five-item CCTCM are reliable and valid scales for assessing attitudes toward patient’s TCM use and communicative competence in TCM.

Download Full-text