scholarly journals EVALUATION OF CLINICAL EFFICIENCY OF FOUR SCALES OF THE MODIFIED VERSION OF THE NEUROTIC DISORDERS QUESTIONNAIRE

2021 ◽  
Vol 19 (1) ◽  
pp. 85-90
Author(s):  
L. I. Tsidik ◽  
Keyword(s):  
Correlation Analysis ◽  
Roc Analysis ◽  
Rating Scale ◽  
Classical Test Theory ◽  
Clinical Effectiveness ◽  
Test Theory ◽  
Neurotic Disorders ◽  
Scale Modeling ◽  
Standardized Residuals ◽  
Hamilton Anxiety Rating Scale

The neurotic disorders questionnaire was originally created on the basis of the classical test theory and does not meet the requirements of modern psychometrics. Within the framework of our research, this technique has been modified and consists of 13 scales, the psychometric analysis of which included all the technical stages of iterative analysis and scale modeling based on the Rush metric system. This article presents the results of clinical validation of four of them. Purpose of the study. To assess the clinical effectiveness of the scales of coping deficit, anankasticity, the scale of impulsivity and addictive reactions, as well as the scale of general personal disorganization of the modified version of the questionnaire of neurotic disorders. Material and methods. 296 people were examined. Among them, 167 are women and 129 are men. Statistical methods of the study are factor analysis of standardized residuals, ROC analysis, correlation analysis. Results: The studied scales are homogeneous in their structure. Using the ROC-analysis, high and moderate differentiating properties of the scales were revealed, cutoff values were calculated, which were the criteria for interpretation. Correlation analysis of the total indicator revealed statistically significant correlations between the studied scales and the MMPI scores, the QIDS-SR16 questionnaire, and the Hamilton Anxiety Rating Scale (HADS). Conclusions: The scales of coping deficit, anankasticity, the scale of impulsivity and addictive reactions, as well as the scale of general personal disorganization of the modified version of the neurotic disorders questionnaire are clinically valid and can be used to solve various practical problems.

scholarly journals CLINICAL VALIDATION OF THE SCALES OF EXPANSIVENESS, RESTRICTIVE CONTROL, CORRECTION AND PHOBIC FEARS OF THE MODIFIED VARIANT OF THE NEUROTIC DISORDERS QUESTIONNAIRE

2020 ◽  
Vol 18 (6) ◽  
pp. 681-686
Author(s):  
L. I. Tsidik ◽  
Keyword(s):  
Factor Analysis ◽  
Correlation Analysis ◽  
Roc Analysis ◽  
Rating Scale ◽  
Clinical Effectiveness ◽  
Test Theory ◽  
Clinical Validation ◽  
Neurotic Disorders ◽  
Standardized Residuals ◽  
Hamilton Anxiety Rating Scale

Background. On the basis of the statements of the questionnaire of neurotic disorders within the framework of the Rush model, which is a kind of modern test theory, 13 scales with proven psychometric properties were formed. This article evaluates the clinical effectiveness of four of them. Purpose of the study. To carry out clinical validation of scales of expansiveness, restrictive control, correction and phobic fears of the modified version of the neurotic disorders questionnaire. Material and methods. A total of 296 people were examined, among them 167 women and 129 men. Statistical methods of research included factor analysis of standardized residuals, ROC-analysis, and correlation analysis. Results. The scales under study have a homogeneous structure. With the help of ROC-analysis, moderate differentiating properties of the scales were revealed, and cutoff values were calculated, which were the criteria for interpretation. Correlation analysis of the total indicator revealed statistically significant correlations between the studied scales and the MMPI scores, the QIDS-SR16 questionnaire and the Hamilton Anxiety Rating Scale (HADS). Conclusions. The scales of expansiveness, restrictive control, correction and phobic fears of the modified version of the neurotic disorders questionnaire are clinically valid and can be used to solve various practical problems.

scholarly journals Clinical validation of the scales of depression, neuroticism, somatization, personal anxiety and validity of the modified questionnaire for neurotic disorders

2021 ◽  
Vol 55 (2) ◽  
pp. 73-82
Author(s):  
L. I. Tsydzik
Keyword(s):  
Correlation Analysis ◽  
Roc Analysis ◽  
New Technologies ◽  
Correlation Coefficients ◽  
Roc Curves ◽  
Measurement Model ◽  
Test Theory ◽  
Clinical Validation ◽  
Neurotic Disorders ◽  
Personal Anxiety

The classical theory of tests, in the framework of which a questionnaire for neurotic disorders was created, does not meet the requirements of modern psychometrics. In this regard, it became necessary to use new technologies for its modification and effective use in the clinic. The Rush metric system, a variation of modern test theory, is the only measurement model that meets the criteria for a joint additive measurement. On the basis of the claims of the questionnaire for neurotic disorders, 13 scales with proven psychometric characteristics were formed in the framework of the Rush model. This article evaluated the clinical efficacy of five of them.The purpose of the study: to conduct clinical validation of the scales of depression, neuroticism, somatization, personal anxiety and validity of the modified version of the questionnaire for neurotic disorders.Materials and Methods: the sample consisted of research data from a group of subjects in the amount of 296 people. Among them, 167 women and 129 men. Statistical methods of work—factor analysis of standardized residuals, ROC analysis, correlation analysis of the total indicator.Results: 1. the points of each investigated scale characterize various aspects of one construct, that is, the scales are homogeneous; 2. through ROC analysis, high diagnostic properties of the scales were identified and cut-off values for each scale were calculated, which were the criteria for interpretation; 3. the criterion validity of the studied scales is statistically significantly higher or not different from the validity of the well-known questionnaires, which are the «gold standard» of measurement, which demonstrated a statistical comparison of their ROC curves; 4. the correlation analysis of the total indicator revealed statistically significant (p <0.05) correlation coefficients of the scales of the modified questionnaire among themselves, as well as with the assessments according to the MMPI scales, QIDS-SR16 questionnaire and the Hamilton anxiety score scale (HADS).Conclusion: the scales of depression, neuroticism, somatization, personal anxiety and validity of the modified version of the neurotic disorders questionnaire are clinically valid, and therefore, can be used to solve various practical problems in psychodiagnostics.

Psychometric evaluation of the Relative Mastery Scale: An Occupational Adaptation instrument

2021 ◽  
pp. 153944922110608
Author(s):  
Lorrie George-Paschal ◽  
Nancy E. Krusen ◽  
Chia-Wei Fan
Keyword(s):  
Rating Scale ◽  
Classical Test Theory ◽  
Correlation Coefficients ◽  
Measurement Model ◽  
Community Dwelling ◽  
Test Theory ◽  
Partial Credit Model ◽  
Validity And Reliability ◽  
Occupational Adaptation ◽  
Scale Properties

This study evaluated the psychometric properties of the Relative Mastery Scale (RMS). Valid and reliable client-centered instruments support practice in value-based health care and community-based settings. Participants were 368 community-dwelling adults aged 18 to 95 years. Researchers conducted validity and reliability examinations of the RMS using classical test theory and Rasch measurement model. A partial credit model allowed exploration of individual scale properties. Spearman’s correlation coefficients between items were statistically significant at the .01 level. Cronbach’s alpha coefficient was .94 showing strong internal consistency. In exploratory factor analysis, Factor 1 accounted for 71% of variance with an eigenvalue of 4.26. In Rasch analysis, the 5-point rating scale demonstrated adequate functioning, confirmed unidimensionality, and person/item separation. The RMS instrument demonstrates sound psychometric characteristics. A valid and reliable measure of internal occupational adaptation supports application to monitor progress of internal occupational adaptation across a variety of individuals.

scholarly journals Validation of the Spanish adaptation of the School Atitude Assessment Survey-Revised using multidimensional Rasch analysis

2016 ◽  
Vol 33 (1) ◽  
pp. 74 ◽  
Author(s):  
Alejandro Veas ◽  
Juan Luis Castejón ◽  
Raquel Gilar ◽  
Pablo Miñano
Keyword(s):  
Rasch Model ◽  
Rasch Analysis ◽  
Rating Scale ◽  
Item Difficulty ◽  
Classical Test Theory ◽  
Latent Trait ◽  
Principal Component ◽  
Analysis Data ◽  
Test Theory ◽  
Assessment Survey

<p>The School Attitude Assessment Survey-Revised (SAAS-R) was developed by McCoach &amp; Siegle (2003b) and validated in Spain by Author (2014) using Classical Test Theory. The objective of the current research is to validate SAAS-R using multidimensional Rasch analysis. Data were collected from 1398 students attending different high schools. Principal Component Analysis supported the multidimensional SAAS-R. The item difficulty and person ability were calibrated along the same latent trait scale. 10 items were removed from the scale due to misfit with the Rasch model. Differential Item Functioning revealed no significant differences across gender for the remaining 25 items. The 7-category rating scale structure did not function well, and the subscale goal valuation obtained low reliability values. The multidimensional Rasch model supported 25 item-scale SAAS-R measures from five latent factors. Therefore, the advantages of multidimensional Rasch analysis are demonstrated in this study.</p>

Evaluation Properties of the Chinese Version of the Caring Factor Survey-Caring of Manager According to Classical Test Theory and Item Response Theory

2019 ◽  
Vol 23 (4) ◽  
pp. 275-283
Author(s):  
Ling Wang ◽  
John W. Nelson
Keyword(s):  
Item Response Theory ◽  
Psychometric Properties ◽  
Item Response ◽  
Rating Scale ◽  
Item Difficulty ◽  
Classical Test Theory ◽  
Chinese Version ◽  
Test Theory ◽  
Response Theory ◽  
Classical Test

The aim of the study is to evaluate psychometric properties of the Chinese version of Caring Factor Survey-Caring of Manager (CFS-CM), which evaluated by using with classical test theory (CTT) and item response theory (IRT). CTT analyses evaluate include internal consistence reliability, test–retest reliability and construct validity. IRT analyses were conducted to test the unidimensionality, item fit, item difficulty, the reliability, and rating scale analysis. CTT showed good psychometric properties of the CFS-CM. However, IRT revealed some problems of category level. Taking the above issue into consideration, it could be beneficial to perfect the CFS-CM in the future.

scholarly journals Development of the Paranormal and Supernatural Beliefs Scale using classical and modern test theory

2021 ◽  
Vol 9 (1) ◽  
Author(s):  
Charlotte E. Dean ◽  
Shazia Akhtar ◽  
Tim M. Gale ◽  
Karen Irvine ◽  
Richard Wiseman ◽  
...  
Keyword(s):  
Rating Scale ◽  
Classical Test Theory ◽  
Test Theory ◽  
Scale Model ◽  
Internal Reliability ◽  
Classical Test ◽  
Classic Test Theory ◽  
Differential Item Functioning Analysis ◽  
Supernatural Beliefs ◽  
Test Retest Reliability

Abstract Background This study describes the construction and validation of a new scale for measuring belief in paranormal phenomena. The work aims to address psychometric and conceptual shortcomings associated with existing measures of paranormal belief. The study also compares the use of classic test theory and modern test theory as methods for scale development. Method We combined novel items and amended items taken from existing scales, to produce an initial corpus of 29 items. Two hundred and thirty-one adult participants rated their level of agreement with each item using a seven-point Likert scale. Results Classical test theory methods (including exploratory factor analysis and principal components analysis) reduced the scale to 14 items and one overarching factor: Supernatural Beliefs. The factor demonstrated high internal reliability, with an excellent test–retest reliability for the total scale. Modern test theory methods (Rasch analysis using a rating scale model) reduced the scale to 13 items with a four-point response format. The Rasch scale was found to be most effective at differentiating between individuals with moderate-high levels of paranormal beliefs, and differential item functioning analysis indicated that the Rasch scale represents a valid measure of belief in paranormal phenomena. Conclusions The scale developed using modern test theory is identified as the final scale as this model allowed for in-depth analyses and refinement of the scale that was not possible using classical test theory. Results support the psychometric reliability of this new scale for assessing belief in paranormal phenomena, particularly when differentiating between individuals with higher levels of belief.

scholarly journals Using Generalizability Theory and Many-Facet Rasch Model to Evaluate In-Basket Tests for Managerial Positions

2021 ◽  
Vol 12 ◽  
Author(s):  
Guangming Li ◽  
Yuxi Pan ◽  
Weijun Wang
Keyword(s):  
Rasch Model ◽  
Rating Scale ◽  
Generalizability Theory ◽  
Classical Test Theory ◽  
Interview Data ◽  
Test Theory ◽  
Personnel Recruitment ◽  
Communication And Coordination ◽  
Chinese Company ◽  
Managerial Positions

Purpose: This study aimed to analyze interview data collected from a series of in-basket tests during managerial personnel recruitment in a local Chinese company, taking advantage of the use of combination of Generalizability theory (GT) and Many-facet Rasch Model (MFRM), rather than the Classical Test Theory (CTT).Design/Methodology/Approach: Participants included 78 candidates (Mage = 37.76, SD = 6.36; 35.9% female) interviewed for eight managerial positions in a local Chinese company. Data were collected based on a series of 10 in-basket interview tests, and a 20-item rating scale (the in-basket test rating scale; IBTRS) was developed and piloted, and five expert raters rated the participants on their performance in five aspects (planning, communication and coordination, capital operations and management, analysis and problem solving, and empowerment and controlling). The data were analyzed using a crossed design of p × i × r, where p represents person, i represents item, and r represents rater. Effects of candidate (person), test item, rater, and the interaction of item and rater were examined.Findings: The use of the combination of GT and MFRM was able to provide accurate, comprehensive information over the process of in-basket interview tests. Specifically, GT analysis showed good generalization coefficient and reliability index (0.893 and 0.871, respectively), and the variation of candidates explained most of the total variance (53.22%). The candidates scored high in the dimension of empowerment and controlling. There were differences in the severity of raters. Three raters should be sufficient to ensure good scoring stability.Originality/Value: This study used the combination of GT and MFRM to assess the interview data instead of using a CTT approach.

A Comparison of the QIDS-C16, QIDS-SR16, and the MADRS in an Adult Outpatient Clinical Sample

CNS Spectrums ◽  
2010 ◽  
Vol 15 (7) ◽  
pp. 458-468 ◽  
Author(s):  
Ira H. Bernstein ◽  
A. John Rush ◽  
Diane Stegman ◽  
Laurie Macleod ◽  
Bradley Witte ◽  
...  
Keyword(s):  
Depressive Episode ◽  
Major Depressive Episode ◽  
Rating Scale ◽  
Depressive Symptomatology ◽  
Clinical Sample ◽  
Classical Test Theory ◽  
Test Theory ◽  
Self Report ◽  
Screening Tools ◽  
Major Depressive

ABSTRACTBackground: This study compared the 16-item Clinician and Self-Report versions of the Quick Inventory of Depressive Symptomatology (QIDS-C16 and QIDS-SR16) and the 10-item Montgomery-Asberg Depression Rating Scale (MADRS) in adult outpatients. The comparison was based on psychometric features and their performance in identifying those in a major depressive episode as defined by the Mini-International Neuropsychiatric Interview for Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition.Methods: Of 278 consecutive outpatients, 181 were depressed. Classical test theory, factor analysis, and item response theory were used to evaluate the psychometric features and receiver operating characteristic (ROC) analyses.Results: All three measures were unidimensional. All had acceptable reliability (coefficient α=.87 for MADRS10, .82 for QIDS-C16, and .80 for QIDS-SR16). Test information function was higher for the MADRS (ie, it was most sensitive to individual differences in levels of depression). The MADRS and QIDS-C16 slightly but consistently outperformed the QIDS-SR16 in differentiating between depressed versus non-depressed patients.Conclusion: All three measures have satisfactory psychometric properties and are valid screening tools for a major depressive episode.

The Development of Chinese Version of Transcultural Nursing Self-Efficiency Scale: Using Rasch Model Analysis

2020 ◽  
Vol 32 (1) ◽  
pp. 30-40
Author(s):  
Yi Tian ◽  
Li Wang ◽  
Yan Xu ◽  
Zhuang He
Keyword(s):  
Nursing Student ◽  
Rating Scale ◽  
Item Analysis ◽  
Classical Test Theory ◽  
Analytical Framework ◽  
Chinese Version ◽  
Test Theory ◽  
Scale Model ◽  
Transcultural Nursing ◽  
Rating Scale Model

Introduction: With the huge advances of globalization and urbanization, the nursing services in China are meeting the challenge of varied culture-specific needs in practices. Tools to measure transcultural sensitivity thus has great value in promoting transcultural nursing practices. Method: The Chinese version of Transcultural Nursing Self-Efficacy Scale (TSET-CV) was translated and validated with a sample of 2,346 nurses in China. Utilizing the analytical framework of the rating scale model, each item of the three subscales, namely the cognitive, practical, and effect subscale, was analyzed in terms of item analysis, item fitting, difficulty, reliability, item function, and validity. Results: The analysis suggested that 5-point Likert-type scale was more suitable than the 10-point Likert-type scale originally used. Item 27 and Item 79 showed deficient properties, which was deleted in the TSET-CV. The most accurate ranges measured by the TSET-CV matched the range of the distribution of the subjects’ ability. Discussion: Unlike the classical test theory, the rating scale model based on the Rasch’s model can provide sample-independent psychometric properties of items. The revised TSET-CV has great potential in diagnosing deficiency among nursing student in transcultural self-efficiency, which can promote the development of corresponding education strategies.

Rasch Analysis of the Proactive Personality Scale

2021 ◽  
pp. 003329412110281
Author(s):  
Enoch Teye-Kwadjo ◽  
Gideon P. de Bruin
Keyword(s):  
Psychometric Properties ◽  
Rasch Analysis ◽  
Rating Scale ◽  
Classical Test Theory ◽  
Internal Consistency Reliability ◽  
Proactive Personality ◽  
Test Theory ◽  
Scale Model ◽  
Personality Scale ◽  
Good Internal Consistency

The Proactive Personality Scale (PPS) is used widely to measure proactive personality. Previous research has evaluated the psychometric properties of the 6-item PPS (hereafter called PPS-6) using classical test theory. There is a need to provide further validity evidence for the PPS-6 using modern test theory. This study evaluated the psychometric properties of the PPS-6 using Rasch analysis. A total of 429 participants completed the PPS-6. Rasch rating scale model (RSM) was used to analyse the data. RSM showed that the PPS-6 fitted the Rasch model well. RSM demonstrated that the PPS-6 functioned as a unidimensional measure with good internal consistency reliability. Items on the PPS-6 did not show any noticeable differential item functioning across gender. RSM showed that the response rating scale of the PPS-6 is suitable. Results suggest that the PPS-6 is a reliable measure for the assessment of proactive personality.

Sign in / Sign up

Export Citation Format

Share Document