scholarly journals Testing the psychometric properties of a short skills inventory for students looking for their first job

2021 ◽  
Vol 9 (1) ◽  
Author(s):  
Rosa Isabel Rodrigues
Keyword(s):  
Psychometric Properties ◽  
Developmental Process ◽  
Classical Test Theory ◽  
Performance Standards ◽  
Test Theory ◽  
Business World ◽  
Professional Performance ◽  
Selection Processes ◽  
Recruitment And Selection ◽  
First Job

Abstract Background In the last two decades, the transformations that have affected the business world have had a great impact on professional performance standards. As such, they have contributed significantly to increasing concerns regarding employability. Particularly, these concerns are even more worrying among students who are looking for their first job. Consequently, this leads organizations to question whether the skills these candidates have are sufficient and adequate for them to enter the job market. Although it is a problem that deserves an urgent response, it is still poorly understood amongst academics, which is why it continues to be essential to define and signal which skills candidates should develop in order to guarantee a better person-function fit. Hereupon, the present study aims at the construction and validation of a short skills inventory for students who are looking for their first job. This inventory will allow alignment between candidates' skills and the level of performance expected by their future employers. Methods The development of the short skills inventory for students looking for their first job was based on Classical test theory and Item response theory methodologies. Specifically, its developmental process encompassed three studies. Study 1, comprising a qualitative scope, dealt with the development and construction of the items (n = 97). Study 2, of an exploratory nature, was intended to evaluate the psychometric properties of the instrument (n = 173). Finally, Study 3, of a confirmatory nature, was aimed at validating the results gathered from the Exploratory factor analysis (n = 407). Results This inventory is a valuable asset for the selection of students who are looking for their first job. The analyzes carried out over the various studies show that this instrument has satisfactory psychometric properties, and, as such, is a valid and reliable instrument and an alternative to the instruments currently used in the recruitment and selection processes. Conclusions The construction of this short skills inventory brings theoretical and practical benefits. In short, it contributes to reducing Portugal’s gap regarding psychological assessment upon selection considering the lack of validated and verified instruments for students looking for their first job.

Psychometric properties of the Mastery Scale-Chinese version: Applying classical test theory and Rasch analysis

2013 ◽  
Vol 20 (6) ◽  
pp. 404-411 ◽  
Author(s):  
Yun-Ling Chen ◽  
Ping-Chuan Hsiung ◽  
Lyinn Chung ◽  
Shing-Chia Chen ◽  
Ay-Woan Pan
Keyword(s):  
Psychometric Properties ◽  
Rasch Analysis ◽  
Classical Test Theory ◽  
Chinese Version ◽  
Test Theory ◽  
Classical Test

Item response theory

2015 ◽  
Author(s):  
David L. Streiner ◽  
Geoffrey R. Norman ◽  
John Cairney
Keyword(s):  
Item Response Theory ◽  
Psychometric Properties ◽  
Item Response ◽  
Traditional Approach ◽  
Classical Test Theory ◽  
Test Theory ◽  
Response Theory ◽  
Advantages And Disadvantages ◽  
The Past ◽  
Classical Test

Over the past few decades, there has been a revolution in the approach to scale development. Called item response theory (IRT), this approach challenges the notion that scales must be long in order to be reliable, and that psychometric properties of a scale derived from one group of people cannot be applied to different groups. This chapter provides an introduction to IRT, and discusses how it can be used to develop scales and to shorten existing scales that have been developed using the more traditional approach of classical test theory. IRT also can result in scales that have interval-level properties, unlike those derived from classical test theory. Further, it allows people to be compared to one another, even though they may have completed different items, allowing for computer-adapted testing. The chapter concludes by discussing the advantages and disadvantages of IRT.

The Development and Validation of the Cognitions of Internet Sexual Offending (C-ISO) Scale

Sexual Abuse ◽  
2019 ◽  
Vol 32 (8) ◽  
pp. 907-930 ◽  
Author(s):  
Sarah Paquette ◽  
Franca Cortoni
Keyword(s):  
Psychometric Properties ◽  
Item Response ◽  
Sexual Offending ◽  
Classical Test Theory ◽  
Test Theory ◽  
Future Research ◽  
The Internet ◽  
Sexual Activities ◽  
Sexual Offenses ◽  
Development And Validation

Tools designed to measure the cognitions of individuals who engage in sexual activities with children over the Internet are either based on knowledge about men who had committed contact sexual offenses or cognitive phenomena not specifically associated to offending behaviors. Thus, there is no validated tool specifically designed to assess the offense-supportive cognitions of men who use the Internet to sexually offend children. This study developed and validated the Cognitions of Internet Sexual Offending (C-ISO) scale. A sample of 241 men with online and contact sexual as well as with nonsexual offenses completed the C-ISO scale and its psychometric properties, and latent structure was analyzed using both Classical Test Theory (CTT) and Item Response Theory (IRT), resulting in a final version containing 31 items. The analyses indicate that the C-ISO has excellent psychometric properties and discriminates men with online sexual offenses from those with contact sexual and nonsexual offenses. Implications of the findings for clinical practice and future research are discussed.

scholarly journals The necessity of applying Rasch measurement theory in questionnaire-based public health research

2019 ◽  
Vol 29 (Supplement_4) ◽  
Author(s):  
H S Finbråten ◽  
A L Kleppang ◽  
A M Steigen
Keyword(s):  
Public Health ◽  
Psychometric Properties ◽  
Health Research ◽  
Measurement Theory ◽  
Classical Test Theory ◽  
Public Health Research ◽  
Rasch Measurement ◽  
Test Theory ◽  
Rasch Measurement Theory ◽  
Classical Test

Abstract Background Questionnaires are frequently used in public health research. In order to provide valid and reliable results to generate recommendations for practice and policies, scales with sound psychometric properties are required. Classical test theory such as factor analysis is most frequently used to assess the psychometric properties of scales. However, classical test theory may have limitations in confirming the validity of scales. Only Rasch measurement theory meet the requirements of fundamental measurement, such as additivity, invariance, sufficiency and specific objectivity. The objective is to exemplify how Rasch measurement theory can be used to evaluate the psychometric properties of a scale. Validation of the Hopkins Symptom Checklist-10 is used as an example. Methods This study is based on cross-sectional data from the Youth Data Survey. In total, 6777 adolescents responded to a web-based questionnaire. Data collection was carried out in lower and upper secondary schools in Norway during 2018. The data were analysed using the partial credit parameterization of the unidimensional Rasch model. Results Preliminary results indicated that the scale had acceptable reliability (person separation index: 0.82). However, one pair of items shows response dependence. The targeting could have been better (mean person location: -1.445). All items had ordered thresholds. Three items under-discriminated. Several items displayed differential item functioning with regard to gender and school level. Conclusions Applying Rasch measurement theory measurement problems that would go undetected using classical test theory approaches were observed. Scales used in public health research should be thoroughly validated applying Rasch measurement theory before the data are used to support claims about public health and used to provide recommendations for policy and practice. Key messages Public health practice and policy should be based on information from valid and reliable scales. Rasch measurement theory should be used to evaluate psychometric properties of scales used in public health research.

A systematic review of evidence on psychometric properties of information literacy tests

2017 ◽  
Vol 66 (6/7) ◽  
pp. 442-455
Author(s):  
Khalid Mahmood
Keyword(s):  
Systematic Review ◽  
Psychometric Properties ◽  
Information Literacy ◽  
English Language ◽  
Discriminant Validity ◽  
Classical Test Theory ◽  
Internal Consistency Reliability ◽  
Test Theory ◽  
Content Type ◽  
Properties Of Information

Purpose This paper aims to present the results of a systematic review of the evidence on psychometric properties of information literacy (IL) tests. Design/methodology/approach A two-stage search strategy was used to find relevant studies in two subject and three general databases. A descriptive review of test characteristics and psychometric properties was presented. The review included 29 studies describing psychometric properties of 18 IL tests. Findings It was found that the classical test theory was applied for all tests. However, the item response theory was also applied in three cases. Most of the psychometric tests were developed in the USA using ACRL IL competency standards. The most commonly used psychometric analyses include content validity, discriminant validity and internal consistency reliability. Research limitations/implications Only studies in English language are included in this review. Practical implications The study recommends that standards should be developed for the use and reporting of psychometric measures in designing IL tests. Librarians need to be trained in psychometric analysis of tests. Originality/value It is the first study that systematically reviewed psychometric properties of IL tests. The findings are useful for librarians who are teaching IL courses.

Psychometric properties of QuickDASH – A classical test theory and Rasch analysis study

2011 ◽  
Vol 16 (2) ◽  
pp. 177-182 ◽  
Author(s):  
Franco Franchignoni ◽  
Giorgio Ferriero ◽  
Andrea Giordano ◽  
Francesco Sartorio ◽  
Stefano Vercelli ◽  
...  
Keyword(s):  
Psychometric Properties ◽  
Rasch Analysis ◽  
Classical Test Theory ◽  
Test Theory ◽  
Analysis Study ◽  
Classical Test

scholarly journals Advanced psychometric testing on a clinical screening tool to evaluate insomnia: sleep condition indicator in patients with advanced cancer

2020 ◽  
Vol 18 (4) ◽  
pp. 343-349
Author(s):  
Chung-Ying Lin ◽  
Andy S. K. Cheng ◽  
Vida Imani ◽  
Mohsen Saffari ◽  
Maurice M. Ohayon ◽  
...  
Keyword(s):  
Psychometric Properties ◽  
Advanced Cancer ◽  
Roc Curve ◽  
Classical Test Theory ◽  
Test Theory ◽  
Operating Characteristics ◽  
Classical Test ◽  
Edmonton Symptom Assessment Scale ◽  
Sleep Condition ◽  
Condition Indicator

Abstract Purpose To examine the psychometric properties of the Sleep Condition Indicator (SCI) using different psychometric approaches [including classical test theory, Rasch models, and receiver operating characteristics (ROC) curve] among patients with advanced cancer. Methods Through convenience sampling, patients with cancer at stage III or IV (n = 859; 511 males; mean ± SD age = 67.4 ± 7.5 years) were recruited from several oncology units of university hospitals in Iran. All the participants completed the SCI, Insomnia Severity Index (ISI), Pittsburgh Sleep Quality Index (PSQI), Epworth Sleepiness Scale (ESS), Hospital Anxiety and Depression Scale (HADS), General Health Questionnaire (GHQ), and Edmonton Symptom Assessment Scale (ESAS). In addition, 491 participants wore an actigraph device to capture objective sleep. Results Classical test theory [factor loadings from confirmatory factor analysis = 0.76–0.89; test–retest reliability = 0.80–0.93] and Rasch analysis [infit mean square (MnSq) = 0.63–1.31; outfit MnSq = 0.61–1.23] both support the construct validity of the SCI. The SCI had significant associations with ISI, PSQI, ESS, HADS, GHQ, and ESAS. In addition, the SCI has satisfactory area under ROC curve (0.92) when comparing a gold standard of insomnia diagnosis. Significant differences in the actigraphy measure were found between insomniacs and non-insomniacs based on the SCI score defined by ROC. Conclusion With the promising psychometric properties shown in the SCI, healthcare providers can use this simple assessment tool to target the patients with advanced cancer who are at risk of insomnia and subsequently provide personalized care efficiently.

Evaluation Properties of the Chinese Version of the Caring Factor Survey-Caring of Manager According to Classical Test Theory and Item Response Theory

2019 ◽  
Vol 23 (4) ◽  
pp. 275-283
Author(s):  
Ling Wang ◽  
John W. Nelson
Keyword(s):  
Item Response Theory ◽  
Psychometric Properties ◽  
Item Response ◽  
Rating Scale ◽  
Item Difficulty ◽  
Classical Test Theory ◽  
Chinese Version ◽  
Test Theory ◽  
Response Theory ◽  
Classical Test

The aim of the study is to evaluate psychometric properties of the Chinese version of Caring Factor Survey-Caring of Manager (CFS-CM), which evaluated by using with classical test theory (CTT) and item response theory (IRT). CTT analyses evaluate include internal consistence reliability, test–retest reliability and construct validity. IRT analyses were conducted to test the unidimensionality, item fit, item difficulty, the reliability, and rating scale analysis. CTT showed good psychometric properties of the CFS-CM. However, IRT revealed some problems of category level. Taking the above issue into consideration, it could be beneficial to perfect the CFS-CM in the future.

Sign in / Sign up

Export Citation Format

Share Document