A Critical Examination of the Internal Consistency of Competencies Assessed Across Multiple Methods

2011 ◽  
Vol 4 ◽  
pp. 11-19 ◽  
Author(s):  
Paul Englert ◽  
Duncan J. R. Jackson ◽  
Marco van Gelderen
Keyword(s):  
Performance Management ◽  
Internal Consistency ◽  
Resource Selection ◽  
Behavioral Assessment ◽  
Measurement Properties ◽  
Critical Examination ◽  
Employment Decisions ◽  
Semantic Framework ◽  
Study Results ◽  
Competency Models

AbstractCompetency models represent a popular concept that is widely applied in such areas as human resource selection, performance management, employee development, and job analysis. Despite widespread popularity and applied use, little is known about the measurement properties of competencies and whether they can reasonably be used to provide meaningful feedback or as a basis for employment decisions. The present study evaluated the internal consistency of multimethod competency scores obtained from a developmental assessment centre. A total of 214 managers participated in this study. Results suggested that there was virtually no support for the idea that multimethod-derived competencies could be regarded as meaningful, internally consistent, underlying characteristics. The article argues that competency models that employ multimethod approaches merely provide a semantic framework for conveying the complexity of a person specification, a framework which is qualitative not quantitative. These findings are discussed in relation to their implications for behavioral assessment in employment.

scholarly journals Measuring Subjective Sleep Quality: A Review

2021 ◽  
Vol 18 (3) ◽  
pp. 1082
Author(s):  
Marco Fabbri ◽  
Alessia Beracci ◽  
Monica Martoni ◽  
Debora Meneo ◽  
Lorenzo Tonetti ◽  
...  
Keyword(s):  
Construct Validity ◽  
Sleep Quality ◽  
Psychometric Properties ◽  
Internal Consistency ◽  
Self Report ◽  
Measurement Properties ◽  
Poor Sleep ◽  
Daily Routine ◽  
Factorial Structure ◽  
Poor Sleep Quality

Sleep quality is an important clinical construct since it is increasingly common for people to complain about poor sleep quality and its impact on daytime functioning. Moreover, poor sleep quality can be an important symptom of many sleep and medical disorders. However, objective measures of sleep quality, such as polysomnography, are not readily available to most clinicians in their daily routine, and are expensive, time-consuming, and impractical for epidemiological and research studies., Several self-report questionnaires have, however, been developed. The present review aims to address their psychometric properties, construct validity, and factorial structure while presenting, comparing, and discussing the measurement properties of these sleep quality questionnaires. A systematic literature search, from 2008 to 2020, was performed using the electronic databases PubMed and Scopus, with predefined search terms. In total, 49 articles were analyzed from the 5734 articles found. The psychometric properties and factor structure of the following are reported: Pittsburgh Sleep Quality Index (PSQI), Athens Insomnia Scale (AIS), Insomnia Severity Index (ISI), Mini-Sleep Questionnaire (MSQ), Jenkins Sleep Scale (JSS), Leeds Sleep Evaluation Questionnaire (LSEQ), SLEEP-50 Questionnaire, and Epworth Sleepiness Scale (ESS). As the most frequently used subjective measurement of sleep quality, the PSQI reported good internal reliability and validity; however, different factorial structures were found in a variety of samples, casting doubt on the usefulness of total score in detecting poor and good sleepers. The sleep disorder scales (AIS, ISI, MSQ, JSS, LSEQ and SLEEP-50) reported good psychometric properties; nevertheless, AIS and ISI reported a variety of factorial models whereas LSEQ and SLEEP-50 appeared to be less useful for epidemiological and research settings due to the length of the questionnaires and their scoring. The MSQ and JSS seemed to be inexpensive and easy to administer, complete, and score, but further validation studies are needed. Finally, the ESS had good internal consistency and construct validity, while the main challenges were in its factorial structure, known-group difference and estimation of reliable cut-offs. Overall, the self-report questionnaires assessing sleep quality from different perspectives have good psychometric properties, with high internal consistency and test-retest reliability, as well as convergent/divergent validity with sleep, psychological, and socio-demographic variables. However, a clear definition of the factor model underlying the tools is recommended and reliable cut-off values should be indicated in order for clinicians to discriminate poor and good sleepers.

scholarly journals Citizenship matters: Translating and adapting the Citizenship Measure to Norwegian

2021 ◽  
pp. 145507252110186
Author(s):  
Linda Nesse ◽  
Marianne Thorsen Gonzalez ◽  
Michael Rowe ◽  
Ruth Kjærsti Raanaas
Keyword(s):  
Internal Consistency ◽  
Convergent Validity ◽  
Mental Health Problems ◽  
Supported Housing ◽  
Measurement Properties ◽  
Convenience Sample ◽  
Marginalised Groups ◽  
Two Factors ◽  
Back Translation ◽  
High Internal Consistency

Citizenship is considered intertwined with recovery, and may be a useful perspective for advancing quality of life among marginalised groups. Yet, matters of citizenship among persons with co-occurring substance use and mental health problems both in research and practice. Aims: In order to measure citizenship among persons with co-occurring problems in a Norwegian study, a measure of citizenship was translated from English to Norwegian. The aims of the study were to 1) translate and adapt the Citizenship Measure, developed by Rowe and colleagues at the Yale Program for Recovery and Community Health, to Norwegian, and 2) to assess the internal consistency and convergent validity of the Norwegian translated measure. Methods: The translation process was carried out using forward and back translation procedures. To examine measurement properties, a convenience sample of 104 residents with co-occurring problems living in supported housing completed the measure. Results: Two factors were identified, related to rights, and to relational citizenship. The Norwegian translation of the Citizenship Measure showed has high internal consistency and adequate convergent validity. Conclusions: We argue that the measure can be useful in assessing perceived citizenship, and in initiating efforts to support citizenship among persons with co-occurring problems.

scholarly journals Psychometric Testing of the Spanish Modified Version of the Mini-Suffering State Examination

2021 ◽  
Vol 18 (15) ◽  
pp. 7821
Author(s):  
Daniel Gutiérrez-Sánchez ◽  
Rafael Gómez-García ◽  
Isabel María López-Medina ◽  
Antonio I. Cuesta-Vargas
Keyword(s):  
Internal Consistency ◽  
Content Validity ◽  
Convergent Validity ◽  
Informal Caregivers ◽  
Psychometric Testing ◽  
Spanish Version ◽  
Measurement Properties ◽  
Quality Of Dying ◽  
State Examination

Background: The mini-suffering state examination is a valid and reliable measure that have been used to assess suffering in patients with advanced cancer. The aim of this study was to carry out a psychometric analysis of the Spanish version of the mini-suffering state examination. Method: A validation study was conducted. Seventy-two informal caregivers of deceased patients in palliative care were included in this study. A psychometric testing of content validity, internal consistency, and convergent validity with the Spanish version of the quality of dying and death questionnaire was performed. Results: The original instrument was modified to be used by informal caregivers. The content validity was acceptable (0.96), and the internal consistency was moderate (α = 0.67). Convergent validity was demonstrated (r = −0.64). Conclusion: The Spanish modified version of the MSSE showed satisfactory measurement properties. The Spanish modified version of MSSE can be useful to facilitate screening, monitor progress, and guide treatment decisions in end-of-life cancer patients.

scholarly journals The Impact of performance management on improving human resources management’s elements at Al Hikmah Pharmaceutical Company (Public shareholding)

2021 ◽  
Vol 10 (2) ◽  
pp. 415-425
Author(s):  
Mah’d Hussein Abu Joma
Keyword(s):  
Human Resources ◽  
Performance Management ◽  
Pharmaceutical Company ◽  
Task Performance ◽  
Human Resources Management ◽  
Contextual Performance ◽  
Study Data ◽  
Study Results ◽  
Management Factors ◽  
The Impact

The study aimed to identify the impact of Performance management’s dimensions (Task performance & Contextual performance) on improving human resources management’s elements in Al Hikmah Pharmaceutical Company. The study sample consisted of the employees working of Al Hikmah Pharmaceutical Company where 302 questionnaires were distributed to the employees working in in the company in Jordan; (12) questionnaires were excluded because they were not valid for analysis. The study used the descriptive analytical method. The study data was collected through a specially designed questionnaire for this purpose. The results of the study showed that the performance management factors (Task performance & Contextual performance) factors in Al Hikmah pharmaceutical company, the values of their arithmetic averages ranged between (3.675- 4.149) and according to the adopted scale, all these values are (high), which confirms the presence of a high impact of both performance management factors on all factors of human resources management in Al hikmah company. The study also showed that there is a discrepancy in the amount of the impact of performance management factors on the stages of human resources management’s elements, as follows: 1-The training and development. factor came first, 2-The organizational culture. factor came second, 3-The evaluate performance factor came third. Human resources management’s elements have been influenced to a lesser extent by the performance management factors. Based on the study results, researcher recommended the necessity of adapting Performance management by administration's leaders so as to develop the human resources department’s elements in the company because this contributes to raise productivity of it, which also means bigger market share, better revenues, best quality, then driving organization to achieve its goals.

Popularity of Competency Models

2021 ◽  
pp. 1-17
Keyword(s):  
Knowledge Management ◽  
Competitive Advantage ◽  
Performance Management ◽  
Employee Development ◽  
Organizational Systems ◽  
Organizational Capability ◽  
Competency Models ◽  
Competency Based ◽  
Performance System ◽  
Use Of Knowledge

Competency models are prevalent within various industries in business. Their popularity is due to the value they add to employee development and organizational capability. The popularity of competency models and specifically competency-based approaches are covered in this chapter. Competence-based approaches and how businesses in the market use them for gaining and maintaining a competitive advantage are also covered. How competency-based approaches have evolved into a new area of performance management that allows businesses to integrate existing organizational systems into a single performance system where they make more use of knowledge and become knowledge management organizations through competency that is modeled in their business is also covered. The chapter sets the tone of the book.

Measurement properties of the Physical Literacy Assessment for Youth (PLAY) Tools

2020 ◽  
Author(s):  
Hilary Ann Toccacelli Caldwell ◽  
Natascja A Di Cristofaro ◽  
John Cairney ◽  
Steven R Bray ◽  
Brian W. Timmons
Keyword(s):  
Internal Consistency ◽  
Convergent Validity ◽  
Measurement Properties ◽  
School Age Children ◽  
School Age ◽  
Literacy Assessment ◽  
Physical Literacy ◽  
Rater Reliability ◽  
Method Of Evaluation ◽  
Acceptable Internal Consistency

The Physical Literacy Assessment for Youth (PLAY) Tools are a suite of tools to assess an individual’s physical literacy. The purpose of this study is to examine the psychometric properties of the PLAY Tools, including inter-rater reliability, internal consistency, validity and the associations between the tools. In this study, 218 children and youth (8.4- to- 13.7-years old) and a parent/ guardian completed the appropriate physical literacy assessments (i.e., PLAYbasic, PLAYfun, PLAYparent and PLAYself) and the Bruiniks-Oseretsky Test of Motor Proficiency (BOT-2). Inter-rater reliability for PLAYfun was excellent (ICC=0.94). The PLAYbasic, PLAYfun total, running and object control scores, and PLAYparent motor competence domain were higher in males than females, and PLAYfun locomotor skills were lower in males than females (p<0.05). Age was positively correlated with PLAYbasic and PLAYfun (r=0.14-0.32, p<0.05). BOT-2 was positively correlated with PLAYfun and PLAYbasic (r=0.19-0.59, p<0.05). PLAYbasic is a significant predictor of PLAYfun (R<sup>2</sup>=0.742, p<0.001). PLAYfun, PLAYparent and PLAYself were moderately correlated with one another. PLAYfun, PLAYparent and PLAYself demonstrated acceptable internal consistency (α=0.74-0.87, ω=0.73-0.87). The PLAY Tools demonstrated moderate associations between one another, strong inter-rater reliability and good construct and convergent validity. Continued evaluation of these tools with other populations, such as adolescents, is necessary. •In school-age children, the PLAY Tools demonstrated strong inter-rater reliability, moderate associations with one another, acceptable internal consistency and good construct and convergent validity.•The results suggest that that PLAY Tools are an acceptable method of evaluation for physical literacy in school-age children.

scholarly journals Anterior cruciate ligament—return to sport after injury scale: validation of the Norwegian language version

2020 ◽  
Vol 28 (8) ◽  
pp. 2634-2643 ◽  
Author(s):  
Anne Gro Heyn Faleide ◽  
Eivind Inderhaug ◽  
Willemijn Vervaat ◽  
Kyrre Breivik ◽  
Bård Erik Bogen ◽  
...  
Keyword(s):  
Anterior Cruciate Ligament ◽  
Measurement Error ◽  
Internal Consistency ◽  
Cruciate Ligament ◽  
Return To Sport ◽  
Measurement Properties ◽  
Factor Analyses ◽  
Sum Score ◽  
Anterior Cruciate ◽  
Test Retest Reliability

Abstract Purpose Evidence is emerging on the importance of psychological readiness to return to sport after anterior cruciate ligament (ACL) reconstruction. The ACL-Return to Sport after Injury scale (ACL-RSI) is developed to assess this. The aim of the current study was to translate ACL-RSI into Norwegian and examine the measurement properties of the Norwegian version (ACL-RSI-No). Methods ACL-RSI was translated according to international guidelines. A cohort of 197 ACL-reconstructed patients completed ACL-RSI-No and related questionnaires nine months post-surgery. One hundred and forty-six patients completed hop tests and 142 patients completed strength tests. Face and structural validity (confirmative factor analysis and explorative analyses), internal consistency [Cronbach’s alpha (α)], test–retest reliability [Intraclass Correlation Coefficients (ICC)], measurement error [Standard error of measurement (SEM) and smallest detectable change at individual (SDCind) and group level (SDCgroup)] and construct validity (hypotheses testing; independent t tests, Pearson’s r) were examined. Results ACL-RSI-No had good face validity. Factor analyses suggested that the use of a sum score is reasonable. Internal consistency and test–retest reliability were good (α 0.95, ICC 0.94 (95% CI 0.84–0.97) and measurement error low (SEM 5.7). SDCind was 15.8 points and SDCgroup was 2.0. Six of seven hypotheses were confirmed. Conclusions ACL-RSI-No displayed good measurement properties. Factor analyses suggested one underlying explanatory factor for “psychological readiness”—supporting the use of a single sum score. ACL-RSI-No can be used in the evaluation of psychological readiness to return to sport after ACL injury. Level of evidence III.

scholarly journals The Influence of Nursing Care on Pregnancy and Labour

2015 ◽  
Vol 124 (4) ◽  
pp. 195-198
Author(s):  
Joanna Kozłowiec ◽  
Monika Kozłowiec ◽  
Piotr Książek
Keyword(s):  
Performance Management ◽  
Quality Care ◽  
Professional Role ◽  
Point Of View ◽  
Information Support ◽  
Obstetrics And Gynaecology ◽  
Care Assessment ◽  
Study Results ◽  
Nurses And Midwives

Abstract Introduction. Performance management is a crucial concept in the broader field of human resource management. In accordance with its principles, in defining a professional role, its aim must be included. In addition, key results areas and crucial competencies must be stated. The professional role of a nurse with regard to pregnancy and pre-natal care, is defined by way of the set of functions fulfilled. The role of a midwife and her competencies are, however, in this situation, much broader. Aim. The aim of the conducted research was to determine the roles played by both nursing and midwifery staff in ensuring a healthy pregnancy and delivery by way of their patients' assessment. Material and methods. The research was conducted in the Obstetrics and Gynaecology unit, in the Regional Specialist Hospital in Biała Podlaska, and it involved 40 pregnant women. Results and discussion. Our study reveals that what the subject women need the most from the nursing and midwifery staff, is emotional support. What is more, the dominant majority connects their expectations as to the fulfilment of the roles played by nursing and midwifery staff to an increase in information support. Conclusion. The obtained results allow a defining of the aim of the professional roles of nurses and midwives in supporting and assisting the pregnant, as well as identifying their key results areas and crucial competencies from the patients' point of view. In comparing our own study results to that involving patients' opinions (gained by way of a study conducted in the obstetrics and gynaecology unit, by the quality care assessment section of the Regional Specialist Hospital in Biała Podlaska), it can be stated that there is continuous positive growth in the quality of service provided by nurses and midwives.

scholarly journals Rasch Analysis Supports the Use of the Pain Self-Efficacy Questionnaire

2014 ◽  
Vol 94 (1) ◽  
pp. 91-100 ◽  
Author(s):  
Flavia Di Pietro ◽  
Mark J. Catley ◽  
James H. McAuley ◽  
Luke Parkitny ◽  
Christopher G. Maher ◽  
...  
Keyword(s):  
Low Back Pain ◽  
Back Pain ◽  
Pain Intensity ◽  
Internal Consistency ◽  
Self Efficacy ◽  
Rasch Analysis ◽  
Item Bias ◽  
Measurement Properties ◽  
Low Back ◽  
Pain Duration

Background The Pain Self-Efficacy Questionnaire (PSEQ) is used by physical therapists in clinical practice and in research. However, current understanding of the PSEQ's measurement properties is incomplete, and investigators cannot be confident that it provides unbiased information on patient self-efficacy. Objective The aims of this study were: (1) to investigate the scale properties of the PSEQ using Rasch analysis and (2) to determine whether age, sex, pain intensity, pain duration, and pain-related disability bias function of the PSEQ. Design This was a retrospective study; data were obtained from 3 existing studies. Methods Data were combined from more than 600 patients with low back pain of varying duration. Rasch analysis was used to evaluate targeting, category ordering, unidimensionality, person fit, internal consistency, and item bias. Results There was evidence of adequate category ordering, unidimensionality, and internal consistency of the PSEQ. Importantly, there was no evidence of item bias. Limitations The PSEQ did not adequately target the sample; instead, it targeted people with lower self-efficacy than this population. Item 7 was hardest for participants to endorse, showing excessive positive misfit to the Rasch model. Response strings of misfitting persons revealed older participants and those reporting high levels of disability. Conclusions The individual items of the PSEQ can be validly summed to provide a score of self-efficacy that is robust to age, sex, pain intensity, pain duration, and disability. Although item 7 is the most problematic, it may provide important clinical information and requires further investigation before its exclusion. Although the PSEQ is commonly used with people with low back pain, of whom the sample in this study was representative, the results suggest it targets patients with lower self-efficacy than that observed in the current sample.

Sign in / Sign up

Export Citation Format

Share Document