scholarly journals Development of the NHS Job Evaluation Tool: A Quantitative Study of Nurses in China

2021 ◽  
Author(s):  
Jing Gong ◽  
Fei Yang ◽  
Runjun He ◽  
Dan Zhang
Keyword(s):  
Evaluation System ◽  
High Reliability ◽  
Reliability And Validity ◽  
Principal Component ◽  
Public Hospitals ◽  
Job Evaluation ◽  
Evaluation Tool ◽  
High Turnover ◽  
Structural Validity ◽  
Four Dimensions

Abstract Aim: Based on the National Health Service job evaluation scheme, we aimed to construct a quality indicator for Chinese nurses.Background: Because most nurses’ low job satisfaction has led to a high turnover rate, establishing a job evaluation system that truly reflects nurses' values has become the core of Chinese nursing work reform.Methods: Based on the literature review and Delphi method, a questionnaire containing 30 items was designed. By stratified sampling, nurses from six tertiary public hospitals in Beijing were selected. We collected 701 valid questionnaires. SPSS 24.0 was used to extract factors and analyze the questionnaire’s reliability and structural validity.Results: We retained 26 factors and divided them into four dimensions: Knowledge and Skills, Responsibility, Work/Environment, and Task Characteristics according to principal component analysis. The Cronbach’s α of four dimensions ranged from 0.890 to 0.923, indicating high reliability. The Kaiser-Meyer-Olkin value was 0.960, demonstrating good structural validity. Conclusions: The improved job evaluation system has strong reliability and validity and reflects the nurse’s job characteristics scientifically. Implications for Nursing Management: Nursing managers can apply this job evaluation model to formulate nurses' performance evaluation standards to improve their comprehensive ability.

scholarly journals Development and validation of an instrument in job evaluation factors of physicians in public hospitals in Beijing, China

PLoS ONE ◽  
2021 ◽  
Vol 16 (1) ◽  
pp. e0244584
Author(s):  
Dan Zhang ◽  
Meixia Liao ◽  
Pusheng Wang ◽  
Herng-Chia Chiu
Keyword(s):  
Principal Component Analysis ◽  
Reliability And Validity ◽  
Principal Component ◽  
Public Hospitals ◽  
Job Evaluation ◽  
Structural Validity ◽  
Preliminary Screening ◽  
Physician Compensation ◽  
Evaluation Scheme ◽  
Chinese Public

Background Job evaluation has been widely used to establish a foundation for internal equity and other human resource functions. The United Kingdom adopts the National Health Service (NHS) Job Evaluation scheme to determine the pay bands for most NHS staff and ensure equal pay for work of equal value. The challenges of recruiting and retaining physicians in Chinese public hospitals have heightened the need for a reliable job evaluation system to ensure the equality of physician compensation. The aim of this study was to construct job evaluation factors of physicians in Chinese public hospitals based on the NHS Job Evaluation scheme and to examine the reliability and validity of the established system. Methods Questionnaire surveys and statistical analyses were used to determine the job evaluation factors for physicians. The preliminary screening of the evaluation factors was based on a literature review, focused interviews with physicians and the Delphi method. Based on the results of preliminary screening, a questionnaire with 25 factors was designed to survey physicians regarding the importance of each factor in physician job evaluation. After the pretest, final questionnaire data were collected from 900 physicians by adopting a stratified sampling from 6 tertiary public hospitals in Beijing. A principal component analysis was used for factor extraction and structural validity analysis. The reliability was determined using Cronbach’s alpha. Results The results of the principal component analysis showed that the 25 physician job evaluation factors were grouped into the 5 dimensions of Task Characteristics, Knowledge, Responsibility, Effort/Environment, and Skills. The Cronbach’s alpha coefficients of the five dimensions ranged from 0.841 to 0.909, which indicated a high level of reliability. The result of the factor analysis indicated fair structural validity. The content validity was established by building onto the NHS Job Evaluation scheme and other well-established job evaluation systems. Conclusions Our study indicates that the Chinese version of physician job evaluation is an instrument with fair reliability and validity, which fully reflects the characteristics of physicians in Chinese public hospitals. This system can provide an important basis for developing a physician compensation plan and ensuring internal equity in healthcare organizations.

Educational Technology Assessment

2015 ◽  
pp. 215-246
Author(s):  
James Edward Osler II ◽  
Mahmud A. Mansaray
Keyword(s):  
Reliability And Validity ◽  
Psychometric Evaluation ◽  
Principal Component ◽  
Student Ratings ◽  
Black College ◽  
Evaluation Tool ◽  
Test Analysis ◽  
College And University ◽  
Digital Assessment ◽  
Post Hoc

In this chapter a digital assessment and an associated novel mathematical statistical model are provided as online psychometrics designed to evaluate College and University courses. The psychometric evaluation tool is a Student Ratings of Instruction [SRI] instrument used at a Historically Black College and University [HBCU] for course evaluation purposes. The research methodology is an a posteriori post hoc investigation that examines the reliability and validity of the items used in the SRI instrument. The sample under analysis consisted of the responses to 56,451 total items extracted from 7,919 distributed Student Ratings Instruments delivered online during the 2012 academic year. The post hoc application of the novel Tri–Squared Test analysis methodology is used to intricately analyze the results of an earlier study on SRIs that yielded strong construct validity from Cronbach's Alpha Reliability Model, Goodman & Kruskal's Lambda, and Principal Component Factor Analysis with Varimax Rotation.

Psychometric Evaluation of the USE (Usefulness, Satisfaction, and Ease of use) Questionnaire for Reliability and Validity

2018 ◽  
Vol 62 (1) ◽  
pp. 1414-1418 ◽  
Author(s):  
Meiyuzi Gao ◽  
Philip Kortum ◽  
Frederick Oswald
Keyword(s):  
Factor Model ◽  
High Reliability ◽  
Reliability And Validity ◽  
Psychometric Evaluation ◽  
Ease Of Use ◽  
Face Validity ◽  
Four Dimensions ◽  
System Sensitivity ◽  
Microsoft Word ◽  
System Usability Scale

The Usefulness, Satisfaction, and Ease of Use Questionnaire (USE, Lund, 2001) measures the subjective usability of a product or service. It is a 30-item survey that examines four dimensions of usability: usefulness, ease of use, ease of learning, and satisfaction. This metric can be applied to various scenarios of usability assessment because it is non-proprietary and technology-agnostic. Items in the USE also have good face validity with unambiguous and relevant descriptions. However, little published research has reported reliability or validity of the USE. The current study aims to address this issue by investigating psychometric properties of the USE. One hundred and fifty-one participants from Mechanical Turk (MTurk) evaluated Microsoft Word and Amazon.com on the USE and the System Usability Scale (SUS, Brooke, 1996). Ignoring the four dimensions in the USE, Cronbach’s alpha was .98, which indicates high reliability of overall USE score. The scale-reliability of dropping any item was .98 in both products. In terms of correlations between the USE dimensions and the SUS, validity was statistically and practically significant ( r between .60 and .82, p < .001). System sensitivity of the USE was also demonstrated via significant t-tests on the USE scores between Microsoft Word and Amazon.com . A principal axis factor analysis revealed a four-factor model that is different from the original model. Three factors resembled the original dimensions, and a fourth factor was related to multiple dimensions. Overall, the USE is a valid and reliable instrument that needs further refinement.

scholarly journals RELIABILITY AND VALIDITY OF CHANGE-OF-DIRECTION SPEED TESTS FOR JUNIOR BASKETBALL PLAYERS

2021 ◽  
pp. 535
Author(s):  
Nenad Selaković ◽  
Željko Krneta
Keyword(s):  
Body Mass ◽  
High Reliability ◽  
Body Height ◽  
Reliability And Validity ◽  
Internal Validity ◽  
Principal Component ◽  
Test Body ◽  
T Test ◽  
Basketball Players ◽  
Change Of Direction

The main goal of this study was to determine the reliability and validity of change-of-direction speed (CODS) tests for junior basketball players and to test the differences between the positions of players on the team. On a sample of 66 junior basketball players (18.2±3.18 years), the CODS was tested using the following tests: the Lane Agility Test (LAT), Zigzag Agility Test (ZAT), Agility T-test and Modified Agility T-test. Body height and body mass were used as control variables. α-Cronbach's coefficient was calculated to determine the reliability and internal consistency of the measurements, as well as the average correlation between the trials of each test. The difference between groups of players was tested by MANCOVA. CODS tests showed good to high reliability (interclass correlations ranged from 0.83-0.93 with a variability of 4.4% to 6.4% for the entire sample). The first principal component was determined, which included 83% of the total variance of the analyzed variables. Very high coefficients of internal validity of all the applied tests (0.93-0.98) were obtained on the common subject of defined measurements. Significant differences were found between groups of players by position in favor of outside players (guards) on two tests LAT and ZAT (F=18.023; 8.559 and p≤0.005) with control of the influence of body height and body mass. All tests can be rated as reliable and valid for junior basketball players. LAT proved to be the most suitable for assessing the CODS in young basketball players, with the best discrimination of players by position on the team.

scholarly journals Value Contribution of Rural E-commerce Development: Model Constructing and Empirical Testing

CONVERTER ◽  
2021 ◽  
pp. 242-257
Author(s):  
Xutang Chen, Jingjing Wang, Guoxin Yu
Keyword(s):  
Structural Equation Model ◽  
Structural Equation ◽  
High Reliability ◽  
Economic Value ◽  
Reliability And Validity ◽  
Principal Component ◽  
Factor Loading ◽  
Equation Model ◽  
Ecological Value ◽  
Value Contribution

In the field of rural e-commerce, based on literature review, the paper constructs a four-dimensional value contribution model of rural e-commerce to economic, social, cultural, and ecological development. The value contribution scale for rural e-commerce development is designed to collect experts’ opinions, then the measurement items are modified, and a questionnaire survey is conducted with farmers participating in rural e-commerce activities as the respondents. With AMOS software, a first-order structural equation model and a higher-order structural equation model are used to analyse the confirmatory factors of the rural e-commerce value contribution model, and to test the convergence and discriminative validity of the model and other important attributes. It can be concluded from the test results that the four value dimensions of the model show relatively high reliability and validity, which also suggest that the use of this model is highly rational in identifying the value contribution of the development of rural e-commerce, and has successfully developed the value contribution system of rural e-commerce as a formal theory. At the same time, according to the factor loading and the contribution rate of each principal component measured at the overall level, the weight of the principal components and indices of the overall dimension are achieved. Among the four value contribution dimensions, economic value shares the largest contribution brought by rural e-commerce development and ecological value shares the smallest. Therefore, these results and weights gained from this research will be used to determine the priority of the value contribution of rural e-commerce development, and will be taken into consideration in developing rural e-commerce.

scholarly journals Exploring the psychometric properties of the Rainbow Model of Integrated Care measurement tool for care providers in Australia

BMJ Open ◽  
2019 ◽  
Vol 9 (12) ◽  
pp. e027920 ◽  
Author(s):  
Julian Fares ◽  
Kon Shing Kenneth Chung ◽  
Megan Passey ◽  
Jo Longman ◽  
Pim P Valentijn
Keyword(s):  
Psychometric Properties ◽  
Integrated Care ◽  
Functional Integration ◽  
Healthcare Providers ◽  
Reliability And Validity ◽  
Principal Component ◽  
Measurement Tool ◽  
Care Providers ◽  
Validity And Reliability ◽  
Four Dimensions

ObjectiveTo assess the reliability and validity of a shortened version of the Rainbow Model of Integrated Care (RMIC) measurement tool (MT). The original version of the measurement tool has been modified (shortened) for the Australian context.DesignValidation of the psychometric properties of the RMIC-MT.SettingHealthcare providers providing services to a geographically defined rural area in New South Wales (NSW), Australia.ParticipantsA sample of 56 healthcare providers providing mental and physical healthcare.Main outcome measuresThe psychometric properties of the tool were tested using principal component analysis for validity and Cronbach’s alpha for reliability.ResultsThe tool was shown to have good validity and reliability. The 35 items used in the shortened version of the tool were reduced to 29 items grouped into four dimensions: community-governance orientation, normative integration, functional integration and clinical-professional coordination.ConclusionsThe shortened version of the RMIC-MT is a valid and reliable tool that evaluates integrated care from a healthcare provider’s perspective in NSW, Australia. In order to assess the tool’s appropriateness in an international context, future studies should focus on validating the tool in other healthcare settings.

scholarly journals Psychometric Characteristics of Different Versions of Vocal Tract Discomfort (VTD) Scale: A Systematic Review

2022 ◽  
Author(s):  
Fateme Aghaei ◽  
Hassan Khoramshahi ◽  
Somayah Biparva
Keyword(s):  
Vocal Tract ◽  
High Reliability ◽  
Reliability And Validity ◽  
Validity And Reliability ◽  
Evaluation Tool ◽  
Adaptive Procedure ◽  
Efficient Treatment ◽  
Reliability Parameters ◽  
And Performance ◽  
Treatment Procedures

Background: This review compare different Vocal Tract Discomfort (VTD) versions. This comparison is based on their validity and reliability parameters in the translation and adaptation process. We aimed to prepare numerical evidence to prove the validity of this easy screening tool. VTD is able to perform an accurate diagnosis of voice discomforts, particularly in primary stages. Methods: Articles were selected from databases including Google Scholar, PubMed, Science Direct and Scopus. Our relevant papers were gathered by searching the phrase: VTD in titles, abstracts, and keys. Studies not followed an adaptive procedure were excluded. Based on the selection criteria, out of 23 collected articles, eight were studied in this review. Results: Standard psychometric protocol steps were followed in all selected articles and simultaneously high reliability and validity were reported in their translation procedure. Such analogous results may confirm the efficacy of this research tool. Conclusion: This review affirms VTD, perceptual patient-based scale, as a valuable evaluation tool to investigate the occurrence of voice disorders. Based on its structure and performance, VTD can work as a quick and precise source for predicting vocal discomforts. Moreover, this capability can help professional therapists to plan more efficient treatment procedures. The other important advantage of VTD is its diagnostic and prognostic capacity to inform patients about their current and future conditions so that they would be motivated to follow treatment procedures more consistently.

scholarly journals Developing and Exploring an Evaluation Tool for Educational Apps (E.T.E.A.) Targeting Kindergarten Children

2020 ◽  
Vol 12 (10) ◽  
pp. 4201 ◽  
Author(s):  
Stamatios Papadakis ◽  
Julie Vaiopoulou ◽  
Michail Kalogiannakis ◽  
Dimitrios Stamovlasis
Keyword(s):  
Mobile Apps ◽  
Preschool Education ◽  
Principal Component ◽  
Kindergarten Children ◽  
Assessment Tools ◽  
Assessment Instrument ◽  
Validity And Reliability ◽  
Evaluation Tool ◽  
Four Dimensions ◽  
Target Children

During the last decade, there has been an explosive increase in the number of mobile apps that are called educational and target children aged three to six. Research has shown that only a few of them have been created taking into consideration young children’s development and learning processes. The key question that emerges is how parents, custodians, or teachers can choose appropriate, high-quality educational apps. Literature has presented limited assessment tools based on advanced statistical procedures, which allow one to address validity and reliability issues. This study investigates the dimensions of using and operating educational apps for kids and presents a thirteen-item assessment instrument along with its psychometric properties. Data (N = 218) were collected via an electronic questionnaire from pre-service teachers of preschool education. Principal Component Analysis (PCA) with Varimax rotation was used to investigate the underlying dimensions. The resulting structure included four factors, namely: Usability, Efficiency, Parental Control, and Security. PCA supported the factorial validity of the instrument, while the reliability measures of Cronbach’s alpha for the four dimensions were satisfactory. Finally, a lucid discussion on the findings is provided.

Using Principal Component Scores to Enhance the Validity and Reliability of Big Five Personality Measures

2017 ◽  
Vol 38 (2) ◽  
pp. 83-93
Author(s):  
Jeffrey M. Cucina ◽  
Nicholas L. Vasilopoulos ◽  
Arwen H. DeCostanza
Keyword(s):  
Big Five ◽  
Discriminant Validity ◽  
Reliability And Validity ◽  
Principal Component ◽  
Big Five Personality ◽  
Validity And Reliability ◽  
Scoring Method ◽  
Five Factors ◽  
Big Five Factors ◽  
Component Scores

Abstract. Varimax rotated principal component scores (VRPCS) have previously been offered as a possible solution to the non-orthogonality of scores for the Big Five factors. However, few researchers have examined the reliability and validity of VRPCS. To address this gap, we use a lab study and a field study to investigate whether using VRPCS increase orthogonality, reliability, and criterion-related validity. Compared to the traditional unit-weighting scoring method, the use of VRPCS enhanced the reliability and discriminant validity of the Big Five factors, although there was little improvement in criterion-related validity. Results are discussed in terms of the benefit of using VRPCS instead of traditional unit-weighted sum scores.

FACTORS AFFECTING ECONOMIC PERFORMANCE THROUGH PARTICIPATION OF ZAKAT RECIPIENT IN DEVELOPING BUSINESS

2019 ◽  
Vol 24 (3) ◽  
pp. 243-250
Author(s):  
Estiningsih ◽  
Sundari
Keyword(s):  
Social Capital ◽  
Economic Performance ◽  
Structural Equation ◽  
High Reliability ◽  
Hypothesis Test ◽  
Reliability And Validity ◽  
Community Empowerment ◽  
Primary Data ◽  
Equation Modeling ◽  
Empowerment Program

Community empowerment is a form of development which directly involves the community. In community empowerment program, the position of the community is as program consumer but as program producer instead. Community empowerment aims to achieve community independence and welfare. Zakat is a subsystem which can support community empowerment program. It’s consistent with the objective of zakat, which is material and spiritual wellbeing. To encourage the success of the program, there should be support from various parties, including companion and social capital supports.The purpose of the present study was determining the direct effects of companion and social capital on participant of zakat recipient and its impact of economic performance of zakat-receiving micro businessman. The present study used primary data by involving 72 zakat-receiving micro businesspeople (mustahik businesspeople) in Wonosari Sub-district, Gunung Kidul Regency, Special Region of Yogyakarta. The research instrument was questionnaire with likert-5 scale which has high reliability and validity based on Cronbah Alpha and Kaiser-Meyer-Olkin values. The empirical model was analyzed using Structural Equation Modeling (SEM).The result of hypothesis test shows that companion and social capital affected the participation of zakat recipient, and the participation of zakat recipient affected the economic performance of zakat-receiving micro businessman.

Sign in / Sign up

Export Citation Format

Share Document