Content validity: A neglected strategy for developing managerial selection tests?

1995 ◽  
Vol 14 (2) ◽  
pp. 138-151
Author(s):  
Dale S. Rose ◽  
Ramzi Baydoun
2014 ◽  
Vol 35 (4) ◽  
pp. 236-244 ◽  
Author(s):  
Atsushi Oshio ◽  
Shingo Abe ◽  
Pino Cutrone ◽  
Samuel D. Gosling

The Ten Item Personality Inventory (TIPI; Gosling, Rentfrow, & Swann, 2003 ) is a widely used very brief measure of the Big Five personality dimensions. Oshio, Abe, and Cutrone (2012) have developed a Japanese version of the TIPI (TIPI-J), which demonstrated acceptable levels of reliability and validity. Until now, all studies examining the validity of the TIPI-J have been conducted in the Japanese language; this reliance on a single language raises concerns about the instrument’s content validity because the instrument could demonstrate reliability (e.g., retest) and some forms of validity (e.g., convergent) but still not capture the full range of the dimensions as originally conceptualized in English. Therefore, to test the content validity of the Japanese TIPI with respect to the original Big Five formulation, we examine the convergence between scores on the TIPI-J and scores on the English-language Big Five Inventory (i.e., the BFI-E), an instrument specifically designed to optimize Big Five content coverage. Two-hundred and twenty-eight Japanese undergraduate students, who were all learning English, completed the two instruments. The results of correlation analyses and structural equation modeling demonstrate the theorized congruence between the TIPI-J and the BFI-E, supporting the content validity of the TIPI-J.


2011 ◽  
Author(s):  
Kevin R. Murphy ◽  
Paige J. Deckert ◽  
Ted B. Kinney ◽  
Mei-Chuan Kung
Keyword(s):  

2020 ◽  
Author(s):  
Mayda Alrige ◽  
Hind Bitar Bitar ◽  
Maram Meccawi ◽  
Balakrishnan Mullachery

BACKGROUND Designing a health promotion campaign is never an easy task, especially during a pandemic of a highly infectious disease, such as Covid-19. In Saudi Arabia, many attempts have been made toward raising the public awareness about Covid-19 infection-level and its precautionary health measures that have to be taken. Although this is useful, most of the health information delivered through the national dashboard and the awareness campaign are very generic and not necessarily make the impact we like to see on individuals’ behavior. OBJECTIVE The objective of this study is to build and validate a customized awareness campaign to promote precautionary health behavior during the COVID-19 pandemic. The customization is realized by utilizing a geospatial artificial intelligence technique called Space-Time Cube (STC) technique. METHODS This research has been conducted in two sequential phases. In the first phase, an initial library of thirty-two messages was developed and validated to promote precautionary messages during the COVID-19 pandemic. This phase was guided by the Fogg Behavior Model (FBM) for behavior change. In phase 2, we applied STC as a Geospatial Artificial Intelligence technique to create a local map for one city representing three different profiles for the city districts. The model was built using COVID-19 clinical data. RESULTS Thirty-two messages were developed based on resources from the World Health Organization and the Ministry of Health in Saudi Arabia. The enumerated content validity of the messages was established through the utilization of Content Validity Index (CVI). Thirty-two messages were found to have acceptable content validity (I-CVI=.87). The geospatial intelligence technique that we used showed three profiles for the districts of Jeddah city: one for high infection, another for moderate infection, and the third for low infection. Combining the results from the first and second phases, a customized awareness campaign was created. This awareness campaign would be used to educate the public regarding the precautionary health behaviors that should be taken, and hence help in reducing the number of positive cases in the city of Jeddah. CONCLUSIONS This research delineates the two main phases to developing a health awareness messaging campaign. The messaging campaign, grounded in FBM, was customized by utilizing Geospatial Artificial Intelligence to create a local map with three district profiles: high-infection, moderate-infection, and low-infection. Locals of each district will be targeted by the campaign based on the level of infection in their district as well as other shared characteristics. Customizing health messages is very prominent in health communication research. This research provides a legitimate approach to customize health messages during the pandemic of COVID-19.


2020 ◽  
Vol 19 (3) ◽  
pp. 269-274 ◽  
Author(s):  
İsmail Toygar ◽  
Sadık Hançerlioğlu ◽  
Selden Gül ◽  
Tülün Utku ◽  
Ilgın Yıldırım Şimşir ◽  
...  

The purpose of this study was to evaluate the validity and reliability of the Turkish version of the Diabetic Foot Scale–Short Form (DFS-SF). The study was cross-sectional and conducted between January and October 2019 in a diabetic foot council of a university hospital. A total of 194 diabetic foot patients participated in the study. A Patient Identification Form and DFS-SF were used for data collection. Forward and backward translations were used in language validity. Expert opinions were obtained to determine the Content Validity Index. To determine construct validity, exploratory factor analysis and confirmatory factor analysis were used. Cronbach’s α internal consistency coefficient, item-scale correlation, and test-retest reliability were used to evaluate reliability. It was found that Content Validity Index was 0.97 (0.86-1.00), the factor loading of scale varied from 0.378 to 0.982, Cronbach’s α value varied from 0.81 to 0.94, and item-total correlations were between 0.30 and 0.75. The Turkish version of the DFS-SF was found valid and reliable to measure the quality of life of diabetic foot patients.


Rheumatology ◽  
2021 ◽  
Vol 60 (Supplement_1) ◽  
Author(s):  
Julia Spierings ◽  
Voon H Ong ◽  
Christopher P Denton

Abstract Background/Aims  Evaluation of skin is central to both clinical practice and trials in systemic sclerosis (SSc). This is generally done with the modified Rodnan Skin Score (mRSS). Remote consultations are now widely implemented in response to the COVID-19 pandemic, which has inevitably limited evaluation of skin. To monitor skin during this pandemic and to further explore ways to assess skin, we developed the PASTUL (Patient self-Assessment of Skin Thickness in Upper Limb) questionnaire. The aim of this study was to evaluate feasibility and validity of the PASTUL in SSc. Methods  The PASTUL questionnaire specifies a simple grading of skin as normal, mild, moderate, or severely thickened at eight sites of upper limb corresponding to mRSS. Assessed grades were converted to an integer scale [0, 1, 2, 3]. Detailed instructions for patients were provided. Scleroderma Skin PRO (SSPRO) and Scleroderma Health Assessment Disability Index (SHAQ-DI) were also completed. The mRSS was done in a selection of patients. Construct validity was evaluated by examining the correlation between PASTUL, mRSS, SSPRO and SHAQ-DI using Pearson’s correlation coefficient. Content validity was evaluated by scoring relevance, clarity and practical difficulty. Test-retest reliability was estimated using intraclass correlation coefficient (ICC). Results  In total, 107 patients were invited of which 83 (77.6%) completed the questionnaires. The mRSS was undertaken in 61 patients. The PASTUL was completed by patients (83.1%) or by a partner/friend (16.9%). Mean PASTUL score was 11 (SD 6), mean HAQ-DI 1.47 (SD 0.76) and mean SSPRO 49.8 (SD 26.6). PASTUL and SSPRO physical limitations correlated strongly (0.62, p < 0.001). Correlations between PASTUL and total SSPRO and mRSS upper limbs were moderate to weak (0.59, 0.50 and 0.32 respectively). Correlation between PASTUL and mRSS was stronger in lcSSc compared to dcSSc patients (0.61 vs 0.29) and when assessed by a partner/friend compared to patients themselves (0.98 vs 0.45). The PASTUL demonstrated excellent test-retest reliability (ICC of 0.92) and good content validity. P151 Table 1:Correlation of PASTUL score with other outcome measuresOutcome measurePearson's correlation coefficientP-valuemRSS0.48<0.001mRSS upper limbs0.50<0.001SHAQ-DI0.320.004VAS pain0.180.107VAS GI0.130.239VAS breathing0.130.236VAS RP0.090.406VAS DU0.090.466VAS limitations0.250.026SSPRO0.59<0.001SSPRO subdomain PE0.56<0.001SSPRO subdomain PL0.62<0.001SSPRO subdomain EE0.49<0.001SSPRO subdomain SE0.370.001DU, digital ulcers; EE, emotional effects; GI, gastrointestinal; HAQ-DI, Health Assessment Questionnaire Disability Index; mRSS, modified Rodnan skin score; PE, physical effects; PL, physical limitations; RP, Raynaud's phenomenon; SE, social effects Conclusion  Moderate and significant correlations of PASTUL scores with total SSPRO, physical limitation scores and mRSS support the usefulness of PASTUL as an outcome measure and indicates it’s potential for use in virtual clinical settings Disclosure  J. Spierings: None. V.H. Ong: None. C.P. Denton: None.


2021 ◽  
pp. 026010602098235 ◽  
Author(s):  
Panchali Moitra ◽  
Preeti Verma ◽  
Jagmeet Madan

Background: Development of culturally appropriate and psychometrically sound instruments that measure knowledge and health behaviors of children will help to inform appropriate interventions. Aim: To develop and test the validity and reliability of a questionnaire measuring knowledge, attitudes, and practices to healthy eating and activity patterns in school children in India. Methods: Review of literature, focus-group discussions, and theoretical constructs of the Health Belief Model guided the development of an item pool. Face and content validity were assessed by children and a panel of experts and the item content validity, item difficulty, and discrimination indices were calculated. Construct validity was determined using the principal axis method of exploratory factor analysis among a cross-sectional sample of children ( n=252). Internal consistency (Cronbach α values >0.7) and test-retest reliability (intraclass correlation coefficient values >0.75) were estimated. Results: Item content validity index for clarity and relevance were satisfactory (>0.80) and internal consistency for knowledge (Kuder-Richardson 20 = 0.832), attitude (Cronbach’s α = 0.912), and practice items (Cronbach’s α = 0.769) were good. Four factors (children’s eating habits, family dietary practices, and consumption of healthy and unhealthy foods) and two factors (moderate to vigorous activities and sedentary activities) explained 67.7% and 48.2% of the total variance in practice items. Intraclass correlation coefficient estimates ranged from good to excellent (0.72–0.99). Conclusions: The results of the validity and reliability of the 84-item knowledge, attitudes, and practices to healthy eating and activity patterns in schoolchildren questionnaire were promising. The detailed description of the methodology employed may prove useful to researchers conducting similar studies in children.


Sign in / Sign up

Export Citation Format

Share Document