Performance tests in human psychopharmacology (2): Content validity, criterion validity, and face validity

BackgroundAn acceptable, reliable, and valid survey instrument to measure missed nursing care in perioperative settings has not been developed.PurposeTo develop and conduct psychometric testing of the MISSCARE Survey OR.MethodsData were collected nationwide from 1,693 operating room (OR) nurses who completed the MISSCARE Survey OR. The survey contained two sections: Part A, “Elements of perioperative nursing care” (32 questions) and Part B, “Reasons for missing nursing care” (17 questions).ResultsThe MISSCARE Survey OR demonstrated acceptability, as few respondents missed questions in Part A (0.1%–1.1%) and Part B (0.8%–1.3%). Exploratory factor analysis revealed five subscales in Part A (Legal, Preparation, Safety, Communication, and Closing) and four in Part B (Urgency, Staffing, Materials, and Teamwork). In Part A, the five-factor solution explained 44% of the variance. In Part B, the four-factor solution explained 53% of the variance. Alpha coefficients for subscales in Part A ranged from 0.71 to 0.84 and 0.74 to 0.90 for Part B. Validity was measured using content validity, criterion validity, and construct validity. A panel of OR nurse experts established content validity. Criterion validity compared hospitals with fewer than six ORs to hospitals with hospitals with more than six ORs where it was hypothesized aprior that nurses in hospitals with fewer ORs would have missed less care (X = −.123, standard error [SE] = .041, p = .003). Construct validity was tested through exploratory and confirmatory factor analyses (CFA). Correlation coefficients for Part A ranged from 0.34 to 0.73 and 0.60 to 0.73 for Part B. Overall model fit was acceptable: goodness-of-fit index (GFI) and CFA were greater than 0.90, standardized root mean square residual (SMRM) was less than 0.06, and root mean square error of approximation (RMSEA) less than 0.08.ConclusionThe MISSCARE Survey OR promises to be a reliable, valid indicator of the extent of and reasons for missed nursing care.

Download Full-text

Preparedness of community-based organisations in biohazard: reliability and validity of an assessment tool

Family Medicine and Community Health ◽

10.1136/fmch-2019-000124 ◽

2019 ◽

Vol 7 (3) ◽

pp. e000124

Author(s):

Fatemeh Rezaei ◽

Mohammad R Maracy ◽

Mohammad H Yarmohammadian ◽

Ali Ardalan ◽

Mahmood Keyvanara

Keyword(s):

Factor Analysis ◽

Content Validity ◽

Assessment Tool ◽

Reliability And Validity ◽

Criterion Validity ◽

Face Validity ◽

Community Based ◽

Validity Data ◽

Health Authorities ◽

Control And Prevention

The purpose of this study was to develop a tool for community-based health organisations (CBHOs) to evaluate the preparedness in biohazards concerning epidemics or bioterrorism. We searched concepts on partnerships of CBHOs with health systems in guidelines of the Centers for Disease Control and Prevention and literature. Then, we validated the researcher-made tool by face validity, content validity, exploratory factor analysis (EFA), confirmatory factor analysis (CFA) and criterion validity. Data were collected by sending the tool to 620 CBHOs serving under supervision of Iran’s ministry of health. Opinions of health professionals and stakeholders in CBHOs were used to assess face and content validity. Factor loads in EFA were based on three-factor structure that verified by CFA. We used SPSS V.18 and Mplus7 software for statistical analysis. About 105 health-based CBHOs participated. After conducting face validity and calculating content validity ratio and content validity index, we reached 54 items in the field of planning, training and infrastructure. We conducted construct validity using 105 CBHOs. Three items exchanged between the fields according to factor loads in EFA, and CFA verified the model fit as Comparative Fit Index, Tucker-Lewis index and root mean square error of approximation were 0.921, 0918 and 0.052, respectively. The Cronbach’s of the whole tool was 0.944. Spearman correlation coefficient confirmed criterion validity as coefficient was 0.736. Planning, training and infrastructure fields are the most important aspects of preparedness in health-based CBHOs. Applying the new assessment tool in future studies will show the weaknesses and capabilities of health-based CBHOs in biohazard and clear necessary intervention actions for health authorities.

Download Full-text

Validating the Support Needs Approach for Patients (SNAP) tool in primary care: a person-centred approach for patients with advanced chronic obstructive pulmonary disease (COPD)

British Journal of General Practice ◽

10.3399/bjgp18x697301 ◽

2018 ◽

Vol 68 (suppl 1) ◽

pp. bjgp18X697301

Author(s):

Carole Gardner ◽

Gail Ewing ◽

Morag Farquhar

Keyword(s):

Primary Care ◽

Health Care Professionals ◽

Content Validity ◽

Depression Scale ◽

Criterion Validity ◽

Postal Survey ◽

Face Validity ◽

Chronic Obstructive ◽

Support Needs ◽

The Impact

BackgroundPrimary care is at the forefront of COPD management. A person-centred approach is advocated, yet patients have difficulty in articulating their needs to health care professionals (HCPs). The Support Needs Approach for Patients (SNAP) tool aims to enable patients to identify and express their support needs but its validity is unknown.AimTo establish the face, content and criterion validity of the SNAP tool in advanced COPD.MethodTwo-stage mixed method primary care study involving patients with advanced COPD, and their carers. Stage 1: Face and content validity assessed though focus groups involving patients and carers (n = 12), considering the appropriateness, relevance and completeness of the SNAP tool. Data analysed using thematic analysis within a Framework Approach. Stage 2: Content and criteria validity assessed in a postal survey through patient self-completion of the SNAP tool and disease impact measures (Chronic Respiratory Questionnaire, COPD Assessment Test, and Hospital Anxiety and Depression Scale). Content validity assessed using summary statistics; criterion validity via correlations between tool items and impact measures.ResultsThe SNAP tool has good face, content and criterion validity. Patients and carers found the tool patient-friendly and potentially useful. No items on the tool were redundant, and clear correlations were found between tool items and the majority of items/sub-scales of the impact measures.ConclusionThe SNAP tool has good face validity; content and criteria validity will be reported. It has the potential to facilitate person-centred care by enabling patients to express their support needs to HCPs. Future work will pilot SNAP in clinical practice.

Download Full-text

IDentification of patients in need of general and specialised PALLiative care (ID-PALL©): item generation and content validity of a new interprofessional screening instrument.

10.21203/rs.2.17375/v1 ◽

2019 ◽

Author(s):

Fabienne Teike Lüthi ◽

Mathieu Bernard ◽

Michel Beauverd ◽

Claudia Gamondi ◽

Anne-Sylvie Ramelet ◽

...

Keyword(s):

Palliative Care ◽

Literature Review ◽

Content Validity ◽

Criterion Validity ◽

Delphi Process ◽

Face Validity ◽

Health Concern ◽

Care Needs ◽

Nurses And Physicians ◽

Palliative Care Needs

Abstract Background Early identification of patients requiring palliative care is a major public health concern. A growing number of instruments exist to help professionals in identifying these patients, but thus far, none have been thoroughly assessed for criterion validity. In addition, no currently available instruments differentiate between patients in need of general vs. specialized palliative care, and most are primarily intended for physicians’ use. This study aims to develop a new interprofessional instrument allowing identification of patients in need of general vs specialized palliative care.Methods The instrument development consisted of four steps: i) literature review to determine the concept to measure; ii) generation of a set of items; iii) review of the initial set of items by experts to establish the content validity; iv) administration of the items to a sample of the target population to establish face validity. We conducted a Delphi process with experts in palliative care to accomplish step 3 and sent a questionnaire to nurses and physicians non-specialised in palliative care to achieve step 4. A committee of interdisciplinary clinical experts supervised all steps.Results The study was conducted in the French - and Italian-speaking regions of Switzerland. The literature review confirmed the necessity of distinguishing between general and specialised palliative care needs and of adapting clinical recommendations to these different needs. Thirty-six nurses and physicians participated in the Delphi process and 28 were involved in the face validity assessment. The Delphi process resulted in two item lists: a 7-items list to identify patients in need of general PC and an 8-items list for specialised PC needs. The content and face validity were deemed to be acceptable by both the expert and the target populations.Conclusion This instrument considers a new perspective in the identification of patients requiring palliative care as it has been designed to differentiate between general and specialised palliative care needs. Moreover, diagnostic data is not fundamental to the use of the instrument, thus facilitating its use by healthcare professionals other than physicians, in particular nurses. Internal and criterion validity assessments are ongoing and essential before further dissemination of the instrument.

Download Full-text

Psychometric Assessment of the Persian Translated Version of the Romantic Perfectionism Scale Among Couples

Psychological Reports ◽

10.1177/00332941211036026 ◽

2021 ◽

pp. 003329412110360

Author(s):

Abbas Abdollahi ◽

Kelly A. Allen

Keyword(s):

Content Validity ◽

Goodness Of Fit ◽

Factor Loading ◽

Face Validity ◽

Fit Indices ◽

Depression Anxiety Stress Scale ◽

Confirmatory Factor ◽

Married Men ◽

Iranian Version ◽

Acceptable Internal Consistency

Romantic perfectionismi can be disruptive to relationships, yet no validated measure for assessing romantic perfectionism in Iranian couples has been developed. Therefore, the purpose of this study was to translate and validate the Romantic Perfectionism Scale (RPS) among Iranian couples. Participants in the study were 200 married men and 320 married women from Tehran, Iran, who completed the translated RPS, the Almost Perfect Scale-Revised, and the Depression Anxiety Stress Scale-21 online. Item impact scores were used to calculate face validity. Impact score values for all items were greater than 1.5, signaling appropriate face validity.. The Content Validity Index (CVI) and the Content Validity Ratio (CVR) were used to measure content validity. Values of the CVI were above the cut-off score of 0.7, implying satisfactory content validity of the items. The CVR values were greater than the Lawshe table (0.78) cut-off score, demonstrating that all items were essential. Confirmatory Factor Analysis (CFA) using AMOS software was used to evaluate the construct validity. The results of the goodness of fit indices confirmed the RPS with two subscales (i.e., self-oriented romantic perfectionism and other-oriented romantic perfectionism) as per the original scale. All items remained in the scale as all factor loading values were greater than 0.45. The findings showed that the two subscales, and the scale as a whole, had acceptable internal consistency, as the construct reliability values for self-oriented romantic perfectionism (0.81), other-oriented romantic perfectionism (0.72), and the whole scale (0.74) were greater than 0.7. The results support the psychometric properties of the Iranian version of the RPS, which could be used by future researchers and clinicians to assess romantic perfectionism in Iranian couples.

Download Full-text

Development and Validity of Questionnaire for Healthy Adult Human Participants of Early Phase Bioequivalence Pharmacokinetic Endpoint Study

Research Journal of Pharmacology and Pharmacodynamics ◽

10.52711/2321-5836.2021.00023 ◽

2021 ◽

pp. 111-117

Author(s):

Sharad Desai ◽

Nilesh Patel

Keyword(s):

Content Validity ◽

Early Phase ◽

Literature Search ◽

Healthy Adult ◽

Face Validity ◽

Domain Identification ◽

Adult Human ◽

Human Participants ◽

Development And Validation ◽

Validation Of Questionnaire

Participation of humans in clinical research is always remained questionable. Hence evaluation of such doubt helps to conclude the perception about such participation. This research presents the process for development and validation of questionnaire for Healthy Adult Human Participants of Early Phase Bioequivalence Pharmacokinetic Endpoint Study. For development of questionnaire, literature search, experts’ discussion and authors’ experience was used for domain identification and its segregation for different variables. For validity of questionnaire, face validity and content validity was performed. Modification was done based on response from experts during non-quantitative face validity. % of overall agreement was 94.55 for question asked in face validity. While, Content Validity Ratio and Content Validity Index was calculated using the process mentioned by Lawshe and Lynn respectively. Initially 83 items were identified but based on validation 84 items were finalized after removal of three and addition of four questions. Deleted three items had Content Validity Ratio of 0.00, 0.67 and 0.67 and which were below accepted level of 0.99. While, I-CVI was observed from range of 0.83 to 1.00 and S-CVI values were above acceptable level of 0.90 for S-CVI (S-CVI/ Ave) and 0.80 for S-CVI (S-CVI/UA) for whole questionnaire and each part.

Download Full-text

Feasibility, face, and content validity of quantitative computed tomography in interstitial lung disease related to connective tissue diseases

Journal of Basic and Clinical Physiology and Pharmacology ◽

10.1515/jbcpp-2021-0110 ◽

2021 ◽

Vol 0 (0) ◽

Author(s):

Gianluca Sambataro ◽

Domenico Sambataro ◽

Martina Orlandi ◽

Sofia Battisti ◽

Lorenzo Cavagna ◽

...

Keyword(s):

Computed Tomography ◽

Interstitial Lung Disease ◽

Connective Tissue ◽

Lung Disease ◽

Content Validity ◽

Online Survey ◽

Objective Assessment ◽

Quantitative Computed Tomography ◽

Connective Tissue Diseases ◽

Face Validity

Abstract Objectives Quantitative computed tomography (QCT) is a promising tool for objective assessment of interstitial lung disease (ILD) related to connective tissue diseases (CTD). However, its validity was never investigated. The aim of this study was to assess QCT feasibility, face, and content validity evaluation concerning CTD-ILD. Methods A rheumatologist and a chest radiologist conceived an online survey with nine statements: Two about general issue involving CTD-ILD, one for the face validity, three both for content validity and feasibility. Each statement had to be rated with a score from 0 to 100, respectively, (complete disagreement and agreement). We considered a statement supported by the experts if the median score was ≥75.0. Results A panel of 14 experts (11 from Europe, three from America) with a nine years median experience was enrolled. All the statements about feasibility, face and content validity were supported, except for QCT capability to recognize elementary lesions. Conclusions The panel of experts supported feasibility, face, and content validity of QCT assessment concerning CTD-ILD. This may stimulate a greater use in clinical practice and further studies to confirm its discriminative properties and its construct validity.

Download Full-text

Psychometric evaluation and cultural adaptation of the Spanish version of the “Scale for End-of Life Caregiving Appraisal”

Palliative & Supportive Care ◽

10.1017/s1478951518000470 ◽

2018 ◽

Vol 17 (03) ◽

pp. 314-321

Author(s):

José Manuel Hernández-Padilla ◽

Matías Correa-Casado ◽

José Granero-Molina ◽

Alda Elena Cortés-Rodríguez ◽

Tamara María Matarín-Jiménez ◽

...

Keyword(s):

Factor Analysis ◽

Construct Validity ◽

End Of Life ◽

Exploratory Factor Analysis ◽

Content Validity ◽

Criterion Validity ◽

Spanish Version ◽

Validity Index ◽

Content Validity Index ◽

The Impact

AbstractObjectiveTo translate, culturally adapt, and psychometrically evaluate the Spanish version of the “Scale for End-of Life Caregiving Appraisal” (SEOLCAS).MethodObservational cross-sectional study. Convenience sample of 201 informal end-of-life caregivers recruited in a southern Spanish hospital. The reliability of the questionnaire was assessed through its internal consistency (Cronbach's α) and temporal stability (Pearson's correlation coefficient [r] between test-retest). The content validity index of the items and the scale was calculated. Criterion validity was explored through performing a linear regression analysis to evaluate the SEOLCAS’ predictive validity. Exploratory factor analysis was used to examine its construct validity.ResultsThe SEOLCAS’ reliability was very high (Cronbach's α = 0.92). Its content validity was excellent (all items’ content validity index = 0.8–1; scale's validity index = 0.88). Evidence of the SEOLCAS’ criterion validity showed that the participants’ scores on the SEOLCAS explained approximately 79.3% of the between-subject variation of their results on the Zarit Burden Interview. Exploratory factor analysis provided evidence of the SEOLCAS’ construct validity. This analysis revealed that two factors (“internal contingencies” and “external contingencies”) explained 53.77% of the total variance found and reflected the stoic Hispanic attitude toward adversity.Significance of resultsThe Spanish version of the SEOLCAS has shown to be an easily applicable, valid, reliable, and culturally appropriate tool to measure the impact of end-of-life care provision on Hispanic informal caregivers. This tool offers healthcare professionals the opportunity to easily explore Hispanic informal end-of-life caregivers’ experiences and discover the type of support they may need (instrumental or emotional) even when there are communicational and organizational constraints.

Download Full-text

Validity and Reliability of the Scale, Role Taking in Caregivers of People with Chronic Disease, ROL

International Archives of Medicine ◽

10.3823/2575 ◽

2018 ◽

Vol 11 ◽

Author(s):

Mauricio Arias ◽

Sonia Carreño ◽

Lorena Chaparro

Keyword(s):

Factor Analysis ◽

Chronic Disease ◽

Construct Validity ◽

Internal Consistency ◽

Content Validity ◽

Three Dimensions ◽

Face Validity ◽

Validity And Reliability ◽

Role Taking ◽

Phase Study

Objective: To determine face, content, and construct validity, and internal consistency of ROL scale. Methods and Findings: A three-phase study was conducted. First, content analysis of the scale was carried out consulting 10 professional experts. Then, face validity was analyzed with 60 caregivers. Finally, construct validity was evaluated by performing an exploratory factor analysis (EFA) with 110 participants. Internal consistency of ROL scale was also assessed. Face validity of ROL scale reached a high acceptance index in three dimensions: role performance (0.97), role organization (0.98), and response to the role (0.98). Content validity showed coherence, clarity, and relevance of the scale. From factor analysis, three components emerged and were grouped in the same manner for varimax, quartimax, and equimax rotations. Cronbach's alpha was 0.816, which is an acceptable overall value. Conclusion: ROL scale makes objective the concept of role taking in family caregivers of people with chronic disease. It demonstrated to have acceptable reliability, and construct, face, and content validity to be used in the Colombian context. Keywords: Validation Study, Caregivers, Health Transitions, Chronic Disease.

Download Full-text

AMAMENTAÇÃO E CUIDADOS AO BEBÊ DURANTE A PANDEMIA DA COVID-19: como recursos multimídias podem ajudar

Psicologia e Saúde em Debate ◽

10.22289/2446-922x.v7n1a8 ◽

2021 ◽

Vol 7 (1) ◽

pp. 107-127

Author(s):

Cassia Patricia Barroso Perry ◽

Ana Cristina Barros da Cunha ◽

Karolina Alves de Albuquerque ◽

Paula Caroline de Moura Burgarelli ◽

Marina Batella Martins ◽

...

Keyword(s):

Higher Education ◽

High School ◽

Content Validity ◽

Target Population ◽

Support Networks ◽

Methodological Study ◽

Multimedia Resources ◽

Validity Criterion ◽

Southeastern Region ◽

Video Format

With the COVID-19 pandemic, the development of coping strategies to face the stress generated by the worldwide crisis of the new coronavirus became mandatory. Based on this, the purpose of this article is to analyze multimedia resources on video format for the digital platform Instagram as health education strategies to help puerperal women and their support networks during the COVID-19 pandemic. This is a descriptive methodological study based on the evaluation of content validity criterion by 21 postnatal judges, with an average age of 29.38 years. Most of them lived in the southeastern region of Brazil (n = 20) and had higher education (52.38%), followed by high school (38.09%). Content Validity Coefficients (CVC) ≥ 0.80 were adopted to validate language clarity, relevance, pertinence, and presentation of the videos. All CVC of the from the Series “Breastfeeding” were satisfactory between ≥ 0.85 and 1. With the exception of the 4th video (CVC ≥ 0.73) the videos from the Series “Neonatal Care” obtained CVC between ≥0,86 and 1. These results indicate that the target population considered the videos relevant, adequate, easy to understand and aesthetically pleasing. Accordingly, multimedia resources in video format can be considered a valid tool for the educational health proposal. Thus, the videos could help women during the postpartum period and their families to cope with the stress from the COVID-19 pandemic.

Download Full-text