Validating the Development of Instrument for Measuring Nurses’ Performance Scale

2019 ◽  
Vol 6 (1) ◽  
pp. 31-38
Author(s):  
Suhaila Haron ◽  
Aini Suzana Ariffin ◽  
Durrishah Idrus
Keyword(s):  
Content Validity ◽  
Expert Panel ◽  
Reduction Process ◽  
Kappa Statistic ◽  
Four Dimensions ◽  
Validity Assessment ◽  
Content Domain ◽  
Development Of Instrument ◽  
Performance Scale

Measuring and evaluating nurses’ performance are vital to identify areas for improvement in maintaining quality of service delivery and ensuring sustainability of current practices. This study attempts to examine the content validity of the nurses’ performance scale. It is also aimed to achieve acceptable criteria for content validity of this instrument. Construct and content domain of nurses’ performance were identified followed by items generation and instrument formation. Subsequently, assessments of content validity were performed based on content validity Index (CVI), Inter-rater agreement percentage (IRA%) and modified Kappa statistic. Two level of judgement were performed using the lay expert panel and research expert panel. Criteria were established based on these indices as basis for item reduction process. Pilot study was conducted on 50 respondents to assess the internal consistency using Cronbach’s alpha value of finalized NPQ instrument. 71 items are yielded during developmental stage of instrument to measure four dimensions of nurses’ performance. Assessment of content validity based on lay and research expert judgement resulting in elimination of 27 items (38%). Computed modified Kappa statistic further supplemented that the remaining 44 items as ‘excellent’. As for conclusion, NPQ instrument has attain acceptable criteria of content validity assessment utilized in this study and therefore proved its potential for further research

scholarly journals Design and Implementation of Content Validity: Instrument Development for Evaluating Functional Building Performance

2021 ◽  
Vol 17 ◽  
pp. 973-982
Author(s):  
Hasnizan Aksah ◽  
Suhana Johar ◽  
Ismar Ms Usman ◽  
Adi Irfan Che Ani
Keyword(s):  
Performance Evaluation ◽  
Instrument Development ◽  
Content Validity ◽  
Evaluation Criteria ◽  
Kappa Statistic ◽  
Management Team ◽  
Building Performance ◽  
Content Domain ◽  
Building Management ◽  
Local Municipality

The research aim is to critically evaluate the content validity of the functional building performance evaluation criteria using the Content Validity Index (CVI) and modified kappa statistic. The selection of relevant criteria for functional building performance evaluation should be managed effectively by the building management team because it is strongly related to the achievement of organizational objectives and the building occupants’ satisfaction. Studies over the past decades have shown that the criteria vary, relying on the intention of conducting the performance evaluation and the types of building. These selection criteria have a direct impact on the functional building performance and need to be done systematically. Thus, the content validity of the functional building performance evaluation criteria is a necessary step in instrument development. To achieve this research aim, the instrument has been developed based on numerous construct items that have been obtained from previous studies by various authors and established rating tools or standards. The sample of the respondents for content validation comprises of seven (7) expert panels in the area of historic building management and building performance evaluation, such as from the local municipality, related government agencies, academician and building management team. The panels reviewed and rated the instrument to ensure its relevance and the representativeness of each item. The result shows that a total of 39 items are valid and are considered to be retained, and will be further tested in the next study. The result has also shown that the Scale level – CVI/ Averaging calculation method (S-CVI/ Ave) for all items has met the criterion of 0.90. Significantly, content validity should be treated as important because it provides adequate and acceptable items of the content domain

scholarly journals Development and psychometric properties of the general public's attitudes toward advance care directives scale in Portugal

2021 ◽  
Vol 10 (1) ◽  
Author(s):  
Carlos Laranjeira ◽  
Maria dos Anjos Dixe ◽  
Luís Gueifão ◽  
Lina Caetano ◽  
Rui Passadouro ◽  
...  
Keyword(s):  
Content Validity ◽  
Online Survey ◽  
Expert Panel ◽  
Principal Component ◽  
Methodological Study ◽  
Varimax Rotation ◽  
Four Dimensions ◽  
Advance Care Directives ◽  
Advance Care ◽  
Good Item

Background: To date, no instrument in Portugal has evaluated the attitudes of the population about advance care directives. This paper describes the development and testing of the General Public's Attitudes Toward Advance Care Directives (GPATACD) Scale.Design and Methods: Methodological study.  The development of the instrument was based on a literature review, updated in 2018. Face and content validity were verified by an expert panel and piloted among six participants. Data were collected in an online survey of 1024 Portuguese adults. The obtained data were analyzed using Varimax rotation, while the reliability was evaluated by calculating Cronbach’s alpha.Results: The scale achieves good Item-Content Validity Index (I-CVI) values, between 0.89 and 1.00, and scale-CVI values of 0.91. A principal component analysis generated four dimensions with 26 items as a final scale, with overall Cronbach’s alpha of 0.848.Conclusions: The findings demonstrate that the scale is valid and reliable as a vehicle for assessment of the general public's attitudes toward advance care directives.

scholarly journals Validity versus feasibility for quality of care indicators: expert panel results from the MI-Plus study

2010 ◽  
Vol 22 (3) ◽  
pp. 201-209 ◽  
Author(s):  
A. Pena ◽  
S. S. Virk ◽  
R. M. Shewchuk ◽  
J. J. Allison ◽  
O. Dale Williams ◽  
...  
Keyword(s):  
Quality Of Care ◽  
Expert Panel

scholarly journals Development and validation of a short version of the Sarcopenia Quality of Life questionnaire: the SF-SarQoL

2021 ◽  
Author(s):  
A. Geerinck ◽  
C. Beaudart ◽  
J.-Y. Reginster ◽  
M. Locquet ◽  
C. Monseur ◽  
...  
Keyword(s):  
Quality Of Life ◽  
Short Form ◽  
Reduction Process ◽  
Community Dwelling ◽  
Short Version ◽  
Second Phase ◽  
Life Questionnaire ◽  
Quality Of Life Questionnaire ◽  
Two Phases

Abstract Purpose To facilitate the measurement of quality of life in sarcopenia, we set out to reduce the number of items in the previously validated Sarcopenia Quality of Life (SarQoL®) questionnaire, and to evaluate the clinimetric properties of this new short form. Methods The item reduction process was carried out in two phases. First, information was gathered through item-impact scores from older people (n = 1950), a Delphi method with sarcopenia experts, and previously published clinimetric data. In the second phase, this information was presented to an expert panel that decided which of the items to include in the short form. The newly created SFSarQoL was then administered to older, community-dwelling participants who previously participated in the SarcoPhAge study. We examined discriminative power, internal consistency, construct validity, test–retest reliability, structural validity and examined item parameters with a graded response model (IRT). Results The questionnaire was reduced from 55 to 14 items, a 75% reduction. A total of 214 older, community-dwelling people were recruited for the validation study. The clinimetric evaluation showed that the SF-SarQoL® can discriminate on sarcopenia status [EWGSOP2 criteria; 34.52 (18.59–43.45) vs. 42.86 (26.56–63.69); p = 0.043], is internally consistent (α = 0.915, ω = 0.917) and reliable [ICC = 0.912 (0.847–0.942)]. A unidimensional model was fitted (CFI = 0.978; TLI = 0.975; RMSEA = 0.108, 90% CI 0.094–0.123; SRMR = 0.055) with no misfitting items and good response category separation. Conclusions A new, 14-item, short form version of the Sarcopenia Quality of Life questionnaire has been developed and shows good clinimetric properties.

scholarly journals Toward an Evidence-Based Definition and Classification of Carbohydrate Food Quality: An Expert Panel Report

Nutrients ◽  
2021 ◽  
Vol 13 (8) ◽  
pp. 2667
Author(s):  
Kevin B. Comerford ◽  
Yanni Papanikolaou ◽  
Julie Miller Jones ◽  
Judith Rodriguez ◽  
Joanne Slavin ◽  
...  
Keyword(s):  
Food Quality ◽  
Diet Quality ◽  
Expert Panel ◽  
Present Report ◽  
Food Group ◽  
Dietary Guidelines ◽  
Evidence Based ◽  
Carbohydrate Quality ◽  
Dietary Guidelines For Americans

Carbohydrate-containing crops provide the bulk of dietary energy worldwide. In addition to their various carbohydrate forms (sugars, starches, fibers) and ratios, these foods may also contain varying amounts and combinations of proteins, fats, vitamins, minerals, phytochemicals, prebiotics, and anti-nutritional factors that may impact diet quality and health. Currently, there is no standardized or unified way to assess the quality of carbohydrate foods for the overall purpose of improving diet quality and health outcomes, creating an urgent need for the development of metrics and tools to better define and classify high-quality carbohydrate foods. The present report is based on a series of expert panel meetings and a scoping review of the literature focused on carbohydrate quality indicators and metrics produced over the last 10 years. The report outlines various approaches to assessing food quality, and proposes next steps and principles for developing improved metrics for assessing carbohydrate food quality. The expert panel concluded that a composite metric based on nutrient profiling methods featuring inputs such as carbohydrate–fiber–sugar ratios, micronutrients, and/or food group classification could provide useful and informative measures for guiding researchers, policymakers, industry, and consumers towards a better understanding of carbohydrate food quality and overall healthier diets. The identification of higher quality carbohydrate foods could improve evidence-based public health policies and programming—such as the 2025–2030 Dietary Guidelines for Americans.

scholarly journals Multi-organ point-of-care ultrasound for COVID-19 (PoCUS4COVID): international expert consensus

Critical Care ◽  
2020 ◽  
Vol 24 (1) ◽  
Author(s):  
Arif Hussain ◽  
Gabriele Via ◽  
Lawrence Melniker ◽  
Alberto Goffi ◽  
Guido Tavazzi ◽  
...  
Keyword(s):  
Lung Ultrasound ◽  
Expert Panel ◽  
Point Of Care ◽  
Expert Consensus ◽  
Future Research ◽  
Point Of Care Ultrasound ◽  
The Past ◽  
Modified Delphi ◽  
Grade Methodology

AbstractCOVID-19 has caused great devastation in the past year. Multi-organ point-of-care ultrasound (PoCUS) including lung ultrasound (LUS) and focused cardiac ultrasound (FoCUS) as a clinical adjunct has played a significant role in triaging, diagnosis and medical management of COVID-19 patients. The expert panel from 27 countries and 6 continents with considerable experience of direct application of PoCUS on COVID-19 patients presents evidence-based consensus using GRADE methodology for the quality of evidence and an expedited, modified-Delphi process for the strength of expert consensus. The use of ultrasound is suggested in many clinical situations related to respiratory, cardiovascular and thromboembolic aspects of COVID-19, comparing well with other imaging modalities. The limitations due to insufficient data are highlighted as opportunities for future research.

scholarly journals Psychometric Testing of the Spanish Modified Version of the Mini-Suffering State Examination

2021 ◽  
Vol 18 (15) ◽  
pp. 7821
Author(s):  
Daniel Gutiérrez-Sánchez ◽  
Rafael Gómez-García ◽  
Isabel María López-Medina ◽  
Antonio I. Cuesta-Vargas
Keyword(s):  
Internal Consistency ◽  
Content Validity ◽  
Convergent Validity ◽  
Informal Caregivers ◽  
Psychometric Testing ◽  
Spanish Version ◽  
Measurement Properties ◽  
Quality Of Dying ◽  
State Examination

Background: The mini-suffering state examination is a valid and reliable measure that have been used to assess suffering in patients with advanced cancer. The aim of this study was to carry out a psychometric analysis of the Spanish version of the mini-suffering state examination. Method: A validation study was conducted. Seventy-two informal caregivers of deceased patients in palliative care were included in this study. A psychometric testing of content validity, internal consistency, and convergent validity with the Spanish version of the quality of dying and death questionnaire was performed. Results: The original instrument was modified to be used by informal caregivers. The content validity was acceptable (0.96), and the internal consistency was moderate (α = 0.67). Convergent validity was demonstrated (r = −0.64). Conclusion: The Spanish modified version of the MSSE showed satisfactory measurement properties. The Spanish modified version of MSSE can be useful to facilitate screening, monitor progress, and guide treatment decisions in end-of-life cancer patients.

scholarly journals Expert Opinion on the Management of Non-Alcoholic Fatty Liver Disease (NAFLD) in the Middle East with a Focus on the Use of Silymarin

2021 ◽  
Vol 12 (2) ◽  
pp. 155-165
Author(s):  
Ahmed Hashem ◽  
Yogesh Shastri ◽  
Malfi Al Otaibi ◽  
Elwin Buchel ◽  
Hussam Saleh ◽  
...  
Keyword(s):  
Liver Disease ◽  
Middle East ◽  
Fatty Liver Disease ◽  
Expert Panel ◽  
Treatment Options ◽  
Current Treatment ◽  
Alcoholic Fatty Liver ◽  
Liver Disease Progression ◽  
Alcoholic Fatty Liver Disease

Non-alcoholic fatty disease (NAFLD) is amongst the leading causes of chronic liver disease worldwide. The prevalence of NAFLD in the Middle East is 32%, similar to that observed worldwide. The clinicians in this region face several challenges in diagnosing and treating patients with NAFLD. Additionally, there are no national or regional guidelines to address the concerns faced with current treatment options. Silymarin, derived from milk thistle, provides a rational and clinically proven approach to hepatoprotection. This article focuses on addressing regional diagnostic challenges and provides clear guidance and potential solutions for the use of Silymarin in the treatment of NAFLD in the Middle East. Both clinical and preclinical studies have highlighted the efficiency of Silymarin in managing NAFLD by reducing liver disease progression and improving patient symptoms and quality of life, alongside being safe and well tolerated. An expert panel of professionals from the Middle East convened to establish a set of regional-specific diagnostics. A consensus was established to aid general physicians to address the diagnostic challenges in the region. In conclusion, Silymarin can be considered beneficial in treating NAFLD and should be initiated as early as possible and continued as long as necessary.

scholarly journals Patient-Reported Outcome Measures for Post-mastectomy Breast Reconstruction: A Systematic Review of Development and Measurement Properties

2020 ◽  
Vol 28 (1) ◽  
pp. 386-404 ◽  
Author(s):  
C. F. Davies ◽  
R. Macefield ◽  
K. Avery ◽  
J. M. Blazeby ◽  
S. Potter
Keyword(s):  
Systematic Review ◽  
Breast Reconstruction ◽  
Content Validity ◽  
Patient Reported Outcome Measures ◽  
Patient Reported Outcome ◽  
Measurement Properties ◽  
Future Studies ◽  
Patient Reported ◽  
Eortc Qlq

Abstract Background Breast reconstruction (BR) is performed to improve outcomes for patients undergoing mastectomy. A recently developed core outcome set for BR includes six patient-reported outcomes that should be measured and reported in all future studies. It is vital that any instrument used to measure these outcomes as part of a core measurement set be robustly developed and validated so data are reliable and accurate. The aim of this systematic review is to evaluate the development and measurement properties of existing BR patient-reported outcome measures (PROMs) to inform instrument selection for future studies. Methods A PRISMA-compliant systematic review of development and validation studies of BR PROMs was conducted to assess their measurement properties. PROMs with adequate content validity were assessed using three steps: (1) the methodological quality of each identified study was assessed using the COSMIN Risk of Bias checklist; (2) criteria were applied for assessing good measurement properties; and (3) evidence was summarized and the quality of evidence assessed using a modified GRADE approach. Results Fourteen articles reported the development and measurement properties of six PROMs. Of these, only three (BREAST-Q, BRECON-31, and EORTC QLQ-BRECON-23) were considered to have adequate content validity and proceeded to full evaluation. This showed that all three PROMs had been robustly developed and validated and demonstrated adequate quality. Conclusions BREAST-Q, BRECON-31, and EORTC QLQ-BRECON-23 have been well-developed and demonstrate adequate measurement properties. Work with key stakeholders is now needed to generate consensus regarding which PROM should be recommended for inclusion in a core measurement set.

scholarly journals Quality assessment with diverse studies (QuADS): an appraisal tool for methodological and reporting quality in systematic reviews of mixed- or multi-method studies

2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Reema Harrison ◽  
Benjamin Jones ◽  
Peter Gardner ◽  
Rebecca Lawton
Keyword(s):  
Health Services Research ◽  
Health Services ◽  
Literature Review ◽  
Quality Assessment ◽  
Systematic Reviews ◽  
Content Validity ◽  
Reporting Quality ◽  
Services Research ◽  
Appraisal Tool

Abstract Background In the context of the volume of mixed- and multi-methods studies in health services research, the present study sought to develop an appraisal tool to determine the methodological and reporting quality of such studies when included in systematic reviews. Evaluative evidence regarding the design and use of our existing Quality Assessment Tool for Studies with Diverse Designs (QATSDD) was synthesised to enhance and refine it for application across health services research. Methods Secondary data were collected through a literature review of all articles identified using Google Scholar that had cited the QATSDD tool from its inception in 2012 to December 2019. First authors of all papers that had cited the QATSDD (n=197) were also invited to provide further evaluative data via a qualitative online survey. Evaluative findings from the survey and literature review were synthesised narratively and these data used to identify areas requiring refinement. The refined tool was subject to inter-rater reliability, face and content validity analyses. Results Key limitations of the QATSDD tool identified related to a lack of clarity regarding scope of use of the tool and in the ease of application of criteria beyond experimental psychological research. The Quality Appraisal for Diverse Studies (QuADS) tool emerged as a revised tool to address the limitations of the QATSDD. The QuADS tool demonstrated substantial inter-rater reliability (k=0.66), face and content validity for application in systematic reviews with mixed, or multi-methods health services research. Conclusion Our findings highlight the perceived value of appraisal tools to determine the methodological and reporting quality of studies in reviews that include heterogeneous studies. The QuADS tool demonstrates strong reliability and ease of use for application to multi or mixed-methods health services research.

Sign in / Sign up

Export Citation Format

Share Document