scholarly journals Development of the Home Cooking EnviRonment and Equipment Inventory Observation form (Home-CookERITM): An Assessment of Content Validity, Face Validity, and Inter-Rater Agreement

Nutrients ◽  
2020 ◽  
Vol 12 (6) ◽  
pp. 1853
Author(s):  
Sonja Schönberg ◽  
Roberta Asher ◽  
Samantha Stewart ◽  
Matthew J. Fenwick ◽  
Lee Ashton ◽  
...  
Keyword(s):  
Content Validity ◽  
Online Survey ◽  
Telephone Interview ◽  
Face Validity ◽  
Alcoholic Beverages ◽  
Rater Agreement ◽  
Nutrition Interventions ◽  
Domestic Spaces ◽  
Home Cooking ◽  
Nutrition Epidemiology

Introduction: Quantifying Home Cooking EnviRonments has applications in nutrition epidemiology, health promotion, and nutrition interventions. This study aimed to develop a tool to quantify household cooking environments and establish its content validity, face validity, and inter-rater agreement. Methods: The Home Cooking EnviRonment and equipment Inventory observation form (Home-CookERI™) was developed as a 24-question (91-item) online survey. Items included domestic spaces and resources for storage, disposal, preparation, and cooking of food or non-alcoholic beverages. Home-CookERITM was piloted to assess content validity, face validity, and usability with six Australian experts (i.e., dietitians, nutrition researchers, chefs, a food technology teacher, and a kitchen designer) and 13 laypersons. Pilot participants provided feedback in a 10 min telephone interview. Home-CookERI™ was modified to an 89-item survey in line with the pilot findings. Inter-rater agreement was examined between two trained raters in 33 unique Australian households. Raters were required to observe each item before recording a response. Home occupants were instructed to only assist with locating items if asked. Raters were blinded to each other’s responses. Inter-rater agreement was calculated by Cohen’s Kappa coefficient (κ) for each item. To optimize κ, similar items were grouped together reducing the number of items to 81. Results: Home-CookERITM had excellent content and face validity with responding participants; all 24 questions were both clear and relevant (X2 (1, n = 19; 19.0, p = 0.392)). Inter-rater agreement for the modified 81-item Home-CookERI™ was almost-perfect to perfect for 46% of kitchen items (n = 37 items, κ = 0.81–1), moderate to substantial for 28% (n = 23, κ = 0.51–0.8), slight to fair for 15% (n = 12, κ = 0.01–0.5), and chance or worse for 11% of items (n = 9, κ ≤ 0.0). Home-CookERITM was further optimized by reduction to a 77-item version, which is now available to researchers. Conclusion: Home-CookERI™ is a comprehensive tool for quantifying Australian household cooking environments. It has excellent face and content validity and moderate to perfect inter-rater agreement for almost three-quarters of included kitchen items. To expand Home-CookERI™ applications, a home occupant self-completion version is planned for validation.

Feasibility, face, and content validity of quantitative computed tomography in interstitial lung disease related to connective tissue diseases

2021 ◽  
Vol 0 (0) ◽  
Author(s):  
Gianluca Sambataro ◽  
Domenico Sambataro ◽  
Martina Orlandi ◽  
Sofia Battisti ◽  
Lorenzo Cavagna ◽  
...  
Keyword(s):  
Computed Tomography ◽  
Interstitial Lung Disease ◽  
Connective Tissue ◽  
Lung Disease ◽  
Content Validity ◽  
Online Survey ◽  
Objective Assessment ◽  
Quantitative Computed Tomography ◽  
Connective Tissue Diseases ◽  
Face Validity

Abstract Objectives Quantitative computed tomography (QCT) is a promising tool for objective assessment of interstitial lung disease (ILD) related to connective tissue diseases (CTD). However, its validity was never investigated. The aim of this study was to assess QCT feasibility, face, and content validity evaluation concerning CTD-ILD. Methods A rheumatologist and a chest radiologist conceived an online survey with nine statements: Two about general issue involving CTD-ILD, one for the face validity, three both for content validity and feasibility. Each statement had to be rated with a score from 0 to 100, respectively, (complete disagreement and agreement). We considered a statement supported by the experts if the median score was ≥75.0. Results A panel of 14 experts (11 from Europe, three from America) with a nine years median experience was enrolled. All the statements about feasibility, face and content validity were supported, except for QCT capability to recognize elementary lesions. Conclusions The panel of experts supported feasibility, face, and content validity of QCT assessment concerning CTD-ILD. This may stimulate a greater use in clinical practice and further studies to confirm its discriminative properties and its construct validity.

scholarly journals The I-DECIDED clinical decision-making tool for peripheral intravenous catheter assessment and safe removal: a clinimetric evaluation

BMJ Open ◽  
2020 ◽  
Vol 10 (1) ◽  
pp. e035239 ◽  
Author(s):  
Gillian Ray-Barruel ◽  
Marie Cooke ◽  
Vineet Chopra ◽  
Marion Mitchell ◽  
Claire M Rickard
Keyword(s):  
Decision Making ◽  
Vascular Access ◽  
Content Validity ◽  
Online Survey ◽  
Clinical Decision Making ◽  
Decision Time ◽  
Face Validity ◽  
Intravenous Catheter ◽  
Rater Reliability ◽  
Peripheral Intravenous Catheter

ObjectiveTo describe the clinimetric validation of the I-DECIDED tool for peripheral intravenous catheter assessment and decision-making.Design and settingI-DECIDED is an eight-step tool derived from international vascular access guidelines into a structured mnemonic for device assessment and decision-making. The clinimetric evaluation process was conducted in three distinct phases.MethodsInitial face validity was confirmed with a vascular access working group. Next, content validity testing was conducted via online survey with vascular access experts and clinicians from Australia, the UK, the USA and Canada. Finally, inter-rater reliability was conducted between 34 pairs of assessors for a total of 68 peripheral intravenous catheter (PIVC) assessments. Assessments were timed to ensure feasibility, and the second rater was blinded to the first’s findings. Content validity index (CVI), mean item-level CVI (I-CVI), internal consistency, mean proportion of agreement, observed and expected inter-rater agreements, and prevalence-adjusted bias-adjusted kappas (PABAK) were calculated. Ethics approvals were obtained from university and hospital ethics committees.ResultsThe I-DECIDED tool demonstrated strong content validity among international vascular access experts (n=7; mean I-CVI=0.91; mean proportion of agreement=0.91) and clinicians (n=11; mean I-CVI=0.93; mean proportion of agreement=0.94), and high inter-rater reliability in seven adult medical-surgical wards of three Australian hospitals. Overall, inter-rater reliability was 87.13%, with PABAK for each principle ranging from 0.5882 (‘patient education’) to 1.0000 (‘document the decision’). Time to complete assessments averaged 2 min, and nurse-reported acceptability was high.ConclusionThis is the first comprehensive, evidence-based, valid and reliable PIVC assessment and decision tool. We recommend studies to evaluate the outcome of implementing this tool in clinical practice.Trial registration number12617000067370

Evaluation of the Modified Naranjo Criteria for Assessing Causal Attribution of Clinical Outcome to Homeopathic Intervention as Presented in Case Reports

Homeopathy ◽  
2020 ◽  
Vol 109 (04) ◽  
pp. 191-197
Author(s):  
Chetna Deep Lamba ◽  
Vishwa Kumar Gupta ◽  
Robbert van Haselen ◽  
Lex Rutten ◽  
Nidhi Mahajan ◽  
...  
Keyword(s):  
Clinical Outcome ◽  
Causal Relationship ◽  
Clinical Case ◽  
Assessment Tool ◽  
Causal Attribution ◽  
Case Reports ◽  
Face Validity ◽  
Rater Agreement ◽  
The Face ◽  
Selection Of

Abstract Objectives The objective of this study was to establish the reliability and content validity of the “Modified Naranjo Criteria for Homeopathy—Causal Attribution Inventory” as a tool for attributing a causal relationship between the homeopathic intervention and outcome in clinical case reports. Methods Purposive sampling was adopted for the selection of information-rich case reports using pre-defined criteria. Eligible case reports had to fulfil a minimum of nine items of the CARE Clinical Case Reporting Guideline checklist and a minimum of three of the homeopathic HOM-CASE CARE extension items. The Modified Naranjo Criteria for Homeopathy Inventory consists of 10 domains. Inter-rater agreement in the scoring of these domains was determined by calculating the percentage agreement and kappa (κ) values. A κ greater than 0.4, indicating fair agreement between raters, in conjunction with the absence of concerns regarding the face validity, was taken to indicate the validity of a given domain. Each domain was assessed by four raters for the selected case reports. Results Sixty case reports met the inclusion criteria. Inter-rater agreement/concordance per domain was “perfect” for domains 1 (100%, κ = 1.00) and 2 (100%, κ = 1.00); “almost perfect” for domain 8 (97.5%, κ = 0.86); “substantial” for domains 3 (96.7%, κ = 0.80) and 5 (91.1%, κ = 0.70); “moderate” for domains 4 (83.3%, κ = 0.60), 7 (67.8%, κ = 0.46) and 9 (99.2%, κ = 0.50); and “fair” for domain 10 (56.1%, κ = 0.38). For domains 6A (46.7%, κ = 0.03) and 6B (50.3%, κ = 0.18), there was “slight agreement” only. Thus, the validity of the Modified Naranjo Criteria for Homeopathy tool was established for each of its domains, except for the two that pertain to direction of cure (domains 6A and 6B). Conclusion The Modified Naranjo Criteria for Homeopathy—Causal Attribution Inventory was identified as a valid tool for assessing the likelihood of a causal relationship between a homeopathic intervention and clinical outcome. Improved wordings for several criteria have been proposed for the assessment tool, under the new acronym “MONARCH”. Further assessment of two MONARCH domains is required.

Kinesio tape in paediatric physiotherapy: A content analysis of practitioner experience

2021 ◽  
pp. 1-9
Author(s):  
Claire Smart ◽  
Kylie Murphy ◽  
Kristen Andrews ◽  
Donalee Gregory
Keyword(s):  
Content Analysis ◽  
Muscle Activation ◽  
Online Survey ◽  
Telephone Interview ◽  
Small Body ◽  
Exact Nature ◽  
Kinesio Tape ◽  
Application Methods ◽  
Basic Content

INTRODUCTION: Kinesio tape (KT) is an emerging tool in paediatric physiotherapy. A small body of research suggests KT is efficacious with some children, but clinical guidelines are not yet available. The aim of this study was to gather physiotherapists’ practices and experiences using KT with children. The focus was on why, where, how, and how long physiotherapists use KT with children, and the outcomes they observe, to guide future experimental research. METHOD: Nine Australian physiotherapists, each with at least two years of experience using KT with children, were recruited. All nine physiotherapists completed a largely open-ended online survey, and three of these physiotherapists participated in a brief follow-up telephone interview. Basic content analysis was conducted. RESULTS: The physiotherapists’ practices and experience with KT largely related to four themes: (1) taping for muscle activation; (2) gait and posture outcomes; (3) child tolerance limiting effectiveness; and (4) inconsistent application methods and treatment durations. CONCLUSION: Physiotherapists in this study used KT to serve a variety of purposes, it was mainly considered beneficial for improving gait and posture. However, there was little agreement regarding how to apply it, for how long, and the exact nature of its benefits. Empirical research is also lacking on these questions. The effectiveness of KT as an adjunct therapy for improving children’s posture and gait warrants further investigation. Research comparing specific taping application methods and durations will be valuable in guiding physiotherapists’ practice.

Psychometric Assessment of the Persian Translated Version of the Romantic Perfectionism Scale Among Couples

2021 ◽  
pp. 003329412110360
Author(s):  
Abbas Abdollahi ◽  
Kelly A. Allen
Keyword(s):  
Content Validity ◽  
Goodness Of Fit ◽  
Factor Loading ◽  
Face Validity ◽  
Fit Indices ◽  
Depression Anxiety Stress Scale ◽  
Confirmatory Factor ◽  
Married Men ◽  
Iranian Version ◽  
Acceptable Internal Consistency

Romantic perfectionismi can be disruptive to relationships, yet no validated measure for assessing romantic perfectionism in Iranian couples has been developed. Therefore, the purpose of this study was to translate and validate the Romantic Perfectionism Scale (RPS) among Iranian couples. Participants in the study were 200 married men and 320 married women from Tehran, Iran, who completed the translated RPS, the Almost Perfect Scale-Revised, and the Depression Anxiety Stress Scale-21 online. Item impact scores were used to calculate face validity. Impact score values for all items were greater than 1.5, signaling appropriate face validity.. The Content Validity Index (CVI) and the Content Validity Ratio (CVR) were used to measure content validity. Values of the CVI were above the cut-off score of 0.7, implying satisfactory content validity of the items. The CVR values were greater than the Lawshe table (0.78) cut-off score, demonstrating that all items were essential. Confirmatory Factor Analysis (CFA) using AMOS software was used to evaluate the construct validity. The results of the goodness of fit indices confirmed the RPS with two subscales (i.e., self-oriented romantic perfectionism and other-oriented romantic perfectionism) as per the original scale. All items remained in the scale as all factor loading values were greater than 0.45. The findings showed that the two subscales, and the scale as a whole, had acceptable internal consistency, as the construct reliability values for self-oriented romantic perfectionism (0.81), other-oriented romantic perfectionism (0.72), and the whole scale (0.74) were greater than 0.7. The results support the psychometric properties of the Iranian version of the RPS, which could be used by future researchers and clinicians to assess romantic perfectionism in Iranian couples.

scholarly journals Brief Montreal-Toulouse Language Assessment Battery: adaptation and content validity

2020 ◽  
Vol 33 (1) ◽  
Author(s):  
Raira Fernanda Altmann ◽  
Karin Zazo Ortiz ◽  
Tainá Rossato Benfica ◽  
Eduarda Pinheiro de Oliveira ◽  
Karina Carlesso Pagliarin
Keyword(s):  
Content Validity ◽  
Assessment Instrument ◽  
Rater Agreement ◽  
Language Abilities ◽  
Pilot Studies ◽  
Brief Assessment ◽  
Effective Interventions ◽  
Stage 4 ◽  
Language Assessment Battery ◽  
Stage 1

Abstract Background Evaluating patients in the acute phase of brain damage allows for the early detection of cognitive and linguistic impairments and the implementation of more effective interventions. However, few cross-cultural instruments are available for the bedside assessment of language abilities. The aim of this study was to develop a brief assessment instrument and evaluate its content validity. Methods Stimuli for the new assessment instrument were selected from the M1-Alpha and MTL-BR batteries (Stage 1). Sixty-five images were redesigned and analyzed by non-expert judges (Stage 2). This was followed by the analysis of expert judges (Stage 3), where nine speech pathologists with doctoral training and experience in aphasiology and/or linguistics evaluated the images, words, nonwords, and phrases for inclusion in the instrument. Two pilot studies (Stage 4) were then conducted in order to identify any remaining errors in the instrument and scoring instructions. Results Sixty of the 65 figures examined by the judges achieved inter-rater agreement rates of at least 80%. Modifications were suggested to 22 images, which were therefore reanalyzed by the judges, who reached high levels of inter-rater agreement (AC1 = 0.98 [CI = 0.96–1]). New types of stimuli such as nonwords and irregular words were also inserted in the Brief Battery and favorably evaluated by the expert judges. Optional tasks were also developed for specific diagnostic situations. After the correction of errors detected in Stage 4, the final version of the instrument was obtained. Conclusion This study confirmed the content validity of the Brief MTL-BR Battery. The method used in this investigation was effective and can be used in future studies to develop brief instruments based on preexisting assessment batteries.

Development and Validity of Questionnaire for Healthy Adult Human Participants of Early Phase Bioequivalence Pharmacokinetic Endpoint Study

2021 ◽  
pp. 111-117
Author(s):  
Sharad Desai ◽  
Nilesh Patel
Keyword(s):  
Content Validity ◽  
Early Phase ◽  
Literature Search ◽  
Healthy Adult ◽  
Face Validity ◽  
Domain Identification ◽  
Adult Human ◽  
Human Participants ◽  
Development And Validation ◽  
Validation Of Questionnaire

Participation of humans in clinical research is always remained questionable. Hence evaluation of such doubt helps to conclude the perception about such participation. This research presents the process for development and validation of questionnaire for Healthy Adult Human Participants of Early Phase Bioequivalence Pharmacokinetic Endpoint Study. For development of questionnaire, literature search, experts’ discussion and authors’ experience was used for domain identification and its segregation for different variables. For validity of questionnaire, face validity and content validity was performed. Modification was done based on response from experts during non-quantitative face validity. % of overall agreement was 94.55 for question asked in face validity. While, Content Validity Ratio and Content Validity Index was calculated using the process mentioned by Lawshe and Lynn respectively. Initially 83 items were identified but based on validation 84 items were finalized after removal of three and addition of four questions. Deleted three items had Content Validity Ratio of 0.00, 0.67 and 0.67 and which were below accepted level of 0.99. While, I-CVI was observed from range of 0.83 to 1.00 and S-CVI values were above acceptable level of 0.90 for S-CVI (S-CVI/ Ave) and 0.80 for S-CVI (S-CVI/UA) for whole questionnaire and each part.

scholarly journals Validity and Reliability of the Scale, Role Taking in Caregivers of People with Chronic Disease, ROL

10.3823/2575 ◽  
2018 ◽  
Vol 11 ◽  
Author(s):  
Mauricio Arias ◽  
Sonia Carreño ◽  
Lorena Chaparro
Keyword(s):  
Factor Analysis ◽  
Chronic Disease ◽  
Construct Validity ◽  
Internal Consistency ◽  
Content Validity ◽  
Three Dimensions ◽  
Face Validity ◽  
Validity And Reliability ◽  
Role Taking ◽  
Phase Study

Objective: To determine face, content, and construct validity, and internal consistency of ROL scale. Methods and Findings: A three-phase study was conducted. First, content analysis of the scale was carried out consulting 10 professional experts. Then, face validity was analyzed with 60 caregivers. Finally, construct validity was evaluated by performing an exploratory factor analysis (EFA) with 110 participants. Internal consistency of ROL scale was also assessed. Face validity of ROL scale reached a high acceptance index in three dimensions: role performance (0.97), role organization (0.98), and response to the role (0.98). Content validity showed coherence, clarity, and relevance of the scale. From factor analysis, three components emerged and were grouped in the same manner for varimax, quartimax, and equimax rotations. Cronbach's alpha was 0.816, which is an acceptable overall value. Conclusion: ROL scale makes objective the concept of role taking in family caregivers of people with chronic disease. It demonstrated to have acceptable reliability, and construct, face, and content validity to be used in the Colombian context. Keywords: Validation Study, Caregivers, Health Transitions, Chronic Disease.

Sign in / Sign up

Export Citation Format

Share Document