scholarly journals Content and Face Validation of a Novel, Interactive Nutrition Specific Physical Exam Competency Tool (INSPECT) to Evaluate Registered Dietitians’ Competence: A Delphi Consensus from the United States

Healthcare ◽  
2021 ◽  
Vol 9 (9) ◽  
pp. 1225
Author(s):  
Sunitha Zechariah ◽  
Jennifer L. Waller ◽  
Gianluca De Leo ◽  
Judith Stallings ◽  
Ashley J. Gess ◽  
...  

The nutrition-focused physical examination (NFPE) is an integral component of nutrition assessment performed by registered dietitian nutritionists (RDNs) to determine signs of malnutrition and other nutrition-related complications. Increased use of this essential skill among RDNs and the transformation of dietetics education to a competency-based model in the near future calls for appropriately validated tools to measure RDNs’ NFPE competence. To fill the need for a validated competency tool, this study developed an Interactive Nutrition-Specific Physical Exam Competency Tool (INSPECT) utilizing the initial 70 items identified in the first phase of the study. The second phase of this study aimed to test the preliminary version of the INSPECT for content and face validity. An expert panel of 17 members provided consensus recommendations through the Delphi process. Internal consistency of the consensus was measured with Cronbach’s alpha (α) and α of ≥0.70 was defined as acceptable a priori. Inter-rater agreement among the expert panel was determined using the intraclass correlation coefficient (ICC) and an a priori ICC of 0.75 to 0.9 was established as good and >0.9 as excellent agreement. The results showed acceptable face validity (α = 0.71) and excellent content validity for the INSPECT, with an internal consistency of α = 0.97 in the first round and α = 0.96 in the second round. The inter-rater agreement was also excellent with ICC = 0.95 for each of the Delphi rounds. A total of 52 items were retained from the preliminary version of the INSPECT. Open feedback from the experts allowed for the consolidation of 11 similar items for better scoring and evaluation and thus, a total of 41 items were included in the final version of the INSPECT. The final version of the INSPECT is currently being studied in real-life, multi-site clinical settings among practicing RDNs to examine construct validity, reliability, and item-level psychometric properties. Ultimately, the validated INSPECT will be available for the competency evaluation of RDNs practicing in clinical settings.

Author(s):  
Ine Janssens ◽  
Margot Van Hauwe ◽  
Michael Ceulemans ◽  
Karel Allegaert

There is a need to assess the knowledge of healthcare providers on the use of maternal analgesics during lactation, while a valid instrument is not yet available. This study aimed to develop a valid and reliable questionnaire on the knowledge of analgesics (acetaminophen, ibuprofen, aspirin, tramadol, codeine, oxycodone) during lactation, using a prospective, stepwise approach. To generate a pool of item subgroups, literature was assessed as first step. This preliminary version was subsequently reviewed in two focus groups [midwives (n=4), pediatric nurses (n=6)], followed by an expert panel (n=7, 2 rounds) to confirm content validity [item-level and scale content validity]. This resulted in a instrument consisting of 33 questions, and 5 clincial case descriptions specific for both disciplines. Based on known-groups validity between midwives and pediatric nurses (assuming an a priori difference related to their curricula), high construct validity was subsequently demonstrated in a pilot e-survey (86 midwives, 73 pediatric nurses). We therefore conclude that an instrument to assess knowledge on lactation-related exposure to analgesics was generated, that can be further developed and validated. Furthermore, pilot findings suggest suboptimal knowledge for both professions, so that adaptations in their curricula and postgraduate training are warranted.


Homeopathy ◽  
2020 ◽  
Vol 109 (04) ◽  
pp. 191-197
Author(s):  
Chetna Deep Lamba ◽  
Vishwa Kumar Gupta ◽  
Robbert van Haselen ◽  
Lex Rutten ◽  
Nidhi Mahajan ◽  
...  

Abstract Objectives The objective of this study was to establish the reliability and content validity of the “Modified Naranjo Criteria for Homeopathy—Causal Attribution Inventory” as a tool for attributing a causal relationship between the homeopathic intervention and outcome in clinical case reports. Methods Purposive sampling was adopted for the selection of information-rich case reports using pre-defined criteria. Eligible case reports had to fulfil a minimum of nine items of the CARE Clinical Case Reporting Guideline checklist and a minimum of three of the homeopathic HOM-CASE CARE extension items. The Modified Naranjo Criteria for Homeopathy Inventory consists of 10 domains. Inter-rater agreement in the scoring of these domains was determined by calculating the percentage agreement and kappa (κ) values. A κ greater than 0.4, indicating fair agreement between raters, in conjunction with the absence of concerns regarding the face validity, was taken to indicate the validity of a given domain. Each domain was assessed by four raters for the selected case reports. Results Sixty case reports met the inclusion criteria. Inter-rater agreement/concordance per domain was “perfect” for domains 1 (100%, κ = 1.00) and 2 (100%, κ = 1.00); “almost perfect” for domain 8 (97.5%, κ = 0.86); “substantial” for domains 3 (96.7%, κ = 0.80) and 5 (91.1%, κ = 0.70); “moderate” for domains 4 (83.3%, κ = 0.60), 7 (67.8%, κ = 0.46) and 9 (99.2%, κ = 0.50); and “fair” for domain 10 (56.1%, κ = 0.38). For domains 6A (46.7%, κ = 0.03) and 6B (50.3%, κ = 0.18), there was “slight agreement” only. Thus, the validity of the Modified Naranjo Criteria for Homeopathy tool was established for each of its domains, except for the two that pertain to direction of cure (domains 6A and 6B). Conclusion The Modified Naranjo Criteria for Homeopathy—Causal Attribution Inventory was identified as a valid tool for assessing the likelihood of a causal relationship between a homeopathic intervention and clinical outcome. Improved wordings for several criteria have been proposed for the assessment tool, under the new acronym “MONARCH”. Further assessment of two MONARCH domains is required.


2013 ◽  
Vol 37 (7) ◽  
pp. 221-227 ◽  
Author(s):  
Bridey Monger ◽  
Scott M. Hardie ◽  
Robin Ion ◽  
Jane Cumming ◽  
Nigel Henderson

Aims and methodThe Individual Recovery Outcomes Counter (I.ROC) is to date the only recovery outcomes instrument developed in Scotland. This paper describes the steps taken to initially assess its validity and reliability, including factorial analysis, internal consistency and a correlation benchmarking analysis.ResultsThe I.ROC tool showed high internal consistency. Exploratory factor analysis indicated a two-factor structure comprising intrapersonal recovery (factor 1) and interpersonal recovery (factor 2), explaining between them over 50% of the variance in I.ROC scores. There were no redundant items and all loaded on at least one of the factors. The I.ROC significantly correlated with widely used existing instruments assessing both personal recovery and clinical outcomes.Clinical implicationsI.ROC is a valid and reliable measure of recovery in mental health, preferred by service users when compared with well-established instruments. It could be used in clinical settings to map individual recovery, providing feedback for service users and helping to assess service outcomes.


2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Adam Polnay ◽  
Helen Walker ◽  
Christopher Gallacher

Purpose Relational dynamics between patients and staff in forensic settings can be complicated and demanding for both sides. Reflective practice groups (RPGs) bring clinicians together to reflect on these dynamics. To date, evaluation of RPGs has lacked quantitative focus and a suitable quantitative tool. Therefore, a self-report tool was designed. This paper aims to pilot The Relational Aspects of CarE (TRACE) scale with clinicians in a high-secure hospital and investigate its psychometric properties. Design/methodology/approach A multi-professional sample of 80 clinicians were recruited, completing TRACE and attitudes to personality disorder questionnaire (APDQ). Exploratory factor analysis (EFA) determined factor structure and internal consistency of TRACE. A subset was selected to measure test–retest reliability. TRACE was cross-validated against the APDQ. Findings EFA found five factors underlying the 20 TRACE items: “awareness of common responses,” “discussing and normalising feelings;” “utilising feelings,” “wish to care” and “awareness of complicated affects.” This factor structure is complex, but items clustered logically to key areas originally used to generate items. Internal consistency (α = 0.66, 95% confidence interval (CI) = 0.55–0.76) demonstrated borderline acceptability. TRACE demonstrated good test–retest reliability (intra-class correlation = 0.94, 95% CI = 0.78–0.98) and face validity. TRACE indicated a slight negative correlation with APDQ. A larger data set is needed to substantiate these preliminary findings. Practical implications Early indications suggested TRACE was valid and reliable, suitable to measure the effectiveness of reflective practice. Originality/value The TRACE was a distinctive measure that filled a methodological gap in the literature.


QJM ◽  
2021 ◽  
Vol 114 (Supplement_1) ◽  
Author(s):  
Nour Muhammad Raouf Elmessiri ◽  
Hussien Ahmed Elkholy ◽  
Mohamed Farouk Allam ◽  
Diaa Marzouk Abd el-Hamid

Abstract Background The four-dimensional symptom questionnaire (4DSQ) is a Dutch self-administered screening tool that has been developed in primary care to differentiate non pathologic general distress from depression, anxiety and somatization. It has been validated in the English language as well as other languages yet it has not been validated in Arabic. For the sake of developing the appropriate Arabic version, linguistic validation has been sought with the guidance of crosscultural adaptation guidelines. Objective To design the appropriate Arabic version of the 4DSQ that has linguistic and conceptual equivalence to its validated English version and that is appropriate for administration to Egyptian primary care attendees. Methods The validated English version of the 4DSQ was translated by 5 translators (including specialist psychiatrist, internists and English language specialist) into Arabic (Egyptian spoken dialect) without mutual consultation. An expert committee that consisted of 2 professors of public health and family medicine and an associate professor of neuropsychiatry was formed. The consensus version was created after expert committee modification and approval of each questionnaire item using DELPHI method. After that the back translation to English was carried out by two independent bilingual physicians whose English is their mother tongue. A pilot study was carried out on 17 bilingual participants after answering the questionnaire in both languages to test its equivalence. The consensus Arabic version was updated based on the pilot study and the final version was developed. The final version was then tested on 278 Egyptian primary care attendees. Results After the course of forward and back translation, expert committee’s review and developer’s comments, the final version of Arabic 4DSQ was developed for assessment of distress, depression, anxiety and somatization. There was no significant difference between results of Arabic and English questionnaire using paired T test. Final testing showed very good internal consistency of each of the 4 scales of the questionnaire. Conclusion The Arabic 4DSQ linguistically and conceptually corresponds to the validated English 4DSQ. It has good structural validity and internal consistency reliability and thus could be used in primary care after further psychometric validation.


Author(s):  
Eliza M. Park ◽  
Mian Wang ◽  
Savannah M. Bowers ◽  
Anna C. Muriel ◽  
Paula K. Rauch ◽  
...  

Purpose: When patients with advanced cancer have minor children (age < 18), their health-related quality of life is closely linked to their concerns about the impact of progressive illness and death on their children. The Parenting Concerns Questionnaire (PCQ), a validated measure for parents with cancer, does not capture the full range of concerns in advanced cancer. The aim of this was study was to adapt and establish psychometrics for the PCQ for advanced disease (PCQ-AD). Methods: After generating an initial item-bank, we conducted concept elicitation interviews with clinicians (n = 8) and cognitive interviews with patients (n = 23) for face validity. New items addressed concerns about impact of parental death, making every moment count, communication, and financial impact of cancer on children. We administered 21 candidate items to 151 parents with advanced cancer. We conducted confirmatory factor analysis (CFA), calculated internal consistency, and assessed convergent and known-groups validity. Results: We removed 8 redundant items due to residual covariation between items. CFA of the 13-item PCQ-AD demonstrated satisfactory fit (CFI = 0.971, TLI = 0.966, RMSEA = 0.081) and high internal consistency (Cronbach’s alpha = 0.94, composite reliability = 0.95). The PCQ-AD demonstrated convergent validity and known-groups validity; patients with poor functional status reported higher scores than patients with better functional status (Cohen’s d = 0.56, p = 0.002). Conclusion: Adaptation of the PCQ yielded the addition of constructs important in advanced cancer. The PCQ-AD appears to be a reliable and valid measure of parenting concerns in advanced cancer, but future studies are needed to examine measure performance in diverse populations and responsiveness of the PCQ-AD to interventions.


2018 ◽  
Vol 7 (3) ◽  
pp. 581-604 ◽  
Author(s):  
Armin Eftekhari ◽  
Michael B Wakin ◽  
Rachel A Ward

Abstract Leverage scores, loosely speaking, reflect the importance of the rows and columns of a matrix. Ideally, given the leverage scores of a rank-r matrix $M\in \mathbb{R}^{n\times n}$, that matrix can be reliably completed from just $O (rn\log ^{2}n )$ samples if the samples are chosen randomly from a non-uniform distribution induced by the leverage scores. In practice, however, the leverage scores are often unknown a priori. As such, the sample complexity in uniform matrix completion—using uniform random sampling—increases to $O(\eta (M)\cdot rn\log ^{2}n)$, where η(M) is the largest leverage score of M. In this paper, we propose a two-phase algorithm called MC2 for matrix completion: in the first phase, the leverage scores are estimated based on uniform random samples, and then in the second phase the matrix is resampled non-uniformly based on the estimated leverage scores and then completed. For well-conditioned matrices, the total sample complexity of MC2 is no worse than uniform matrix completion, and for certain classes of well-conditioned matrices—namely, reasonably coherent matrices whose leverage scores exhibit mild decay—MC2 requires substantially fewer samples. Numerical simulations suggest that the algorithm outperforms uniform matrix completion in a broad class of matrices and, in particular, is much less sensitive to the condition number than our theory currently requires.


2020 ◽  
Author(s):  
Moira Dean ◽  
Johann Issartel ◽  
Tony Benson ◽  
Amanda McCloat ◽  
Elaine Mooney ◽  
...  

Abstract Background Learning cooking skills during childhood and adolescence is associated with positive dietary outcomes in adulthood as well as being tracked from adolescence to adulthood. In addition studies have found that perceived competence to be a greater motivator to perform a behaviour than actual competence. However, a lack of validated tools that effectively measure behavioural and dietary changes and other related measures in children is a limitation. Therefore, this research aimed to develop and validate age-appropriate perceived cooking competence measures for younger and older primary school aged children. Methods Two measures of perceived Cooking Competence (CooC11 and CooC7) for older (8–12 years) and younger (6–7 years) children were developed from a critical evaluation of publically available recommendations and expert consultation. The cooking skills within the measures were illustrated by a graphic designer in consultation with a chef and reviewed in an iterative manner by the research team. The measures were piloted for clarity, ease of use and initial face validity. Multiple studies were used for both CooC11 and CooC7 to establish psychometric properties of the measures, temporal stability, internal consistency reliability, construct validity, as well as responsiveness to change for CooC11. Analysis included Exploratory Factor Analysis, Confirmatory Factor Analysis, Intraclass Correlation Coefficients, Pearson’s Correlations, ANOVAs and Cronbach’s Alphas. Results Both measures had high levels of face validity and received positive user feedback. Two factors were shown in both measures with the measures showing excellent temporal stability (ICC > 0.9) and good internal consistency (Cronbach’s Alphas > 0.7). Both measures showed initial discriminant validity, with significant differences (P < 0.001) between those who reported assisting their parents with dinner preparation and those who did not. Additionally, CooC11 was significantly correlated with an adult cooking measure and had a significant responsiveness to change (P < 0.01). Conclusions The CooC11 and CooC7 are the first validated age-appropriate measures for assessing children’s perceived Cooking Competence for ages 8–12 and 6–7 years respectively. They can be used to evaluate the efficacy of children’s cooking intervention studies or school nutrition education programmes.


2020 ◽  
Vol 42 (2) ◽  
pp. 153-162
Author(s):  
Clara Sandra de Araujo Sugizaki ◽  
Clarice Carneiro Braga ◽  
Ana Tereza Vaz de Souza Freitas ◽  
Maria do Rosário Gondim Peixoto

Abstract Objective: To produce a transcultural adaptation of the Thirst Distress Scale (TDS) into Brazilian Portuguese and analyze the scale’s psychometric properties for patients on hemodialysis (HD). Methods: The original scale was translated, back translated, and discussed with psychometric assessment experts. The final version was tested with 126 patients on HD and retested with 70 individuals from the original patient population. Cronbach’s alpha was used to measure the scale’s internal consistency. Reliability of thirst intensity evaluated via the visual analogue scale (VAS) was tested with Kappa statistic and the Bland-Altman plot. Reproducibility was assessed based on the intraclass correlation coefficient (ICC). Results: The wording of three items and the verb tenses of six had to be adjusted in the final version of the Brazilian Portuguese TDS. Comprehension of the scale by patients on HD was good, the scale’s internal consistency was satisfactory (0.84; p<0.001), agreement with a visual analogue scale (VAS) was moderate (kappa=0.44; p<0.001), and reproducibility neared perfection (ICC=0.87; p<0.001). Conclusion: Our results showed that the Brazilian Portuguese version of the scale might be used reliably. The Brazilian Portuguese version of the TDS is a practical, affordable, accessible and well-accepted tool that has a lot to offer for the management of patients with HD.


Sign in / Sign up

Export Citation Format

Share Document