scholarly journals Systematic review of instruments for assessing culinary skills in adults: What is the quality of their psychometric properties?

PLoS ONE ◽  
2021 ◽  
Vol 16 (8) ◽  
pp. e0235182
Author(s):  
Aline Rissatto Teixeira ◽  
Daniela Bicalho ◽  
Betzabeth Slater ◽  
Tacio de Mendonça Lima

Background Culinary skills are important objects of study in the field of Public Health. Studies that propose to develop instruments for assessing such construct show lack of methodological uniformity to report validity and reliability of their instruments. Objective To identify studies that have developed instruments to measure culinary skills in adult population, and critically assess their psychometric properties. Design We conducted a systematic review according to the PRISMA statement. We searched literature PubMed/Medline, Scopus, LILACS, and Web of Science databases until January 2021, and consulted Google Scholar for relevant grey literature. Two reviewers independently selected the studies, conducted data extraction, and assessed the psychometric quality of the instruments. A third reviewer resolved any doubts or disagreements in all steps of the systematic review. Results The search identified 1148 potentially relevant studies, out of which 9 met the inclusion criteria. In addition, we included 3 studies by searching the related articles and the reference lists of these studies, totaling 12 included studies in this review. Ten studies reported the development of tools measuring culinary skills in adults and 2 studies performed cross-cultural adaptations of original instruments. We considered adequate quality of internal consistency reliability in four studies. One study received adequate rating for test-retest reliability. No studies presented adequate rating for content validity and four studies showed satisfactory results for at least one type of construct validity. One study reported criterion validity and the quality of this psychometric property was inadequate. Conclusions We identified many studies that surveyed culinary skills. Although the isolated measures appraised in this review show good promise in terms of quality of psychometric properties, no studies presented adequate measures for each aspect of reliability and validity. A more consistent and consensual definition of culinary skills is recommended. The flaws observed in these studies show that there is a need for ongoing research in the area of the psychometric properties of instruments assessing culinary skills.

2020 ◽  
Author(s):  
Aline Rissatto Teixeira ◽  
Daniela Bicalho ◽  
Betzabeth Slater ◽  
Tacio de Mendonça Lima

AbstractBackgroundCulinary skills and food practices are important objects of study in the field of Public Health. Studies that propose to develop instruments for assessing such constructs show lack of methodological uniformity to provide evidence of validity and reliability of their instruments.ObjectiveTo identify studies that have developed instruments to measure culinary skills and other related concepts in adult population, and critically assess their psychometric properties.DesignA systematic review was conducted. A literature search was performed in PubMed/Medline, Scopus, LILACS, and Web of Science databases until June 2019. The Directory of Open Access Journals and Google Scholar databases were searched to identify relevant grey literature. Searching, selecting and reporting were done according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses Statement. Two reviewers were independently involved in study selection, data extraction, and instrument quality assessment. A third reviewer resolved all disagreements.ResultsThe search identified 1428 potentially relevant studies, out of which 18 had potentially relevant records and 8 met the inclusion criteria. Studies used literature, experts’ judgement, or qualitative interviews to develop the instruments. No studies received positive scores for all validity criteria. Although most studies received positive scores for internal consistency, none of them received positive scores for stability or presented evidence for content validity. One study showed positive results for construct validity. Two studies reported criterion validity, whose scores were deemed negative.ConclusionsMany studies that surveyed culinary skills and related latent phenomena were identified. The overall quality of the psychometric properties of most instruments was considered insufficient, especially for validity measures. A universal definition of culinary skills as an overarching construct is recommended. The flaws observed in these studies show that there is a need for ongoing research in the area of the psychometric properties of instruments assessing these constructs.


2020 ◽  
Author(s):  
Tahereh Mokhtarian-Gilani ◽  
Nourossadat kariman ◽  
Hamid Sharif-Nia ◽  
Mahbobeh Ahmadi-Doulabi ◽  
Malihe Nasiri

Abstract Background:The postpartum quality of life refers to women's understanding of their standing in the postpartum crisis that differs depending on their health status, social support, cultural status and values, attitudes, goals and standards. The present systematic review will identify, describe, and critically assess the psychometric properties of postpartum quality of life questionnaires.Methods/Design:A systematic review will be conducted in databases including PubMed, Embase, Scopus, Web of Science, PsycINFO, and CINAHL from January 2000 to January 2020. The psychometric properties (validity and reliability) of the instruments used in the primary studies will be assessed, and the selection, methodological quality assessment and data extraction processes of the studies will be independently assessed by two reviewers with expertise in conducting systematic reviews, so as to minimize potential personal bias. Eligible resources are selected after any lack of consensus is put to debate.The risk of bias is assessed using the COSMIN RISK of Bias checklist, and to evaluate the quality of the studies, the protocol is written based on the PRISMA-P1 standards. The results of the studies will be judged based on good measurement properties, and the results of all the studies are qualitatively summarized to produce a reference for the general quality of the results. The general quality of the evidence will be determined using a modified GRADE method.Discussion:This study assessed the psychometric properties of questionnaires used for assessing postpartum quality of life and its results can be used to identify the most appropriate tool for health applications in measuring postpartum quality of life. Systematic review registration: reference number in PROSPRO CRD42020166301


2019 ◽  
Vol 8 (1) ◽  
Author(s):  
Brett Williams ◽  
Bronwyn Beovich

Abstract Background Empathy is an important characteristic to possess for healthcare professionals. It has been found to improve communication between professionals and patients and to improve clinical health outcomes. The Jefferson Scale of Empathy (JSE) was developed to measure this quality and has been used extensively, and psychometrically appraised, with a variety of cohorts and in different cultural environments. However, no study has been undertaken to systematically examine the methodological quality of studies which have assessed psychometric factors of the JSE. This systematic review will examine the quality of published papers that have reported on psychometric factors of the JSE. Methods A systematic review of studies which report on the psychometric properties of the JSE will be conducted. We will use a predefined search strategy to identify studies meeting the following eligibility criteria: original data is reported on for at least one of the psychometric measurement properties described in the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) Risk of Bias checklist, examines the JSE in a healthcare cohort (using the student, physician or health profession versions of the JSE), and is published from January 2001 and in the English language. Conference abstracts, editorials and grey literature will be excluded. Six electronic databases (Medline, EMBASE, PsychInfo, PubMed, Web of Science and CINAHL) will be systematically searched for articles meeting these criteria and studies will be assessed for eligibility by two review authors. The methodological quality of included papers will be examined using the COSMIN Risk of Bias checklist. Discussion A narrative description of the findings will be presented along with summary tables. Recommendations for use of the JSE with various cohorts and circumstances will be offered which may inform future research in this field. Systematic review registration PROSPERO CRD42018111412


2019 ◽  
Vol 11 (5) ◽  
pp. 409-415 ◽  
Author(s):  
Fábio Carlos Lucas de Oliveira ◽  
Anny Fredette ◽  
Sherezada Ochoa Echeverría ◽  
Charles Sebiyo Batcho ◽  
Jean-Sébastien Roy

Context: Two-dimensional (2D) video-based analysis is often used by clinicians to examine the foot strike pattern (FSP) and step rate in runners. Reliability and validity of 2D video-based analysis have been questioned. Objective: To synthesize the psychometric properties of 2D video-based analysis for assessing runners’ FSP and step rate while running. Data Sources: Medline/PubMed, Science Direct, Embase, EBSCOHost/CINAHL, and Scielo were searched from their inception to August 2018. Study Selection: Studies were included if (1) they were published in English, French, Portuguese or Spanish; (2) they reported at least 1 psychometric property (validity and/or reliability) of 2D video-based analysis to assess running kinematics; and (3) they assessed FSP or step rate during running. Study Design: Systematic review. Level of Evidence: Level 2. Data Extraction: Studies were screened for methodological (MacDermid checklist) and psychometric quality (COSMIN checklist) by 2 independent raters. Results: Eight studies, with a total of 702 participants, were included. Seven studies evaluated the reliability of 2D video to assess FSP and found very good to excellent reliability (0.41 ≤ κ ≤ 1.00). Two studies reported excellent reliability for the calculation of step rate (0.75 ≤ intraclass correlation coefficient [ICC] ≤ 1.00). One study demonstrated excellent concurrent validity between 2D and 3D (gold standard) motion capture systems to determine FSP (Gwet agreement coefficient [AC] > 0.90; ICC > 0.90), and another study found excellent concurrent validity between 2D video and another device to calculate step rate (0.84 ≤ ICC ≤ 0.95). Conclusion: Strong evidence suggests that 2D video-based analysis is a reliable method for assessing FSP and quantifying step rate, regardless of the experience of the assessor. Limited evidence exists on the validity of 2D video-based analysis in determining FSP and calculating step rate during running.


Author(s):  
Restu Nur Hasanah Haris ◽  
Rahmat Makmur ◽  
Tri Murti Andayani ◽  
Susi Ari Kristina

Quality of life (HRQoL) is a measure of a person's health in physical, spiritual, and emotional, and role functions in the society. Measurement of quality of life (HRQoL) is an important thing to understand and evaluate. Measurements are carried out not only on patients but also on the general population with the use of specific or generic instruments. The instrument used requires a psychometric properties test to ensure its validity and reliability. This article aims to conduct a systematic review of the psychometric properties of quality of life (HRQoL) instruments in the general population. Articles were collected in December 1st to 5th, 2018, from Pubmed and Google Scholar. The assessment was carried out using the checklist properties according to the cohen criteria and included the content validity, construct validity, internal consistency reliability, test-retest, ceiling effect and the level of credibility of the instruments. Among 80 articles obtained there were 24 articles that fulfilled the inclusion criteria. Short Form-36 (SF-36) instrument is the most widely used instrument in measuring the quality of life in the general population (26.6%). Some instruments have not been tested according to the criteria, while almost all instruments show a good level of validation of construct validity using convergent and discriminat validity with cronbach alpha values > 0.7. Test-retest reliability provides a good correlation. Some instruments show a ceiling effect. According to the assessment, the SF-36, SF-6D, EQ-5D, SF-12 and PedsQoL instruments are considered as established instruments. Further validation testing is needed to provide and support the measurement of subsequent quality of life (HRQoL) instruments.


2021 ◽  
Author(s):  
Stephanie Maguire ◽  
Jenny Davison ◽  
Marian McLaughlin ◽  
Victoria Simms

Abstract Background Whilst there are studies that have systematically reviewed the psychometric properties of Quality-of-Life measures for children and young people experiencing intellectual disabilities, these narrowly focus on disease or health conditions. The objective of this planned systematic review is therefore to collate, summarise and critically appraise the psychometric properties of health and wellbeing measures used with adolescents (aged 11–16) with an intellectual disability. Methods We designed and registered a study protocol for a systematic review of studies which explores the psychometric properties of health and wellbeing measures used with adolescents experiencing intellectual disabilities. Electronic databases including PsycINFO, CINAHL, MEDLINE and ERIC will be searched using predefined search terms to identify relevant studies. Quantitative and mixed-methods studies, and studies published in peer-reviewed journals or grey literature will be included. Review papers, editorials and case studies will be excluded. Eligible studies should identify self and/or proxy reported health and wellbeing measures which assess health and wellbeing among adolescents with intellectual disabilities. The methodological quality of the included studies will be assessed by applying the COSMIN Risk of Bias Checklist. The quality of the evidence (i.e., the total body of evidence used for the overall ratings on each psychometric property of an instrument) will be evaluated in accordance with the GRADE guidelines. Discussion This systematic review will be among the first to systematically explore the psychometric properties of health and wellbeing measures used with adolescents experiencing intellectual disabilities. By providing evidence-based knowledge about measures being used in health and wellbeing research amongst this population, and more importantly how reliable and valid these measures are, the most suitable for use will be identified. Our findings will be of potential interest to clinicians, researchers and service providers who need information about the methodological quality and the characteristics of measures to make informed decisions about the most reliable and valid tool for a specific purpose. The findings from this study will contribute to the knowledge surrounding available and appropriate measures to use for measuring the health and wellbeing of adolescents with intellectual disabilities, which are necessary to inform intervention development and future health policy. Systematic Review Registration The protocol has been registered at the International Prospective Register of Systematic Reviews (PROSPERO). The registration number is: CRD42021231697.


2014 ◽  
Vol 27 (6) ◽  
pp. 903-923 ◽  
Author(s):  
Ratko Radakovic ◽  
Catherine Harley ◽  
Sharon Abrahams ◽  
John M. Starr

ABSTRACTBackground:There are several scales used to detect apathy in disease populations. Since apathy is a prevalent symptom in many neurodegenerative diseases, this is an especially important context in which to identify and compare scales.Aims:To provide an overview of apathy scales validated in generic and specific neurodegenerative disease populations, compare validation studies’ methodological quality and the psychometric properties of the validated apathy scales.Methods:A systematic review of literature was conducted of articles published between 1980 and 2013. The final articles selected for review were rated on methodological quality and the psychometric properties of the scales used were interpreted.Results:Sixteen articles validating apathy scales were included in the review, five in a generic neurodegenerative sample and eleven in specific neurodegenerative samples. The methodological quality of specific studies varied from poor to excellent. The highest quality, which had psychometrically favorable scales, were the dementia apathy interview and rating (DAIR) and the apathy evaluation scale-clinical version (AES-C) in Alzheimer's disease and the Lille apathy rating scale (LARS) in Parkinson's disease. Generic neurodegenerative disease validation studies were of average methodological quality and yielded inconsistent psychometric properties.Conclusions:Several instruments can be recommended for use in some specific neurodegenerative diseases. Other instruments should either be validated or developed to assess apathy in more generic populations.


2019 ◽  
Vol 86 (3) ◽  
pp. 172-184 ◽  
Author(s):  
Alexandre Patry ◽  
Claude Vincent ◽  
Christian Duval ◽  
Emmanuelle Careau

Background. Although home environment assessments are commonly performed by occupational therapists working in home care, use of nonstandardized measures created in-house or lack of measure use can cast a shadow over the quality of these assessments for people with disabilities. To ensure quality of home environment assessments, occupational therapists need standardized measures with demonstrated psychometric properties. Purpose. This study provides a critical appraisal of objective accessibility measures of the home environment. Method. A systematic review was undertaken for which three databases—CINAHL, PubMed, and Embase—were searched to identify accessibility measures of the home environment and evaluate their psychometric properties. Two authors independently assessed the quality of selected studies using the critical appraisal form for psychometric articles. Findings. Ten studies discussing seven accessibility measures were identified and selected for this review. No measures showed strong evidence of both good reliability and validity. Only one study addressed the responsiveness of a measure of accessibility. Implications. As occupational therapists are specialists of the person–environment relationship, the lack of evidence of the psychometric properties of objective accessibility measures of the home environment harms evidence-based occupational therapy practice. This review identified the most promising assessment tools, but further research is needed.


2020 ◽  
Vol 20 (2) ◽  
pp. 125
Author(s):  
Mohammed Al Maqbali ◽  
Jackie Gracey ◽  
Jane Rankin ◽  
Lynn Dunwoody ◽  
Eileen Hacker ◽  
...  

This review aimed to explore the psychometric properties of quality of life (QOL) scales to identify appropriate tools for research and clinical practice in Arabic-speaking adults. A systematic search of the Cumulative Index to Nursing and Allied Health Literature® (EBSCO Information Services, Ipswich, Massachusetts, USA), MEDLINE® (National Library of Medicine, Bethesda, Maryland, USA), EMBASE (Elsevier, Amsterdam, Netherlands) and PsycINFO (American Psychological Association, Washington, District of Columbia, USA) databases was conducted according to Preferred Reporting Items Systematic Reviews and Meta- Analysis guidelines. Quality assessment criteria were then utilised to evaluate the psychometric properties of identified QOL scales. A total of 27 studies relating to seven QOL scales were found. While these studies provided sufficient information regarding the scales’ validity and reliability, not all reported translation and cross-cultural adaptation processes. Researchers and clinicians should consider whether the psychometric properties, subscales and characteristics of their chosen QOL scale are suitable for use in their population of interest.Keywords: Quality of Life; Cross-Cultural Comparison; Translations; Psychometrics; Validity and Reliability; Surveys and Questionnaires; Systematic Review.


2021 ◽  
Vol 12 ◽  
Author(s):  
Sangha Lee ◽  
Jihoon Lee ◽  
Soyoung Yoo ◽  
Sooyeon Suh ◽  
Seockhoon Chung ◽  
...  

Objectives: Many individuals around the world are suffering from psychological distress due to the COVID-19 outbreak. The aim of this study is to explore the validity and reliability of the English version of Stress and Anxiety to Viral Epidemics-6 (SAVE-6), which measures the anxiety response of the general population to the viral epidemic.Methods: A cross-sectional web-based study with self-reporting measures was conducted. A total of 314 United States residents were recruited via online platform in exchange for payment. The participants were asked to an anonymous questionnaire, collecting information on demographics, psychiatric history, SAVE-6, Patient Health Questionnaire-4 (PHQ-4), and the Coronavirus Anxiety Scale.Results: The result from confirmatory factor analysis (CFA) demonstrated that a single-factor model [χ(9)2 = 11.53, p = 0.24] yielded excellent fit for all of indices [χ2/df ratio = 1.28; CFI = 1.00; TLI = 1.00; SRMR = 0.02; RMSEA = 0.03 (0.00, 0.07; 90% CI)] and yielded strong internal consistency reliability (Cronbach's α = 0.88). The results from multigroup CFAs showed that there were no gender differences [Δχ(6)2 = 3.20, p = 0.78, ns] and no race differences [Δχ(6)2=3.60, p = 0.73, ns] between the models, along with excellent model fits.Conclusions: The results of this study support the reliability and validity of SAVE-6 with strong psychometric properties for the English version of the U.S. population.


Sign in / Sign up

Export Citation Format

Share Document