scholarly journals Study Design and Evolution, and the Imperatives of Reliability and Validity

2020 ◽  
pp. 7-21
Author(s):  
Hans Wagemaker
Keyword(s):  
Study Design ◽  
Reliability And Validity

scholarly journals The Usefulness of the Pressure Algometer in the Diagnosis and Treatment of Orofacial Pain Patients: A Systematic Review

2020 ◽  
Vol 2020 ◽  
pp. 1-8
Author(s):  
Agata Kamińska ◽  
Bartosz Dalewski ◽  
Ewa Sobolewska
Keyword(s):  
Study Design ◽  
Orofacial Pain ◽  
Pressure Pain Threshold ◽  
Reliability And Validity ◽  
Risk Of Bias ◽  
Small Samples ◽  
Menstrual Phase ◽  
Efficient Approach ◽  
Pressure Algometer ◽  
Pain Patients

Study Design. Data were obtained from PubMed, Dentistry and Oral Sciences Source, ProQuest, Scopus, Medline (EBSCO), and ScienceDirect databases. Literature search was performed from 1 December 2017 through 12 January 2018. The titles and abstracts from electronic search results were screened for keywords and evaluated by two observers, with the following inclusion criteria: published since 1997, written in English, and encompassing human research. Exclusion criteria were as follows: articles published earlier than 1997, not written in English, animal studies, studies with the use of medicaments, and articles examining receptor interactions. Objectives. The pressure pain threshold (PPT) may be an efficient approach to screen and evaluate orofacial pain. However, the results of previous PPT studies have varied greatly. The aim of this paper was to determine whether the PPT is an efficient approach for screening and evaluating orofacial pain. Methods. The search yielded 123 articles. After removal of duplicates and screening of abstracts, 32 articles were selected for further evaluation. The Cochrane Collaboration tool for assessing the risk of bias was used for the evaluation of the studies. Results. The studies covered a total of 4403 adult patients, aged 16-62, and 30 children. The studies investigated the reliability and validity of the PPT (measured by a pressure algometer) in TMD patients. The PPT was investigated in relation to headache, menstrual cycle, oral contraception, occlusal interference, and occlusal appliances. Generally, the risk of bias was low to unclear. Some structural limitations were inherent in the studies, such as small samples and short duration of the testing involved. Also, the analyzed studies lacked consistency in study design and patient management. Pressure increase values differed from 20 kPa/s to 50 kPa/s and from 0.5 kg/cm2/s to 2 kg/cm2/s. Descriptions of the PPT examination points also varied, from very precise and repeatable to a simple listing of anatomical points. The number of measurements varied from 1 to 5 at each visit. The intervals ranged from 5 seconds to 15 minutes. However, some studies confirmed that the pressure algometer is an effective tool for determining the source of orofacial pain. Conclusions. Based on the analyzed articles, the authors argue that the PPT is not an efficient approach for screening and evaluating orofacial pain. What is more, it should not be used as the only diagnostics tool for patients with orofacial pain. Importantly, however, additional factors should be considered in the future for the evaluation of the PPT, including body symmetry and posture, hormone levels and the menstrual phase in women, and the use of medications and its influence on the PPT. Further clinical trials should also be performed on the PPT, examining head and neck pain patients, with more precise study design and larger samples.

scholarly journals Development and Validation of a Nutrition-Specific Set of Tools to Assess the Quality of Nutrition Studies

2020 ◽  
Vol 4 (Supplement_2) ◽  
pp. 1377-1377
Author(s):  
Karima Benkhedda ◽  
Stephen Brooks ◽  
Linda Greene-Finestone ◽  
Shannon Kelly ◽  
Amanda MacFarlane ◽  
...  
Keyword(s):  
Quality Assessment ◽  
Study Design ◽  
Systematic Reviews ◽  
A Priori ◽  
Reliability And Validity ◽  
Quality Appraisal ◽  
Case Control Studies ◽  
Perfect Agreement ◽  
Development And Validation

Abstract Objectives To develop and validate a set of 3 quality assessment instruments (QAls) for evaluating the quality of nutrition studies, for each of the commonly used study designs: (1) randomized controlled trials (RCTs), (2) prospective cohort, and (3) case-control studies. Methods The QAI development and validation process included 8 steps: 1) identify and evaluate existing general QAls for adaptation with nutrition-specific quality appraisal items; 2) scan the literature to identify nutrition-specific quality appraisal issues; 3) generate nutrition-specific items to be added to each of the general QAIs, adapt existing guidance for general items for nutrition applications and develop guidance for added nutrition items; 4) review, by two experts in clinical and population nutrition, of the modified general QAIs with added nutrition-specific items and guidance; 5) assess reliability and validity of the QAI for each study design; 6) improve the usability and feasibility, of the QAIs by considering feedback from the validation exercise to refine the wording of the guidance; 7) develop a worksheet to help evaluate, a priori, topic-specific methodology to address risk of bias; and  8) validate the final QAIs using five peer-reviewed studies identified from published systematic reviews with reported quality assessment. Agreement and reliability were determined for each QAI. Results Results of the validation show good to perfect agreement among evaluators for the overall study rating and across domains. When compared to the study quality assessment reported in the systematic review, nutrition- specific items had the greatest impact on study ratings, generally resulting in a downgrade of the overall rating. Conclusions A set of nutrition-specific QAls were developed to assess the quality and robustness of nutrition studies. These tools incorporate general quality issues of study design and conduct, as well as address recognised nutrition study-specific issues. They will improve consistency in how nutrition studies are assessed particularly in nutrition-related systematic reviews. This will contribute to the overall quality of assessment of diet and Funding Sources This work was supported by Health Canada.

scholarly journals PERCEPTION OF PARENTS IN USING MESSY PLAY IN SENSORY BASED INTERVENTIONS

2020 ◽  
pp. 65-67
Author(s):  
Sheeba Parveen ◽  
Manish Samnani
Keyword(s):  
Autism Spectrum Disorder ◽  
Early Intervention ◽  
Study Design ◽  
Reliability And Validity ◽  
Autism Spectrum ◽  
Occupational Therapist ◽  
Survey Method ◽  
Learning And Development ◽  
Home Based ◽  
Sense Of Touch

Background: The word messy is often given negative meanings and calling an important aspect of play 'messy' can lead to it being undervalued. Messy play involve children using all their senses in the process of exploration especially the sense of touch offering children plenty of opportunity to mould and manipulate materials not having a focus on making or producing something. Objectives: To explore the perception of parents in regard to messy play questionnaire filled by Occupational Therapist who works with Parents of children having Autism Spectrum Disorder. Study Design: Survey method Methods: 30 Occupational Therapist who are working in an Early Intervention Centre across Delhi, have filled a questionnaire about “Perception of Parents about Messy Play in Sensory Based Programs”. The questionnaire was created using Google form and its reliability and validity was tested. Results: The results of the study suggest that parents use messy play during sensory based intervention in home programs occasionally.70 percent of parents suggest using other sensory based equipment’s in comparison to messy play. 80.7 percent of the Occupational Therapist feels that only some of the parents actually do the activities related to messy play. Conclusion: This study shows that Messy play though the cheapest form of intervention with most wide used possibilities of exploration is still not preferred by many parents. Despite all the contributions messy play can make to children's learning and development there does seem to be a reluctance to promote messy play in the home based settings, neglect of such play may be connected with other people's anxieties about children making a mess and its associations with words such as muddled, confused and shambolic. This has led to this type of play being seen as unimportant and undervalued.

The use of simulation in neurosurgical education and training

2014 ◽  
Vol 121 (2) ◽  
pp. 228-246 ◽  
Author(s):  
Matthew A. Kirkman ◽  
Maria Ahmed ◽  
Angelique F. Albert ◽  
Mark H. Wilson ◽  
Dipankar Nandi ◽  
...  
Keyword(s):  
Systematic Review ◽  
Study Design ◽  
Reliability And Validity ◽  
Study Quality ◽  
Ovid Medline ◽  
Key Skills ◽  
Long Term Follow Up ◽  
Improved Performance

Object There is increasing evidence that simulation provides high-quality, time-effective training in an era of resident duty-hour restrictions. Simulation may also permit trainees to acquire key skills in a safe environment, important in a specialty such as neurosurgery, where technical error can result in devastating consequences. The authors systematically reviewed the application of simulation within neurosurgical training and explored the state of the art in simulation within this specialty. To their knowledge this is the first systematic review published on this topic to date. Methods The authors searched the Ovid MEDLINE, Embase, and PsycINFO databases and identified 4101 articles; 195 abstracts were screened by 2 authors for inclusion. The authors reviewed data on study population, study design and setting, outcome measures, key findings, and limitations. Results Twenty-eight articles formed the basis of this systematic review. Several different simulators are at the neurosurgeon's disposal, including those for ventriculostomy, neuroendoscopic procedures, and spinal surgery, with evidence for improved performance in a range of procedures. Feedback from participants has generally been favorable. However, study quality was found to be poor overall, with many studies hampered by nonrandomized design, presenting normal rather than abnormal anatomy, lack of control groups and long-term follow-up, poor study reporting, lack of evidence of improved simulator performance translating into clinical benefit, and poor reliability and validity evidence. The mean Medical Education Research Study Quality Instrument score of included studies was 9.21 ± 1.95 (± SD) out of a possible score of 18. Conclusions The authors demonstrate qualitative and quantitative benefits of a range of neurosurgical simulators but find significant shortfalls in methodology and design. Future studies should seek to improve study design and reporting, and provide long-term follow-up data on simulated and ideally patient outcomes.

An Updated Systematic Review of Turnout Position Assessment Protocols Used in Dance Medicine and Science Research

2021 ◽  
Vol 25 (1) ◽  
pp. 55-71
Author(s):  
Manuela Angioi ◽  
Karis Hodgson ◽  
Katrine Okholm Kryger
Keyword(s):  
Study Design ◽  
External Rotation ◽  
Population Sample ◽  
Reliability And Validity ◽  
Science Research ◽  
Lower Limbs ◽  
Quality Of Reporting ◽  
Level Of Training ◽  
Classical Ballet ◽  
Dance Medicine

Turnout, or external rotation of the lower limbs, is an integral part of classical ballet technique. Contributions of lower limb structures to turnout can be separated into HER (hip external rotation) and NHCTO (non-hip contributions to turnout). This study aimed to review systematically methods used to measure turnout in dance medicine and science research, thereby updating the literature since the Champion and Chatfield review of 2008. CINAHL, EMBASE, PubMed, and Web of Science were searched in January 2018 by two independent reviewers. Peer-reviewed studies measuring turnout in dance were included, except those published prior to March 23, 2006, as that was the last date of publication included in the previous review. Abstracts, theses, and editorials were excluded. From each study, study design, population (sample size, sex, age, genre of dance, and level of training), details of the protocol used, and result of turnout measurement were extracted, as well as reliability data. All included studies were assessed for risk of bias, using either Newcastle-Ottawa scale, AXIS tool, or PEDro scale as appropriate for each study design. A total of 41 studies met the inclusion criteria. Twenty-eight studies measured HER, nine measured NCHTO, and 22 measured total turnout (TTO). An increased number of studies investigated TTO (N = 22; N = 4 passive TTO) and NHCTO (N = 9) since 2006. All studies scored above half the points attainable from their respective tools. Results suggest HER remains the most common protocol for measuring turnout (N = 28), despite the fact it disregards input from structures below the hip. It is concluded that researchers should focus on quality of reporting of protocols to ensure repeatability and facilitate comparison of results. Future studies should include absolute reliability and validity testing of all currently used protocols so that standardization can be fully achieved.

The accuracy of adult narrative reports of developmental trajectories

2005 ◽  
Vol 29 (5) ◽  
pp. 345-355 ◽  
Author(s):  
Patricia Cohen ◽  
Stephanie Kasen ◽  
Antonia Bifulco ◽  
Howard Andrews ◽  
Kathy Gordon
Keyword(s):  
High School ◽  
Young Adults ◽  
Study Design ◽  
Developmental Trajectories ◽  
Reliability And Validity ◽  
Interview Study ◽  
Entire Period ◽  
Social Variables ◽  
Time Periods ◽  
High Consistency

This methodological investigation examines the accuracy of narrative-based scaled ratings covering several post high school years. Guided narratives by young adults described developmentally relevant behaviour and context for each month between ages 17 and the mid-20s. “Prospective” narratives covered shorter time periods in three interviews separated by about 1 year each. A fourth “retrospective” interview included the entire period covered in the previous narratives and took place 1 year after the last prospective interview. Study variables were reliable ratings of data from these carefully conducted and blindly repeated narratives. Aspects of the study design expected to maximise reliability and validity of these data are provided. Prospective–retrospective (test–retest) correlation of ratings based on data from 149 participants covering an average of 64 studied months each on role-related, qualitative, and social variables are reported. The high consistency of many developmental variables based on these reports suggests that retrospective narratives can produce reliable and valid scaled measures covering a substantial period of time.

Reliability and Validity: Part II

2004 ◽  
Vol 23 (3) ◽  
pp. 74-76 ◽  
Author(s):  
Deborah Winders Davis
Keyword(s):  
Study Design ◽  
Reliability And Validity ◽  
Measurement Scales

IN THE PREVIOUS COLUMN (Reliability and Validity: Part I, Vol. 23, No.1), I discussed issues related to reliability and validity of the overall study design. In Part II, I will discuss reliability and validity as it relates specifically to measurement scales and instruments. A study must have valid and reliable measures in order to be considered a valid and reliable study. However, a study can have valid and reliable measures, but due to design flaws, not be a valid or reliable study. For the remainder of this column, the terms reliability and validity will refer to measurement unless otherwise stated.

Sign in / Sign up

Export Citation Format

Share Document