scholarly journals The ANHEQ Evaluation Criteria: Introducing Reliable Rating Scales for Assessing Nordic Hamstring Exercise Quality

2021 ◽  
Vol 7 (1) ◽  
Author(s):  
Tobias Alt ◽  
Marcus Schmidt
Keyword(s):  
Rating Scales ◽  
Intervention Studies ◽  
Evaluation Criteria ◽  
Study Quality ◽  
Rater Agreement ◽  
Rater Reliability ◽  
Comprehensive Review ◽  
Data Presentation ◽  
Related Research

Abstract Background The Nordic Hamstring Exercise (NHE) is very popular for selective eccentric hamstring strengthening. However, NHE-related research is hindered by insufficient details about implementation and reporting. Available tools to assess study quality (e.g., PEDro or TESTEX scale) are too unspecific to account for the specific demands of NHE. Therefore, this study aimed to introduce two rating scales for Assessing Nordic Hamstring Exercise Quality (ANHEQ) of assessment and intervention studies. Methods Eighteen graduated sports scientists, sports physiotherapists and elite coaches with scientific experience independently evaluated the quality of published NHE studies via ANHEQ scales, each comprising eight items and a maximal 13-point score. Inter-rater agreement was analyzed by using criterion-based reference values, while Krippendorff´s alpha determined inter-rater reliability. Systematic differences of the summated ANHEQ scores were determined using Friedman tests. Results Inter-rater agreement was 87 ± 5% for NHE assessments and 88 ± 6% for interventions with single items ranging from 71 to 100%. Alpha values for inter-rater reliability ranged from fair (.250) to perfect (1.00) depending on the item. Total ANHEQ scores revealed coefficients of .829 (almost perfect) and .772 (substantial) without significant inter-rater differences (p = .292). Conclusions The ANHEQ scales are suitable tools to rate NHE execution quality and data presentation. They facilitate a comprehensive review of NHE-related evidence and potentially improve the design and reporting of future NHE studies.

Measuring the quality of life in mild to very severe dementia: Testing the inter-rater and intra-rater reliability of the German version of the QUALIDEM

2014 ◽  
Vol 26 (5) ◽  
pp. 825-836 ◽  
Author(s):  
Martin Nikolaus Dichter ◽  
Christian G. G. Schwab ◽  
Gabriele Meyer ◽  
Sabine Bartholomeyczik ◽  
Olga Dortmann ◽  
...  
Keyword(s):  
Quality Of Life ◽  
Negative Affect ◽  
Social Isolation ◽  
Social Relations ◽  
Rater Agreement ◽  
Severe Dementia ◽  
Rater Reliability ◽  
Single Measure ◽  
Care Relationship

ABSTRACTBackground:Quality of life (Qol) is an increasingly used outcome measure in dementia research. The QUALIDEM is a dementia-specific and proxy-rated Qol instrument. We aimed to determine the inter-rater and intra-rater reliability in residents with dementia in German nursing homes.Methods:The QUALIDEM consists of nine subscales that were applied to a sample of 108 people with mild to severe dementia and six consecutive subscales that were applied to a sample of 53 people with very severe dementia. The proxy raters were 49 registered nurses and nursing assistants. Inter-rater and intra-rater reliability scores were calculated on the subscale and item level.Results:None of the QUALIDEM subscales showed strong inter-rater reliability based on the single-measure Intra-Class Correlation Coefficient (ICC) for absolute agreement ≥ 0.70. Based on the average-measure ICC for four raters, eight subscales for people with mild to severe dementia (care relationship, positive affect, negative affect, restless tense behavior, social relations, social isolation, feeling at home and having something to do) and five subscales for very severe dementia (care relationship, negative affect, restless tense behavior, social relations and social isolation) yielded a strong inter-rater agreement (ICC: 0.72–0.86). All of the QUALIDEM subscales, regardless of dementia severity, showed strong intra-rater agreement. The ICC values ranged between 0.70 and 0.79 for people with mild to severe dementia and between 0.75 and 0.87 for people with very severe dementia.Conclusions:This study demonstrated insufficient inter-rater reliability and sufficient intra-rater reliability for all subscales of both versions of the German QUALIDEM. The degree of inter-rater reliability can be improved by collaborative Qol rating by more than one nurse. The development of a measurement manual with accurate item definitions and a standardized education program for proxy raters is recommended.

Another Look at air Traffic Controller Performance Evaluation

1996 ◽  
Vol 40 (12) ◽  
pp. 574-578
Author(s):  
Earl S. Stein ◽  
Randy L. Sollenberger
Keyword(s):  
Rating Scales ◽  
Rating Scale ◽  
Evaluation Criteria ◽  
Air Traffic ◽  
Group Discussions ◽  
Air Traffic Controller ◽  
Rater Reliability ◽  
Controller Performance ◽  
Performance Area ◽  
Mutual Evaluation

This paper describes a study that evaluated the reliability of a recently developed rating form designed to assess air traffic controller performance. Six supervisors from different radar approach control facilities nationwide viewed 20 video tapes of controllers working traffic from a previously recorded simulation study. The observer/raters used a new evaluation form that consisted of 24 different rating scales measuring specific areas of controller performance. An important part of this study was observer training. The training consisted of practice rating sessions followed by group discussions. In discussion, observers established mutual evaluation criteria for each performance area. Inter-rater reliability was assessed using intraclass correlations, and intra-rater reliability was assessed using Pearson product-moment correlations on repeated video tapes. In general, the reliability of the form was quite good, however, a few rating scales were much less reliable than the others. Reasons for the differences in rating scale reliability are discussed.

scholarly journals A Checklist to Assess the Quality of Survey Studies in Psychology

2020 ◽  
Author(s):  
Cleo Protogerou ◽  
Martin S Hagger
Keyword(s):  
Large Scale ◽  
Quality Criteria ◽  
Preliminary Test ◽  
Criterion Validity ◽  
Consensus Method ◽  
Study Quality ◽  
Rater Reliability ◽  
International Panel ◽  
Importance Ratings

Study quality is emerging as an essential component of evidence syntheses and allows practitioners and policymakers to make informed decisions based on the quality of the evidence reviewed. Study quality is typically assessed by checklists of pre-determined quality criteria. Few study quality checklists have been systematically evaluated, and none have been developed specifically for survey studies in psychology. The present study addresses this evidence gap by developing the quality of survey studies in psychology (Q-SSP) checklist, using an expert-consensus method. An international panel of experts in psychology research and quality assessment (N = 53) evaluated the inclusion and importance of candidate quality items and offered commentary. The resulting checklist was used to evaluate a set of survey studies and inter-rater reliability of checklist scores was computed. A preliminary test of criterion validity of checklist scores was conducted using on a sample of survey studies with ‘known differences’ in study quality verified by experts. Experts exhibited high agreement on inclusion and importance ratings of the candidate items. Minor adjustments were made to the candidate items based on experts’ feedback. Inter-rater reliability of study quality scores using the checklist was high. Some evidence for criterion validity of scores using the checklist was obtained. Overall, we provide preliminary data to support the Q-SSP checklist as a potential means to evaluate the quality of survey studies in psychology. We recommend a large-scale study using the Q-SSP checklist to assess study quality in studies with known differences in quality verified by experts.

scholarly journals Measuring functional outcomes in stroke trials: Improving inter-rater reliability of the Modified Rankin Scale using a structured interview

Stroke ◽  
2001 ◽  
Vol 32 (suppl_1) ◽  
pp. 380-380
Author(s):  
Lindsay Wilson ◽  
Marie Grant ◽  
Asha Hareendran ◽  
Ursula Schuitz ◽  
Tracey Baird ◽  
...  
Keyword(s):  
Rating Scales ◽  
Kappa Statistic ◽  
Weighted Kappa ◽  
Structured Interview ◽  
Modified Rankin Scale ◽  
Multi Centre Study ◽  
Rater Reliability ◽  
Quality Of Results ◽  
Analysis Of Results

P227 Background & aims: The Modified Rankin Scale (MRS) (van Swieten et al, 1988) is widely used in clinical trials to rate disability and handicap after stroke. Although the MRS is a popular measure of functional outcome the categories of the scale are very broadly defined and open to interpretation by raters. Previous work with the Glasgow Outcome Scale indicates that the reliability of functional rating scales may be improved by use of a structured interview (Wilson et al, 1998). The purpose of the present study was to compare the inter-rater reliability of the conventional MRS with the inter-rater reliability of a newly developed structured interview for the MRS (MRS-SI) Methods: A structured interview was devised for the MRS covering five areas of everyday function. 63 patients with stable functional state after stroke (stroke 6 to 24 months previously) were recruited to the study and scored on the conventional MRS by two independent observers. These observers then underwent training in use of the MRS-SI. Eight weeks after the first assessment the same observers reassessed 58 of these patients using the MRS-SI. Results: To allow comparison between the assessments the analysis of results was restricted to the 58 patients who were rated on both the MRS and MRS-SI. Inter-rater reliability was measured using the kappa statistic (unweighted and weighted using quadratic weights). For the MRS, overall agreement between the two raters was 57% (unweighted kappa 0.44, weighted kappa 0.78); using the MRS-SI, overall agreement was 78% (unweighted kappa 0.70, weighted kappa 0.93). Conclusions: Variability between raters in assigning patients to Rankin grades appears to be reduced when using a structured interview for the Modified Rankin Scale. The use of the MRS-SI could potentially improve the quality of results from clinical studies in stroke. A multi-centre study to further establish the improvement in inter-rater reliability is ongoing.

Cathartic Effect of Suicide Attempts Not Limited to Depression

Crisis ◽  
2003 ◽  
Vol 24 (2) ◽  
pp. 73-78 ◽  
Author(s):  
Yves Sarfati ◽  
Blandine Bouchaud ◽  
Marie-Christine Hardy-Baylé
Keyword(s):  
Quality Of Life ◽  
Depressive Symptoms ◽  
Personality Traits ◽  
Rating Scales ◽  
Suicide Attempts ◽  
World Health ◽  
Life Questionnaire ◽  
Short Term

Summary: The cathartic effect of suicide is traditionally defined as the existence of a rapid, significant, and spontaneous decrease in the depressive symptoms of suicide attempters after the act. This study was designed to investigate short-term variations, following a suicide attempt by self-poisoning, of a number of other variables identified as suicidal risk factors: hopelessness, impulsivity, personality traits, and quality of life. Patients hospitalized less than 24 hours after a deliberate (moderate) overdose were presented with the Montgomery-Asberg Depression and Impulsivity Rating Scales, Hopelessness scale, MMPI and World Health Organization's Quality of Life questionnaire (abbreviated versions). They were also asked to complete the same scales and questionnaires 8 days after discharge. The study involved 39 patients, the average interval between initial and follow-up assessment being 13.5 days. All the scores improved significantly, with the exception of quality of life and three out of the eight personality traits. This finding emphasizes the fact that improvement is not limited to depressive symptoms and enables us to identify the relative importance of each studied variable as a risk factor for attempted suicide. The limitations of the study are discussed as well as in particular the nongeneralizability of the sample and setting.

Conceptual imposings of quality management of system of production of composite materials for it is rocket the space equipment

2017 ◽  
Vol 14 (4) ◽  
pp. 30-38
Author(s):  
V. G. Isaev ◽  
T. N. Antipova
Keyword(s):  
Composite Materials ◽  
Quality Management ◽  
Evaluation Criteria ◽  
Criteria And Indicators ◽  
Properties Of Materials ◽  
A Priority ◽  
Required Quality

Basic provisions of the concept and methodology of production of composite materials for the missile and space equipment are offered. The system of the purposes realizing the principle of a priority of the purposes of the customer is offered. The system of evaluation criteria and indicators of quality of composite materials the realizing interrelation of requirements of the customer to quality of material and dependence of ensuring the required quality on the used technologies is developed. It is shown that for ensuring quality of composite materials for units and the RKT systems first of all it is necessary development of mathematical dependences of properties of materials on parameters of the technological modes in the conditions of obligatory implementation of requirements of the customer.

Applied Status and Quality of Graphs in Five Academic Medical Journals in Shanghai (Preprint)

2018 ◽  
Author(s):  
Zisheng Ai ◽  
Yuhong Tang ◽  
Jiaqi Zheng ◽  
Sanyou Wu ◽  
Ying Wu
Keyword(s):  
Evaluation Criteria ◽  
Cross Sectional Study ◽  
Cross Sectional ◽  
Medical Journals ◽  
Graph Type ◽  
Academic Medical ◽  
Substantial Problem ◽  
Error Bias ◽  
Important Form

BACKGROUND Figures are an important form of expressing results commonly found in medical papers and make data easy to read and compare. The quality of graphs in original papers has improved in western medical journals. However, some figures fail to correctly express the results of a paper. Additionally, graph quality and application has not been assessed in medical journals outside western countries. OBJECTIVE To determine the frequency and types of data graphs used in Chinese academic medical journals and evaluate the quality of graphs used in original medical papers. METHODS A total of 783 papers were surveyed from the medical journals of five colleges and universities in Shanghai from 2011 to 2015. A cross-sectional study was used to analyse the applied status and graph quality. The evaluation criteria of graphs mainly included graph type, visual clarity, completeness, and special standards. RESULTS Most authors prefer to use simple charts, and bar charts with 95% CI were the most widely used. More than 60% of charts have problems with visual clarity, completeness, and special standards. Of 841 incorrect graphs, 10 (0.58%) graphs had three combined problems of graph characteristics, and 292 (34.72%) graphs had any two combined problems of graph characteristics. For detailed errors, the absence of variance description was the most substantial problem, especially in 2014 and in some academic medical journals. CONCLUSIONS Graphs are less commonly applied in the five university journals. However, the quality of papers using graphs was not properly controlled. Editors and journal quality management should strengthen the quality control of charts in papers. Authors should also avoid error bias and distorting their conclusions.

scholarly journals Differentiating PSP from MSA using MR planimetric measurements: a systematic review and meta-analysis

2021 ◽  
Author(s):  
Beatrice Heim ◽  
Florian Krismer ◽  
Klaus Seppi
Keyword(s):  
Sensitivity And Specificity ◽  
Meta Analysis ◽  
Risk Of Bias ◽  
Index Test ◽  
Study Quality ◽  
Parkinsonian Syndromes ◽  
Quantitative Mr ◽  
Meta Analyses ◽  
Planimetric Measurements

AbstractDifferential diagnosis of parkinsonian syndromes is considered one of the most challenging in neurology. Quantitative MR planimetric measurements were reported to discriminate between progressive supranuclear palsy (PSP) and non-PSP-parkinsonism. Several studies have used midbrain to pons ratio (M/P) and the Magnetic Resonance Parkinsonism Index (MRPI) in distinguishing PSP patients from those with Parkinson's disease. The current meta-analysis aimed to compare the performance of these measures in discriminating PSP from multiple system atrophy (MSA). A systematic MEDLINE review identified 59 out of 2984 studies allowing a calculation of sensitivity and specificity using the MRPI or M/P. Meta-analyses of results were carried out using random effects modelling. To assess study quality and risk of bias, the QUADAS-2 tool was used. Eight studies were suitable for analysis. The meta‐analysis showed a pooled sensitivity and specificity for the MRPI of PSP versus MSA of 79.2% (95% CI 72.7–84.4%) and 91.2% (95% CI 79.5–96.5%), and 84.1% (95% CI 77.2–89.2%) and 89.2% (95% CI 81.8–93.8%), respectively, for the M/P. The QUADAS-2 toolbox revealed a high risk of bias regarding the methodological quality of patient selection and index test, as all patients were seen in a specialized outpatient department without avoiding case control design and no predefined threshold was given regarding MRPI or M/P cut-offs. Planimetric brainstem measurements, in special the MRPI and M/P, yield high diagnostic accuracy for the discrimination of PSP from MSA. However, there is an urgent need for well-designed, prospective validation studies to ameliorate the concerns regarding the risk of bias.

scholarly journals The Effect of Baseline Patient and Caregiver Mindfulness on Dementia Outcomes

2021 ◽  
pp. 1-23
Author(s):  
Ashley D. Innis ◽  
Magdalena I. Tolea ◽  
James E. Galvin
Keyword(s):  
Quality Of Life ◽  
Cognitive Performance ◽  
Rating Scales ◽  
Present Moment ◽  
Health Related Quality ◽  
Targeted Interventions ◽  
Related Quality ◽  
Health Related ◽  
Caregiver Rating

Background: Mindfulness is the practice of awareness and living in the present moment without judgment. Mindfulness-based interventions may improve dementia-related outcomes. Before initiating interventions, it would be beneficial to measure baseline mindfulness to understand targets for therapy and its influence on dementia outcomes. Objective: This cross-sectional study examined patient and caregiver mindfulness with patient and caregiver rating scales and patient cognitive performance and determined whether dyadic pairing of mindfulness influences patient outcomes. Methods: Individuals (N = 291) underwent comprehensive evaluations, with baseline mindfulness assessed using the 15-item Applied Mindfulness Process Scale (AMPS). Correlation, regression, and mediation models tested relationships between patient and caregiver mindfulness and outcomes. Results: Patients had a mean AMPS score of 38.0±11.9 and caregivers had a mean AMPS score of 38.9±11.5. Patient mindfulness correlated with activities of daily living, behavior and mood, health-related quality of life, subjective cognitive complaints, and performance on episodic memory and attention tasks. Caregiver mindfulness correlated with preparedness, care confidence, depression, and better patient cognitive performance. Patients in dyads with higher mindfulness had better cognitive performance, less subjective complaints, and higher health-related quality of life (all p-values<0.001). Mindfulness effects on cognition were mediated by physical activity, social engagement, frailty, and vascular risk factors. Conclusion: Higher baseline mindfulness was associated with better patient and caregiver outcomes, particularly when both patients and caregivers had high baseline mindfulness. Understanding the baseline influence of mindfulness on the completion of rating scales and neuropsychological test performance can help develop targeted interventions to improve well-being in patients and their caregivers.

Venous leg symptoms, ecchymosis, and coldness in patients with peripheral varicose vein: A multicenter assessment and validation study (VEIN-VIOLET study)

Vascular ◽  
2020 ◽  
pp. 170853812098020
Author(s):  
Ertan Yetkin ◽  
Makbule Kutlu Karadag ◽  
Mehmet Ileri ◽  
Ramazan Atak ◽  
Nevzat Erdil ◽  
...  
Keyword(s):  
Quality Of Life ◽  
Regression Analysis ◽  
Varicose Vein ◽  
Odds Ratio ◽  
Venous Insufficiency ◽  
Study Quality ◽  
Inclusion Criteria ◽  
Economic Study ◽  
Independent Association

Objectives We aimed to evaluate peripheral varicose vein symptoms including ecchymosis and coldness by using the Venous Insufficiency Epidemiological and Economic Study-Quality of Life/Symptoms (VEINES-QoL/Sym) questionnaire. Methods A total of 1120 patients were enrolled to the analysis after the exclusion of 199 patients who did not match the inclusion criteria. Patients were asked to answer the VEINES-Sym questionnaire and questions about ecchymosis and coldness. Scores of ecchymosis and coldness were calculated similar to VEINES-Sym questionnaire. Classifications of peripheral varicose vein were made according to the clinical part of clinical, etiological, anatomical, and pathophysiological classification system and patients with grade 2 or higher were considered as positive for peripheral varicose vein. Results Frequency of symptoms present in the VEINES-Sym instrument, ecchymosis and coldness were significantly higher in patients with peripheral varicose vein. Mean score of each symptom was significantly lower in peripheral varicose vein patients including scores of ecchymosis and coldness. Logistic regression analysis revealed that presence of hemorrhoids and all symptoms in VEINES-Sym questionnaire except restless leg were significantly and independently associated with peripheral varicose vein. Besides, ecchymosis (odds ratio: 2.04, 95% confidence interval: 1.34–3.08, p = 0.008) but not coldness was significantly and independently associated with peripheral varicose vein. There was also significant correlation of VEINES-Sym score with ecchymosis ( r = 0.43, p < 0.001) and coldness ( r = 0.47, p < 0.001). Conclusions Venous leg symptoms present in VEINES-Sym questionnaire except restless legs, presence of hemorrhoids and ecchymosis are significantly and independently associated with peripheral varicose vein. Not only ecchymosis but also coldness has shown an independent association with total VEINES-Sym score.

Sign in / Sign up

Export Citation Format

Share Document