Responsiveness to change: an aspect of validity, not a separate dimension

1992 ◽  
Vol 1 (1) ◽  
pp. 73-75 ◽  
Author(s):  
R. D. Hays ◽  
D. Hadorn



Author(s):  
D M Sirkett ◽  
B J Hicks ◽  
C Berry ◽  
G Mullineux ◽  
A J Medland

The folding carton is a widely used packaging solution. Recent European Union packaging legislation has forced carton manufacturers to use lighter-weight grades of carton board. This typically results in a reduction in board stiffness, which can lead to decreased process efficacy or even prevent successful processing. In order to overcome this, end-users lower production rates and fine-tune packaging machine settings for each pack and material. This trial-and-error approach is necessary because the rules relating machine set-up to pack design and material properties are not generally well known. The present study addresses this fundamental issue through the creation of a finite-element computer simulation of carton processing. Mechanical testing was performed to ascertain the key mechanical properties of the carton walls and creases. The carton model was validated against the experimental results and was then subjected to the machine-material interactions that take place during complex packaging operations. The overall approach was validated and the simulation showed good agreement with the physical system. The results of the simulation can be used to determine guidelines relating machine set-up criteria to carton properties. This will improve responsiveness to change and will ultimately allow end-users to process thinner lighter-weight materials more effectively.



2016 ◽  
Vol 23 (3) ◽  
pp. 239 ◽  
Author(s):  
D. Rodin ◽  
B. Banihashemi ◽  
L. Wang ◽  
A. Lau ◽  
S. Harris ◽  
...  

Purpose We evaluated the feasibility, reliability, and validity of the Brain Metastases Symptom Checklist (BMSC), a novel self-report measure of common symptoms experienced by patients with brain metastases.Methods Patients with first-presentation symptomatic brain metastases (n = 137) referred for whole-brain radiotherapy (WBRT) completed the BMSC at time points before and after treatment. Their caregivers (n = 48) provided proxy ratings twice on the day of consultation to assess reliability, and at week 4 after WBRT to assess responsiveness to change. Correlations with 4 other validated assessment tools were evaluated.Results The symptoms reported on the BMSC were largely mild to moderate, with tiredness (71%) and difficulties with balance (61%) reported most commonly at baseline. Test–retest reliability for individual symptoms had a median intraclass correlation of 0.59 (range: 0.23–0.85). Caregiver proxy and patient responses had a median intraclass correlation of 0.52. Correlation of absolute scores on the BMSC and other symptom assessment tools was low, but consistency in the direction of symptom change was observed. At week 4, change in symptoms was variable, with improvements in weight gain and sleep of 42% and 41% respectively, and worsening of tiredness and drowsiness of 62% and 59% respectively.Conclusions The BMSC captures a wide range of symptoms experienced by patients with brain metastases, and it is sensitive to change. It demonstrated adequate test–retest reliability and face validity in terms of its responsiveness to change. Future research is needed to determine whether modifications to the BMSC itself or correlation with more symptom-specific measures will enhance validity. 



2007 ◽  
Vol 122 (1) ◽  
pp. 46-51 ◽  
Author(s):  
I N Steen ◽  
K MacKenzie ◽  
P N Carding ◽  
A Webb ◽  
I J Deary ◽  
...  

AbstractObjectives:A wide range of well validated instruments is now available to assess voice quality and voice-related quality of life, but comparative studies of the responsiveness to change of these measures are lacking. The aim of this study was to assess the responsiveness to change of a range of different measures, following voice therapy and surgery.Design:Longitudinal, cohort comparison study.Setting:Two UK voice clinics.Participants:One hundred and forty-four patients referred for treatment of benign voice disorders, 90 undergoing voice therapy and 54 undergoing laryngeal microsurgery.Main outcome measures:Three measures of self-reported voice quality (the vocal performance questionnaire, the voice handicap index and the voice symptom scale), plus the short form 36 (SF 36) general health status measure and the hospital anxiety and depression score. Perceptual, observer-rated analysis of voice quality was performed using the grade–roughness–breathiness–asthenia–strain scale. We compared the effect sizes (i.e. responsiveness to change) of the principal subscales of all measures before and after voice therapy or phonosurgery.Results:All three self-reported voice measures had large effect sizes following either voice therapy or surgery. Outcomes were similar in both treatment groups. The effect sizes for the observer-rated grade–roughness–breathiness–asthenia–strain scale scores were smaller, although still moderate. The roughness subscale in particular showed little change after therapy or surgery. Only small effects were observed in general health and mood measures.Conclusion:The results suggest that the use of a voice-specific questionnaire is essential for assessing the effectiveness of voice interventions. All three self-reported measures tested were capable of detecting change, and scores were highly correlated. On the basis of this evaluation of different measures' sensitivities to change, there is no strong evidence to favour either the vocal performance questionnaire, the voice handicap index or the voice symptom scale.



2017 ◽  
Vol 26 (1) ◽  
pp. 15-21 ◽  
Author(s):  
Paulo Antônio Martins-Júnior ◽  
Laís Almeida ◽  
Valdirene Souza Silva ◽  
Saul Martins Paiva ◽  
Leandro Silva Marques ◽  
...  


CJEM ◽  
2017 ◽  
Vol 19 (S1) ◽  
pp. S71
Author(s):  
S. Ali ◽  
S. Le May ◽  
A. Plint ◽  
A. Ballard ◽  
C. Khadra ◽  
...  

Introduction: Appropriate pain management relies on the use of valid, reliable and age-appropriate tools that are validated in the setting in which they are intended to be used. The aim of the study was to assess the psychometric properties of pain scales commonly used in children presenting to the pediatric emergency department (PED) with an acute musculoskeletal injury. Methods: Convergent validity was assessed by determining the Spearman’s correlations and the agreement using the Bland-Altman method between the Visual Analogue Scale (VAS), Faces Pain Scale-Revised (FPS-R) and Color Analogue Scale (CAS). Responsiveness to change was determined by performing the Wilcoxon signed-rank test between the pre-post analgesia mean scores. Reliability of the scales was estimated using relative (Spearman’s correlation, Intraclass Correlation Coefficient) and absolute indices (Coefficient of Reliability). Results: A total of 495 participants was included in the analyses. Mean age was 11.9 ±2.7 years and participants were mainly boys (55.3%). Correlation between each pair of scales was 0.79 (VAS/FPS-R), 0.92 (VAS/CAS) and 0.81 (CAS/FPS-R). Limits of agreement (80%CI) were -2.71 to 1.27 (VAS/FPS-R), -1.13 to 1.15 (VAS/CAS) and -1.45 to 2.61 (CAS/FPS-R). Responsiveness to change was demonstrated by significant differences in mean pain scores, among the three scales, between pre- and post-medication administration (p<0.0001). ICC and CR estimates suggested acceptable reliability for the three scales at 0.79 and ±1.49 for VAS, 0.82 and ±1.35 for CAS, and 0.76 and ±1.84 for FPS-R. Conclusion: The scales demonstrated good psychometric properties with a large sample of children with acute pain in the PED. The VAS and CAS showed a stronger convergent validity, while FPS-R was not in agreement with the other scales. Clinically, VAS and CAS scales can be used interchangeably to assess pain intensity of children with acute pain.



2020 ◽  
Author(s):  
Moira Dean ◽  
Johann Issartel ◽  
Tony Benson ◽  
Amanda McCloat ◽  
Elaine Mooney ◽  
...  

Abstract Background Learning cooking skills during childhood and adolescence is associated with positive dietary outcomes in adulthood as well as being tracked from adolescence to adulthood. In addition studies have found that perceived competence to be a greater motivator to perform a behaviour than actual competence. However, a lack of validated tools that effectively measure behavioural and dietary changes and other related measures in children is a limitation. Therefore, this research aimed to develop and validate age-appropriate perceived cooking competence measures for younger and older primary school aged children. Methods Two measures of perceived Cooking Competence (CooC11 and CooC7) for older (8–12 years) and younger (6–7 years) children were developed from a critical evaluation of publically available recommendations and expert consultation. The cooking skills within the measures were illustrated by a graphic designer in consultation with a chef and reviewed in an iterative manner by the research team. The measures were piloted for clarity, ease of use and initial face validity. Multiple studies were used for both CooC11 and CooC7 to establish psychometric properties of the measures, temporal stability, internal consistency reliability, construct validity, as well as responsiveness to change for CooC11. Analysis included Exploratory Factor Analysis, Confirmatory Factor Analysis, Intraclass Correlation Coefficients, Pearson’s Correlations, ANOVAs and Cronbach’s Alphas. Results Both measures had high levels of face validity and received positive user feedback. Two factors were shown in both measures with the measures showing excellent temporal stability (ICC > 0.9) and good internal consistency (Cronbach’s Alphas > 0.7). Both measures showed initial discriminant validity, with significant differences (P < 0.001) between those who reported assisting their parents with dinner preparation and those who did not. Additionally, CooC11 was significantly correlated with an adult cooking measure and had a significant responsiveness to change (P < 0.01). Conclusions The CooC11 and CooC7 are the first validated age-appropriate measures for assessing children’s perceived Cooking Competence for ages 8–12 and 6–7 years respectively. They can be used to evaluate the efficacy of children’s cooking intervention studies or school nutrition education programmes.



2020 ◽  
Author(s):  
Annette Willemoes Holst-Kristensen ◽  
Paul Mark Mitchell ◽  
Myles-Jay Linton ◽  
Joanna Coast ◽  
Kirsten Fonager ◽  
...  

Abstract BackgroundThis study aimed to provide the first assessment of construct validity of ICECAP-A in patients with cardiovascular disease, chronic obstructive pulmonary disease and diabetes, and to assess the responsiveness of the measure in this group. MethodData were provided from patients attending rehabilitation in the municipality of Aalborg, Denmark, from March 2018 to March 2019. Patients answered a questionnaire from the healthcare centre and the ICECAP-A at baseline and 12 weeks follow-up. To assess construct validity, a priori hypotheses were developed. Based on these hypotheses, associations between sociodemographic characteristics, ‘general health’, a freedom dimension, and ICECAP-A were analysed through chi-squared tests and Spearman rank correlations for categorical and ordinal variables, respectively. To investigate responsiveness, the anchor-based method was used. Patients were divided into improved, worsened or no change, based on changes between baseline and follow-up on the anchor measures (‘general health’ and ‘freedom’). To quantify responsiveness, both the weighted and un-weighted ICECAP-A scores’ effect sizes, standardised response means and t-tests were used. Findings were explored across different age groups.ResultOf all the hypothesised associations, 16 of 26 (62%) were in the expected direction. The expected relationships were found between ICECAP-A scores and general health and freedom to do things. ICECAP-A was responsive in terms of capturing the effects on general health and the freedom to do things. Differences were found across age groups, with greater responsiveness to change in those aged under 65 years. The item-by-item analysis showed that capability was mainly driven by stability and autonomy.ConclusionThis study has shown that the Danish ICECAP-A is a valid and responsive measure of the effects of an exercise and education-based rehabilitation programme.



2017 ◽  
Vol 24 (14) ◽  
pp. 1977-1988
Author(s):  
Nathan Miller ◽  
Frances Prevatt

Objective: The purpose of this study was to reexamine the latent structure of ADHD and sluggish cognitive tempo (SCT) due to issues with construct validity. Two proposed changes to the construct include viewing hyperactivity and sluggishness (hypoactivity) as a single continuum of activity level, and viewing inattention as a separate dimension from activity level. Method: Data were collected from 1,398 adults using Amazon’s MTurk. A new scale measuring activity level was developed, and scores of Inattention were regressed onto scores of Activity Level using curvilinear regression. Results: The Activity Level scale showed acceptable levels of internal consistency, normality, and unimodality. Curvilinear regression indicates that a quadratic (curvilinear) model accurately explains a small but significant portion of the variance in levels of inattention. Conclusion: Hyperactivity and hypoactivity may be viewed as a continuum, rather than separate disorders. Inattention may have a U-shaped relationship with activity level. Linear analyses may be insufficient and inaccurate for studying ADHD.



Sign in / Sign up

Export Citation Format

Share Document