SWAT: Do We Need Conjoint Measurement?

Author(s):  
David W. Biers

The present study sought to determine the utility of the unweighted sum as an alternative to conjoint measurement in forming a workload composite measure with the Subjective Workload Assessment Technique (SWAT). The data from a simulator study designed to identify pilot workload associated with alternative cockpit configurations in a night air interdiction mission were reanalyzed using a percentage measure (SUMPCT) based on the unweighted sum of the three SWAT rating scales. Results indicated that the CONJOINT and SUMPCT workload composites were highly correlated and were equally sensitive to detecting differences in the independent variables. The reasons for the equal sensitivity of the two composite measures are discussed. This study adds to the growing body of evidence that one can form a composite measure of workload using the SWAT rating scales without the necessity of having to conduct the time-consuming card sort.

1971 ◽  
Vol 8 (3) ◽  
pp. 355-363 ◽  
Author(s):  
Paul E. Green ◽  
Vithala R. Rao

Conjoint measurement is a new development in mathematical psychology that can be used to measure the joint effects of a set of independent variables on the ordering of a dependent variable. In this (primarily expository) article, the techniques are applied to illustrative problems in marketing. In addition, a number of possible areas of application to marketing research are discussed, as well as some of the methodology's limitations.


1987 ◽  
Vol 31 (1) ◽  
pp. 63-66 ◽  
Author(s):  
David W. Biers ◽  
Philip J. Masline

The present study sought to determine the sensitivity of three alternative approaches to deriving a workload composite measure based upon data gathered using the Subjective Workload Assessment Technique (SWAT) and to determine through the use of multivariate statistical procedures (MANOVA) if anything is to be gained by retaining the individual scale information of SWAT. The three rating scale dimensions of SWAT (time load, mental effort load, psychological stress load) were combined into a single workload composite using three techniques: conjoint measurement; a simple sum of the three scales weighted equally; an empirically determined weighted-linear combination of the three scales (from MANOVA). Using data gathered by having subjects perform a continuous memory task under twelve levels of task difficulty, it was found that the three composite measures were equally sensitive and highly correlated (the minimum correlation among the three composites being 0.9913). The results of the MANOVA performed on the same data indicated that the individual scales of SWAT were differentially sensitive to different task demands and that individual scale information should be retained rather than rely on a simple composite.


2004 ◽  
Vol 10 (4) ◽  
pp. 447-450 ◽  
Author(s):  
L Nicholl ◽  
J Hobart ◽  
L Dunwoody ◽  
F Cramp ◽  
A Lowe-Strong

The Community Dependency Index (CDI) was developed due to concerns that the Barthel Index (BI) was limited as a measure of physical function in community settings. However, no studies have compared the two rating scales within multiple sclerosis (MS). The aim of this study was to determine whether, in a community-based sample of people with MS, the CDI is a better measure than the BI. BI and CDI data were collected from 90 people with MS. Four measurement properties were compared: scaling assumptions (item mean scores, corrected item-total correlations), acceptability (score distributions, floor/ceiling effects), reliability (Cronbach’s alpha) and validity (concurrent, discriminant, group differences, relative validity). Both scales satisfied recommended criteria for scaling assumptions (indicating it was legitimate to report a summed score) and internal consistency reliability (alpha-0.85). The scales were highly correlated (r- 0.96), indicating they measured the same construct. Both scales demonstrated good group differences validity, but the BI was marginally superior. Notable ceiling effects (BI-CDI) were demonstrated for both scales, particularly in those less disabled. This study sample had relatively minor levels of disability, with over 70% still being independently mobile. In this sample of people with MS, the measurement properties of the BI and CDI examined were very similar, suggesting the CDI does not appear to have achieved its goal of better measurement.


1989 ◽  
Vol 66 (4) ◽  
pp. 1553-1560 ◽  
Author(s):  
J. C. Parker ◽  
M. I. Townsley ◽  
J. T. Cartledge

To determine whether the accelerated rate of lobe weight gain during severe pulmonary edema is attributed to increased permeability of the microvascular barrier or a loss of tissue forces opposing filtration, the effect of edema on capillary filtration coefficient (Kf,C), interstitial compliance (Ci), and the volume of fluid filtered after a step increase in microvascular pressure (delta Vi) were determined in eight isolated left lower lobes of dog lungs perfused at 37 degrees C with autologous blood. After attaining a base-line isogravimetric state, the capillary pressure (Pc) was increased in successive steps of 2, 5, and 10 cmH2O. This sequence of vascular pressure increases was repeated three times. Edema accumulation was expressed as weight gained as a percent of initial lobe weight (% delta Wt), and Kf,C was measured by time 0 extrapolation of the weight gain curve. An exponential rate constant for the decrease in the rate of weight gain with time (K) was calculated for each curve. Ci was then calculated by assuming that the capillary wall and interstitium constitute a resistance-capacitance network. Kf,C was not increased by edema formation in any group. Between mild (% delta Wt less than 30%) and severe edema states (% delta Wt greater than 50%) respective mean Ci increased significantly from 3.54 to 9.12 ml.cmH2O-1.100 g-1, K decreased from 0.089 to 0.036 min-1, and delta Vi increased from 1.28 to 2.4 ml.cmH2O-1.100 g-1. The delta Vi during each Pc increase was highly correlated with Kf,C and Ci when used together as independent variables (r = 0.99) but less well correlated when used separately.(ABSTRACT TRUNCATED AT 250 WORDS)


2010 ◽  
Vol 37 (2) ◽  
pp. 453-461 ◽  
Author(s):  
DAFNA D. GLADMAN ◽  
ROBERT LANDEWÉ ◽  
NEIL J. McHUGH ◽  
OLIVER FITZGERALD ◽  
DIAMANT THACI ◽  
...  

At the 2008 annual meeting of GRAPPA (Group for Research and Assessment of Psoriasis and Psoriatic Arthritis) in Leeds, UK, members discussed the value and current status of composite measures for the assessment of psoriatic arthritis (PsA). In plenary presentations, examples of composite measures developed for rheumatoid arthritis (RA) and ankylosing spondylitis (AS) were reviewed, followed by a presentation of the assessment of disease activity in systemic lupus erythematosus. Three recently devised composite methods of assessing activity or response in PsA also were presented. Considerable discussion followed in breakout groups, and members agreed that a new composite measure specifically for PsA is necessary. The composite measure should include components that encompass the spectrum of psoriatic disease, i.e., in addition to assessment of peripheral joints, it should include assessment of sacroiliitis, spondylitis, enthesitis, and dactylitis, as well as skin and nail disease.


2013 ◽  
Vol 12 (3) ◽  
pp. 391-421
Author(s):  
Jørgen Møller ◽  
Svend-Erik Skaaning

Abstract The rule of law research agenda is in many ways still in its infancy. This is reflected, inter alia, in the fact that no attempt has been made to investigate the empirical relationship between sub-components of the rule law. In this article, we set out to make such an appraisal. We take our cue from a recent attempt to get at this relationship with a typology of ‘defective’ subtypes of the rule of law. Insofar as the underlying radial logic characterizes the relationship between constituent units of the rule of law, it would mean that countries tend to be situated in a range of so-called diminished subtypes, i.e., combinations defined by the presence of all attributes save one. The upshot of this is that we cannot simply aggregate the sub-component scores into composite indices. However, our analyses show that the scores on different rule of law attributes are highly correlated and that – if less fine-grained distinctions are used – cases tend to be characterized by either the presence of all attributes, by moderate scores on all attributes, or by severe shortcomings in every regard. These findings can be taken to support, first, that the value of constructing diminished subtypes of the rule of law is limited, and, second, that the creation of composite measures by aggregating across the rule of law subcomponents is not hampered by multidimensionality. At the end of the article, we use the extant literature on democratization and state formation to identify some potential reasons for the high co-variation between rule of law attributes.


Author(s):  
Alexandra de Raadt ◽  
Matthijs J. Warrens ◽  
Roel J. Bosker ◽  
Henk A. L. Kiers

AbstractKappa coefficients are commonly used for quantifying reliability on a categorical scale, whereas correlation coefficients are commonly applied to assess reliability on an interval scale. Both types of coefficients can be used to assess the reliability of ordinal rating scales. In this study, we compare seven reliability coefficients for ordinal rating scales: the kappa coefficients included are Cohen’s kappa, linearly weighted kappa, and quadratically weighted kappa; the correlation coefficients included are intraclass correlation ICC(3,1), Pearson’s correlation, Spearman’s rho, and Kendall’s tau-b. The primary goal is to provide a thorough understanding of these coefficients such that the applied researcher can make a sensible choice for ordinal rating scales. A second aim is to find out whether the choice of the coefficient matters. We studied to what extent we reach the same conclusions about inter-rater reliability with different coefficients, and to what extent the coefficients measure agreement in a similar way, using analytic methods, and simulated and empirical data. Using analytical methods, it is shown that differences between quadratic kappa and the Pearson and intraclass correlations increase if agreement becomes larger. Differences between the three coefficients are generally small if differences between rater means and variances are small. Furthermore, using simulated and empirical data, it is shown that differences between all reliability coefficients tend to increase if agreement between the raters increases. Moreover, for the data in this study, the same conclusion about inter-rater reliability was reached in virtually all cases with the four correlation coefficients. In addition, using quadratically weighted kappa, we reached a similar conclusion as with any correlation coefficient a great number of times. Hence, for the data in this study, it does not really matter which of these five coefficients is used. Moreover, the four correlation coefficients and quadratically weighted kappa tend to measure agreement in a similar way: their values are very highly correlated for the data in this study.


2018 ◽  
Vol 7 (4) ◽  
pp. 22-35
Author(s):  
Brad Gerbrandt ◽  
Marion Joyce Alexander ◽  
David Telles-Langdon

The 180º cutting maneuver (also known as the 505 drill) is commonly seen in field and court sports, and it consists of a 15 m run up to a turning point, followed by a timed stop and 180º change of direction for 5 m. The purpose of this study was to determine the most effective joint movements, limb velocities and body positions to perform the 180º cutting maneuver.  Additionally, the study compared the kinematics of the 505 drill performed indoors while wearing running shoes and outdoors while wearing cleats.  For this study, twelve athletes executed the 505 drill indoors while wearing running shoes, and twelve executed the 505 drill outdoors while wearing cleats.  Fifty nine independent variables were measured for each athlete and compared to the athlete’s time to complete the test.  Mean test time was 2.27 seconds for the indoor group and a significantly lower 2.47 s for the outdoor group. Correlation analysis and forward stepwise multiple regression analysis was performed on both groups to determine which variables were significantly related to test time.  Trunk forward lean at push off of the jab leg was most highly correlated to test time for the indoor athletes (r= -0.887), however, flexion at maximum flexion of the jab knee was most highly correlated to test time for the outdoor group (r= -0.748).  Outdoor athletes could benefit from assuming a lower and more flexed body position similar to the indoor athletes and attain a greater degree of trunk lean at jab leg touchdown.


2021 ◽  
Vol 50 (Supplement_1) ◽  
Author(s):  
Jessica Stanhope ◽  
Philip Weinstein

Abstract Background Pain is often measured by asking people to rate their pain intensity at its worst, on average, and at its least, for the last 7 days using numeric rating scales. The three ratings are summed to produce a composite measure. The validity and reliability of this composite measure has not been examined using modern psychometric methods in any population. We examined the validity and reliability of this pain intensity measure for use with professional musicians, university music and science students, and university staff, all of whom had reported experiencing musculoskeletal symptoms in the last 7 days. Methods Data were collected using a questionnaire survey. The validity and reliability of the composite pain measure were examined using Rasch analysis. Differential item functioning was examined for age, gender, student status, musician status, and socioeconomic status. Results While the data fit one of the Rasch models, after several response categories were collapsed, differential item functioning was present. There was no solution found that fit one of the Rasch models, without differential item functioning. Conclusions Despite the recommendation for the three number ratings scales for pain to be combined, using Rasch analysis showed that this was not a valid approach for our study population. Our findings highlight the importance of using Rasch analysis to examine the utility of measures. Key messages Rasch analysis is a useful method for investigating the validity and reliability of scales. Combining pain ratings cannot be assumed to produce a valid and reliable measure.


Author(s):  
Tomasz Woźniakowski

The paper describes the next stage of the project of an IT platform supporting farmers and organic producers. The article describes the implementation of the method developed in the course of research described in the previous, cited publication of the author. The method assumes the use of composite measures to create a universal gauge (“Good Food Print” ratio GFP) that provides comprehensive information on the good practices used throughout the supply chain of the final product of organic farming. The system offers consumers information in the formula of the Internet All Things, supports producers in the selection of the best suppliers and enables the maintenance of obligatory registers.


Sign in / Sign up

Export Citation Format

Share Document