MRC sum-score in the ICU: Good reliability does not necessarily reflect “true reliability”

2012 ◽  
Vol 45 (5) ◽  
pp. 767-768 ◽  
Author(s):  
Els Karla Vanhoutte ◽  
Catharina Gerritdina Faber ◽  
Ingemar Sergio José Merkies ◽  
2018 ◽  
Vol 34 (6) ◽  
pp. 367-375 ◽  
Author(s):  
Laura D. Seligman ◽  
Erin F. Swedish ◽  
Jason P. Rose ◽  
Jessica M. Baker

Abstract. The current study examined the validity of two self-report measures of social anxiety constructed using social comparative referent points. It was hypothesized that these comparison measures would be both reliable and valid. Results indicated that two different comparative versions – one invoking injunctive norms and another invoking descriptive norms – showed good reliability, excellent internal consistency, and acceptable convergent and discriminant validity. The comparative measures also predicted positive functioning, some aspects of social quality of life, and social anxiety as measured by an independent self-report. These findings suggest that adding a comparative reference point to instructions on social anxiety measures may aid in the assessment of social anxiety.


2004 ◽  
Vol 20 (4) ◽  
pp. 349-357 ◽  
Author(s):  
Ahmed M. Abdel-Khalek ◽  
Joaquin Tomás-Sabádo ◽  
Juana Gómez-Benito

Summary: To construct a Spanish version of the Kuwait University Anxiety Scale (S-KUAS), the Arabic and English versions of the KUAS have been separately translated into Spanish. To check the comparability in terms of meaning, the two Spanish preliminary translations were thoroughly scrutinized vis-à-vis both the Arabic and English forms by several experts. Bilingual subjects served to explore the cross-language equivalence of the English and Spanish versions of the KUAS. The correlation between the total scores on both versions was .93, and the t value was .30 (n.s.), denoting good similarity. The Alphas and 4-week test-retest reliabilities were greater than .84, while the criterion-related validity was .70 against scores on the trait subscale of the STAI. These findings denote good reliability and validity of the S-KUAS. Factor analysis yielded three high-loaded factors of Behavioral/Subjective, Cognitive/Affective, and Somatic Anxiety, equivalent to the original Arabic version. Female (n = 210) undergraduates attained significantly higher mean scores than their male (n = 102) counterparts. For the combined group of males and females, the correlation between the total score on the S-KUAS and age was -.17 (p < .01). By and large, the findings of the present study provide evidence of the utility of the S-KUAS in assessing trait anxiety levels in the Spanish undergraduate context.


2019 ◽  
Vol 34 (Spring 2019) ◽  
pp. 215-231
Author(s):  
Mussarat J. Khan ◽  
Seemab Rasheed

The purpose of present study is to examine the role of learning strategies as moderator between meta-cognitive awareness and study habits among university students. Sample comprises of 200 students (100 male students and 100 female students) of various universities of Islamabad and Rawalpindi with age ranging from 18-25 years. In order to assess study variables questionnaires were used included Meta-Cognitive Awareness Inventory (Schraw & Dennison, 1994) measuring two-components of meta-cognition that are knowledge and regulation of cognition. Study habits demonstrated by the students were measured by the Study Habits Inventory (Wrenn, 1941). Motivated Strategies for Learning Questionnaire (Pintrich, Smith, Garcia, & McKeachie, 1991) which includes motivation and learning strategies scales. In the present study, only the learning strategies section was utilized, which measures the cognitive strategies and resource management strategies. Results revealed positive correlation between research instruments and are also having good reliability. Regression analysis reflected that meta-cognitive awareness predicts study habits among university students. Regression analysis also suggested that learning strategies including resource management strategies and cognitive strategies significantly moderates the relationship between meta-cognitive awareness and study habits. It is also explored gender differences on learning strategies, meta-cognitive awareness and study habits. Future implications of the study were also discussed.


2018 ◽  
Vol 10 (1) ◽  
pp. 41-47
Author(s):  
Ricky Surya ◽  
Dennis Gunawan

Tuberculosis is an infectious disease caused by mycobacterium tuberculosis. It can affect some parts of the body: lungs, lymph nodes, intestines, kidneys, endometrium, bones, and brain. According to the survey of tuberculosis prevalence conducted by Republic of Indonesia Ministry of Health in 2013-2014, Indonesia was the second country in the world with the most case of tuberculosis. It makes Indonesia become a country with emergency in lungs tuberculosis. An expert system for lungs tuberculosis detection is built to help people detecting the possibility of suffering from lungs tuberculosis. Therefore, it is hoped that the lungs tuberculosis patient can have early treatment. Certainty factor is used to solve the uncertainty problem delivered by the doctor when examining the patient. Thus, certainty factor is an appropriate method to be used in the expert system for detecting certain disease. This method has been correctly implemented, proved by comparing system detection result to manual calculation result. The expert system has 81.25% accuracy, 83.49% success using DeLone and McLean model, and a cronbach alpha of 0.82 which indicates a good reliability based on the indicators used in the questionnaire. Index Terms— Certainty Factor, Disease Detection, Expert System, Pulmonary Tuberculosis, Situsparu


Author(s):  
Noor Hassanah Husin ◽  
Nur Naha Abu Mansur ◽  
Nur Naha Abu Mansur ◽  
Beni Widarman Yus Kelana

Innovation plays a major role and is a crucial component of the organization’s growth. Creativity and innovation have become increasingly popular as key contributors to firm success in the last few decades or so. The incoming technology of Industrial Revolution 4.0 forced many companies to be innovative to compete in technological era. However, many SMEs are not ready and less innovative. Furthermore, there is lack of research focus on HPWS implementation amongst SMEs indicates that further research must be conducted along these lines. Therefore, this study aim to investigate the effect of high performance work system (HPWS) towards innovative work behaviour of employees in small and medium enterprises. This study used quantitative approach to identify the critical success factor of high performance work systems (HPWS) in Malaysian small and medium enterprises (SME) manufacturing industry. This study used descriptive analysis to analyze the data. Five-point Likert scales items ranging from (1-strongly disagree, 5 – strongly agree) employed for measuring the HPWS. Therefore, the total of 81 items survey questions were adapted to obtain the respondents for SME manufacturing industry. Reliability analysis shows that all the HPWS dimensions have very good reliability with Cronbach’s alpha value range from 0.884 to 0.976. According to Tang et al (2014), Cronbach’s alpha range between 0.70 and 0.80 considered as good reliability whereby 0.80 and 0.90 considered as very good reliability. Result also showed that selective staffing has the highest mean score followed by employee participation, which are 3.951 and 3.833 respectively. This proved that selective staffing is most important critical success factor in the HPWS implementation for Malaysian SME manufacturing industry. Keywords: high performance work system, work engagement, innovative work behaviour, small and medium enterprise.


2018 ◽  
Author(s):  
Claudia Nava ◽  
Patrizio Sale ◽  
Vittorio Leggero ◽  
Simona Ferrante ◽  
Cira Fundaro' ◽  
...  

BACKGROUND In recent years, different smartphone apps have been validated for joint goniometry, but none for goniometric assessment of gait after stroke. OBJECTIVE The aims of our work were to assess:1) to assess intra-rater reliability of an image-based goniometric app – DrGoniometer- in the measurement of the extension, flexion angles and range of motion of the knee during the hemiparetic gait of a stroke patient; (2) its validity comparing to the reference method (electrogoniometer) for flexion-extension excursion measurements; and the intra-rater agreement in the choice of the video frames. METHODS An left-hemiparetic inpatient following haemorrhagic stroke was filmed using the app while walking on a linear path. An electrogoniometer was fixed on the medial face of the affected knee in order to record the dynamic goniometry during gait. Twenty-one raters, blinded to measurements, were recruited to rate knee angle measurements from video acquired with DrGoniometer. Each rater repeated the same procedure twice, the second one at least one day after the first measure. RESULTS Results showed that flexion angle measurements are reliable (ICC95%=0.66, 0.34;0.85; SEM=4°), and adequately precise (CV=14%). Extension angles measurements demonstrated moderate reliability and higher degree of variation (ICC=0.51, 0.09;0.77; SEM 4°; CV=53%). ROM values were: ICC=0.23 (-0.21;0.60); CV=20%. Accuracy of DrGoniometer compared to the electrogoniometer was 7.3±4.7°. The selection of maximum extension frame revealed an accordance of 58% and 72% within a range of ±5 or ±10 frames, respectively; while the best flexion frame reported 86% of agreement for both range of 5 and 10 frames. CONCLUSIONS The results demonstrated moderate to good reliability concerning the maximum extension and flexion angles, while assessing ROM DrGoniometer showed poor intra-rater reliability. Flexion angle measurements seemed to be reliable according to ICC and SEM values and more precise with a limited dispersion of results DrGoniometer revealed a good accuracy in the measurement of range of motion. The agreement of the maximal extension frame was anyway adequate within 5 frames (59%) and noticeably increased within 10 frames (72%). In conclusion, DrGoniometer was found to be a valid and reliable method for assessing knee angles during hemiparetic gait. Further studies are necessary to investigate inter-rater reliability and confirm our results.


1991 ◽  
Vol 158 (2) ◽  
pp. 213-221 ◽  
Author(s):  
Siu-Luen Luk ◽  
Patrick Wing-Leung Leung ◽  
John Bacon-Shone ◽  
See-Yuen Chung ◽  
Peter Wing-Ho Lee ◽  
...  

A representative sample of 855 Hong-Kong Chinese children aged 36–48 months were assessed using the BSQ and the PBCL. Good reliability for both instruments were found. For the BSQ and PBCL, 12.75% and 27.5% were above the cut-off points of 10+ and 12 + respectively and 5.9% were above both cut-off points. In the second stage, 234 subjects were recruited by stratified random sampling according to the results of the screening stage. A clinician interviewed the parent, child and teacher before making a diagnosis. The prevalence of behaviour disorder was: nil, 53.7%; dubious, 23.1 %; mild, 18.0%; moderate, 4.5%; and severe, 0.7%. There were significantly more boys in the categories mild, moderate and severe.


2019 ◽  
pp. 1-9 ◽  
Author(s):  
Jill de Ron ◽  
Eiko I. Fried ◽  
Sacha Epskamp

Abstract Background In clinical research, populations are often selected on the sum-score of diagnostic criteria such as symptoms. Estimating statistical models where a subset of the data is selected based on a function of the analyzed variables introduces Berkson's bias, which presents a potential threat to the validity of findings in the clinical literature. The aim of the present paper is to investigate the effect of Berkson's bias on the performance of the two most commonly used psychological network models: the Gaussian Graphical Model (GGM) for continuous and ordinal data, and the Ising Model for binary data. Methods In two simulation studies, we test how well the two models recover a true network structure when estimation is based on a subset of the data typically seen in clinical studies. The network is based on a dataset of 2807 patients diagnosed with major depression, and nodes in the network are items from the Hamilton Rating Scale for Depression (HRSD). The simulation studies test different scenarios by varying (1) sample size and (2) the cut-off value of the sum-score which governs the selection of participants. Results The results of both studies indicate that higher cut-off values are associated with worse recovery of the network structure. As expected from the Berkson's bias literature, selection reduced recovery rates by inducing negative connections between the items. Conclusion Our findings provide evidence that Berkson's bias is a considerable and underappreciated problem in the clinical network literature. Furthermore, we discuss potential solutions to circumvent Berkson's bias and their pitfalls.


2021 ◽  
Vol 19 (1) ◽  
Author(s):  
R. Shah ◽  
F. M. Ali ◽  
A. Y. Finlay ◽  
M. S. Salek

Abstract Background A person’s chronic health condition or disability can have a huge impact on the quality of life (QoL) of the whole family, but this important impact is often ignored. This literature review aims to understand the impact of patients' disease on family members across all medical specialities, and appraise existing generic and disease-specific family quality of life (QoL) measures. Methods The databases Medline, EMBASE, CINHAL, ASSIA, PsycINFO and Scopus were searched for original articles in English measuring the impact of health conditions on patients' family members/partner using a valid instrument. Results Of 114 articles screened, 86 met the inclusion criteria. They explored the impact of a relative's disease on 14,661 family members, mostly 'parents' or 'mothers', using 50 different instruments across 18 specialities including neurology, oncology and dermatology, in 33 countries including the USA, China and Australia. These studies revealed a huge impact of patients' illness on family members. An appraisal of family QoL instruments identified 48 instruments, 42 disease/speciality specific and six generic measures. Five of the six generics are aimed at carers of children, people with disability or restricted to chronic disease. The only generic instrument that measures the impact of any condition on family members across all specialities is the Family Reported Outcome Measure (FROM-16). Although most instruments demonstrated good reliability and validity, only 11 reported responsiveness and only one reported the minimal clinically important difference. Conclusions Family members' QoL is greatly impacted by a relative's condition. To support family members, there is a need for a generic tool that offers flexibility and brevity for use in clinical settings across all areas of medicine. FROM-16 could be the tool of choice, provided its robustness is demonstrated with further validation of its psychometric properties.


2021 ◽  
Vol 80 (Suppl 1) ◽  
pp. 351.2-352
Author(s):  
L. Van de Stadt ◽  
F. Kroon ◽  
M. Reijnierse ◽  
D. Van der Heijde ◽  
F. Rosendaal ◽  
...  

Background:Ultrasound (US) is used in rheumatic musculoskeletal diseases (RMDs) such as hand osteoarthritis (OA) as outcome measure. Traditionally scoring is performed real-time, but central reading of static US images could avoid issues of inter-rater reliability. However, agreement between real-time and static assessment has not been studiedObjectives:To study the agreement between real-time and static scoring of US in inflammatory hand OA.Methods:Ultrasound was performed of 30 joints obtained in 75 patients with hand osteoarthritis, treated with prednisolone or placebo in a randomized double-blind trial. Hand joints were assessed for synovial thickening, effusion, Doppler signal and osteophytes by ultrasound (score 0-3 per joint) at baseline and after treatment. Two ultrasonographers blinded for clinical data scored the live images together (simultaneously) in real-time. A consensus score for each joint was recorded. Representative images stored during scanning were scored by one ultrasonographer minimally 6 months after real-time scoring. For each patient, images of each visit were scored paired, with known chronological order.Agreement between scoring methods was studied at joint level with quadratic weighted kappa. At patient level, intra-class correlations (ICC; mixed effect model, absolute agreement, with clustering taken into account) were calculated at both timepoints. ICCs were also calculated for the delta of sum scores. Responsiveness of scoring methods was analyzed with generalized estimating equations (GEE) with treatment as independent and ultrasonography findings as dependent variable.Results:Thirty-nine patients (52%) were treated with prednisolone and 36 (48%) were treated with placebo. Patient characteristics were well-balanced between treatment groups.All patients had signs of synovial thickening and osteophytes as assessed by real-time ultrasonography, and almost all signs of effusion (99%) or a positive Doppler signal (95%) in at least one joint. Total ultrasonography sum score for osteophytes was high (mean 45 ±SD 12), whereas sum score was low for positive Doppler signal (mean 5.9 ±SD 4.4), with intermediate sum scores for synovial thickening and effusion (mean 16 ±SD 6.3 and 11 ±SD 6.0 respectively). Static sum scores were overall slightly higher (osteophytes mean 48 ±SD 10; Doppler mean 6.9 S±D 5.0; synovial thickening mean 20 ±SD 7.0 and effusion 13 ±SD 6.5)Agreement at baseline was good to excellent at joint level (kappa 0.72-0.88) and moderate to excellent at patient level (ICC 0.59-0.86). Agreement for delta sum scores was poor to fair for synovial thickening and effusion (ICC 0.18 and 0.34 respectively), but excellent for Doppler signal (ICC 0.80) (Table 1).Real-time ultrasonography showed responsiveness to prednisolone with a mean between-group difference of synovial thickening sum score of -2.5 (CI:-4.7 to-0.3). Static ultrasonography did not show a decrease in synovial thickening (Figure 1). No difference in ultrasonography scores was seen for the other ultrasonography features, neither with real-time nor static scoring.Conclusion:While cross-sectional agreement between real-time and static ultrasonography was good, agreement of delta sum scores was not and paired static ultrasonography measurement of synovial thickening did not show responsiveness to prednisone therapy where real-time ultrasonography did. Therefore, when using ultrasonography in clinical trials, real-time dynamic scoring should remain the standard.Table 1.Agreement on patient levelBaselineWeek 6Delta W6-BLICC (95% CI)ICC (95% CI)ICC (95% CI)Synovitis0.59 (0.26-0.76)0.58 (0.24-0.77)0.18 (0 - 0.40)Effusion0.84 (0.66-0.92)0.84 (0.75-0.89)0.34 (0.12-0.53)Osteophytes0.82 (0.50-0.92)0.78 (0.56-0.88)NDDoppler0.86 (0.75-0.92)0.91 (0.85-0.94)0.80 (0.70 -0.87)ICC: intra-class correlation coefficient linear mixed model (random patient, fixed rating), absolute agreement. ND: Not DerterminedDisclosure of Interests:Lotte van de Stadt: None declared, Féline Kroon: None declared, Monique Reijnierse Grant/research support from: Dutch Arthritis Foundation, Désirée van der Heijde Consultant of: bbVie, Amgen, Astellas, AstraZeneca, Bayer, BMS, Boehringer Ingelheim, Celgene, Cyxone, Daiichi, Eisai, Eli-Lilly, Galapagos, Gilead, Glaxo-Smith-Kline, Janssen, Merck, Novartis, Pfizer, Regeneron, Roche, Sanofi, Takeda, UCB Pharma, Frits Rosendaal: None declared, Naghmeh Riyazi: None declared, R. de Slegte: None declared, Jende van Zeben: None declared, Cornelia Allaart: None declared, Margreet Kloppenburg Consultant of: Abbvie, Pfizer, Levicept, GlaxoSmithKline, Merck-Serono, Kiniksa, Flexion, Galapagos, Jansen, CHDR, Grant/research support from: MI-APPROACH, Marion Kortekaas: None declared


Sign in / Sign up

Export Citation Format

Share Document