Item count technique with no floor and ceiling effects

2019 ◽  
Vol 49 (6) ◽  
pp. 1330-1356
Author(s):  
Tasos C. Christofides ◽  
Eleni Manoli
2021 ◽  
Vol 4 (2) ◽  
pp. 251524592110073
Author(s):  
Julia M. Rohrer ◽  
Ruben C. Arslan

Psychological theories often invoke interactions but remain vague regarding the details. As a consequence, researchers may not know how to properly test them and may potentially run analyses that reliably return the wrong answer to their research question. We discuss three major issues regarding the prediction and interpretation of interactions. First, interactions can be removable in the sense that they appear or disappear depending on scaling decisions, with consequences for a variety of situations (e.g., binary or categorical outcomes, bounded scales with floor and ceiling effects). Second, interactions may be conceptualized as changes in slope or changes in correlations, and because these two phenomena do not necessarily coincide, researchers might draw wrong conclusions. Third, interactions may or may not be causally identified, and this determines which interpretations are valid. Researchers who remain unaware of these distinctions might accidentally analyze their data in a manner that returns the technically correct answer to the wrong question. We illustrate all issues with examples from psychology and issue recommendations for how to best address them in a productive manner.


2021 ◽  
Vol 8 ◽  
pp. 237437352199883
Author(s):  
Yvonne Versluijs ◽  
Maartje Lemmers ◽  
Laura E. Brown ◽  
Amanda I. Gonzalez ◽  
Joost T. P. Kortlever ◽  
...  

This study assessed the correlation of 9 questions addressing communication effectiveness (the Communication Effectiveness Questionnaire [CEQ]) with other patient-reported experience measures (PREMs; satisfaction, perceived empathy) as well as patient-reported outcome measures (PROMs; pain intensity, activity tolerance) in patients with musculoskeletal illness or injury. In a cross-sectional study, 210 patients visiting an orthopedic surgeon completed the CEQ and measures of satisfaction with the visit, perceived empathy, pain intensity, and activity tolerance. We evaluated correlations between CEQ and other PREMs and CEQ and PROMs. We measured ceiling effects of the PREMs. Communication effectiveness correlated moderately with other PREMs such as satisfaction (ρ = 0.54; P < .001) and perceived empathy (ρ = 0.54; P < .001). Communication effectiveness did not correlate with PROMs: pain intensity (ρ = −0.01; P = .93) and activity tolerance (ρ = −0.05; P = .44). All of the experience measures have high ceiling effects: perceived empathy 37%, satisfaction 80%, and CEQ 46%. The observation of notable correlations of various PREMs, combined with their high ceiling effects, direct us to identify a likely common statistical construct (which we hypothesize as “relationship”) accounting for variation in PREMs, and then develop a PREM which measures that construct in a manner that results in a Gaussian distribution of scores. At least within the limitations of current experience measures, there seems to be no association between illness (PROMs) and experience (PREMs).


2015 ◽  
Vol 13 (1) ◽  
pp. 138-151 ◽  
Author(s):  
Neta Yitzhak ◽  
Ayelet Harel ◽  
Maya Yaari ◽  
Edwa Friedlander ◽  
Nurit Yirmiya

2021 ◽  
Vol 19 (1) ◽  
Author(s):  
A. M. Garratt ◽  
H. Furunes ◽  
C. Hellum ◽  
T. Solberg ◽  
J. I. Brox ◽  
...  

Abstract Background The EuroQol EQ-5D is one of the most widely researched and applied patient-reported outcome measures worldwide. The original EQ-5D-3L and more recent EQ-5D-5L include three and five response categories respectively. Evidence from healthy and sick populations shows that the additional two response categories improve measurement properties but there has not been a concurrent comparison of the two versions in patients with low back pain (LBP). Methods LBP patients taking part in a multicenter randomized controlled trial of lumbar total disc replacement and conservative treatment completed the EQ-5D-3L and 5L in an eight-year follow-up questionnaire. The 3L and 5L were assessed for aspects of data quality including missing data, floor and ceiling effects, response consistency, and based on a priori hypotheses, associations with the Oswestry Disability Index (ODI), Pain-Visual Analogue Scales and Hopkins Symptom Checklist (HSCL-25). Results At the eight-year follow-up, 151 (87%) patients were available and 146 completed both the 3L and 5L. Levels of missing data were the same for the two versions. Compared to the EQ-5D-5L, the 3L had significantly higher floor (pain discomfort) and ceiling effects (mobility, self-care, pain/discomfort, anxiety/depression). For these patients the EQ-5D-5L described 73 health states compared to 28 for the 3L. Shannon’s indices showed the 5L outperformed the 3L in tests of classification efficiency. Correlations with the ODI, Pain-VAS and HSCL-25 were largely as hypothesized, the 5L having slightly higher correlations than the 3L. Conclusion The EQ-5D assesses important aspect of health in LBP patients and the 5L improves upon the 3L in this respect. The EQ-5D-5L is recommended in preference to the 3L version, however, further testing in other back pain populations together with additional measurement properties, including responsiveness to change, is recommended. Trial registration: retrospectively registered: https://clinicaltrials.gov/ct2/show/NCT01704677.


2017 ◽  
Vol 26 (8) ◽  
pp. 2079-2084 ◽  
Author(s):  
Alexander Konnopka ◽  
Hans-Helmut Koenig

2021 ◽  
Vol 9 (9) ◽  
pp. 232596712110383
Author(s):  
Romy Deviandri ◽  
Hugo C. van der Veen ◽  
Andri M.T. Lubis ◽  
Maarten J. Postma ◽  
Inge van den Akker-Scheek

Background: No questionnaire is currently available for use in patients with anterior cruciate ligament (ACL) injuries in an Indonesian population. The most-used questionnaire in clinical research for these patients is the International Knee Documentation Committee (IKDC) Subjective Knee Form, as its psychometric properties are considered to be excellent. Purpose: To translate the IKDC into Indonesian and assess its validity for use in Indonesian-speaking patients with ACL injuries. Study Design: Cohort study (diagnosis); Level of evidence, 2. Methods: After a forward-and-backward translation procedure and cross-cultural adaptation, the validity and reliability of the questionnaire were investigated. The responses of ACL injury patients on 3 questionnaires, the Indonesian-IKDC (I-IKDC), 36-Item Short Form Health Survey, and Kujala Anterior Knee Pain Scale, were compared. Following consensus-based standards for the selection of health measurement instruments guidelines, construct validity, test-retest reliability, internal consistency, floor and ceiling effects, and measurement error were determined. The Bland-Altman method was used to explore absolute agreement. Results: Of 253 ACL injury patients, 106 (42%) responded to the invitation. Construct validity was considered good, as all predefined hypotheses on correlations between the I-IKDC and other scores were confirmed. Reliability proved excellent, with a high test-retest correlation (intraclass correlation coefficient = 0.99). Bland-Altman analyses showed no systematic bias between test and retest. Internal consistency was good (Cronbach α = .90). There were no floor or ceiling effects. Standard error of measurement was 2.1, and the minimal detectable change was 5.8 at the individual level and 0.7 at the group level. Conclusion: The I-IKDC, as developed, appeared to be a good evaluation instrument for Indonesian patients with ACL injuries.


2020 ◽  
Author(s):  
Hailemariam Mamo Hassen ◽  
Manas Ranjan Behera ◽  
Pratap Kumar Jena ◽  
Sudhir K Kumar Satpathy

Abstract Background: Comprehensive tool is not available to assess health literacy status across different languages, contexts and population structures except European health literacy survey scale (HLS-EU-Q47) which is widely used adapted and tested in different countries and languages. However, it was not tested for Ethiopian populations. This study aim was to validate and test the reliability of the Amharic version of the HLS-EU-Q47 survey questionnaire (HLS-Amh) among school adolescents and university students in Dire Dawa, Ethiopia. Method: A cross-sectional study with multistage random sampling was done on urban school adolescents and university students from public schools and Dire Dawa University in Dire Dawa city, Ethiopia, Africa. After translating HLS‐EU‐Q47 into Amharic by translation and back- translation, data was collected using a self-reported questionnaire from samples of 744 participants with 9% non-response rate in October and November, 2018. Confirmatory factor analysis and correlation analysis was done using SPSS and AMOS. Goodness of fit indices, item-scale convergent validity, Pearson correlation coefficient, floor and ceiling effects, Cronbach's alpha and split-half spearman-brown coefficient was computed taking the cut-off values from guidelines and literatures. Ethical issue was contemplated and informed consent was obtained from institutions and participants. Result: Amharic version of HLS- EU-Q47, (HLS-Amh) was reliable but weak for its validity to measure health literacy among urban school adolescents and university students in Dire Dawa, Ethiopia. Goodness-of-fit indices (GFI, AGFI, CFI and IFI) were within range of 0.90-0.80. Although, RMSEA indices were less 0.10, others have made it insufficient to be said as a good model-data fit and was not tolerable for its validity, and the model lacked strength to meet the model-fit indices satisfaction with higher apparent floor/ceiling effects. However, it showed high levels of internal consistency of reliability with relatively higher Cronbach’s alpha coefficient (α=0.910). Conclusions: HLS-Amh was reliable but weak for its validity on these population groups. It can be used for a general survey on awareness and knowledge other than screening substantial and clinical related inquiries. It needs further adaptation and validation for comprehensiveness for demographic, multi-lingual and cultural contexts in Ethiopia.


Sign in / Sign up

Export Citation Format

Share Document