scholarly journals Statistical methods and models based on quality of experience distributions

2020 ◽  
Vol 6 (1) ◽  
Author(s):  
Michael Seufert

AbstractDue to biased assumptions on the underlying ordinal rating scale in subjective Quality of Experience (QoE) studies, Mean Opinion Score (MOS)-based evaluations provide results, which are hard to interpret and can be misleading. This paper proposes to consider the full QoE distribution for evaluating, reporting, and modeling QoE results instead of relying on MOS-based metrics derived from results based on ordinal rating scales. The QoE distribution can be represented in a concise way by using the parameters of a multinomial distribution without losing any information about the underlying QoE ratings, and even keeps backward compatibility with previous, biased MOS-based results. Considering QoE results as a realization of a multinomial distribution allows to rely on a well-established theoretical background, which enables meaningful evaluations also for ordinal rating scales. Moreover, QoE models based on QoE distributions keep detailed information from the results of a QoE study of a technical system, and thus, give an unprecedented richness of insights into the end users’ experience with the technical system. In this work, existing and novel statistical methods for QoE distributions are summarized and exemplary evaluations are outlined. Furthermore, using the novel concept of quality steps, simulative and analytical QoE models based on QoE distributions are presented and showcased. The goal is to demonstrate the fundamental advantages of considering QoE distributions over MOS-based evaluations if the underlying rating data is ordinal in nature.

2020 ◽  
Vol 13 (9) ◽  
pp. 94
Author(s):  
Xin Qu

The present study was executed with the purpose of validating ELT Certificate Lesson Observation and Report Task (ELTC-LORT), which was developed by China Language Assessment to certify China’s EFL teachers by performance-based testing. The ELT Certificate has high-stakes considering its impacts on candidates’ recruitment, ELT in China and quality of education, so it is crucially important for its validation so as to guarantee fairness and justice. The validity of task construct and rating rubric went through a process suited for many-facet Rasch measurement supplemented with qualitative interviews. Participants (N = 40) were provided with a video excerpt from a real EFL lesson, and required to deliver a report on the teacher’s performance. Two raters graded the records of the candidates’ reports using rating scales developed to measure EFL teacher candidates’ oral English proficiency and ability to analyze and evaluate teaching. Many-facet Rasch analysis demonstrated a successful estimation, with a noticeable spread among the participants and their traits, proving the task functioned well in measuring candidates’ performance and reflecting the difference of their ability. The raters were found to have good internal self-consistency, but not the same leniency. The rating scales worked well, with the average measures advancing largely in line with Rasch expectations. Semi-structured interviews as well as focus group interviews were executed to provide knowledge regarding the raters’ performance levels and the functionalities of the rating scale items. The findings provide implications for further research and practice of the Certificate.


2018 ◽  
Vol 18 (1) ◽  
pp. 29-37 ◽  
Author(s):  
Andreas Goebel ◽  
Anu Jacob ◽  
Bernhard Frank ◽  
Paul Sacco ◽  
Guillermo Alexander ◽  
...  

Abstract Background and aims: Current therapies for persistent complex regional pain syndrome (CRPS) are grossly inadequate. With accruing evidence to support an underlying immunological process and anecdotal evidence suggesting potential efficacy of mycophenolate, we wished to explore the feasibility and effectiveness of this treatment in patients with CRPS. Methods: A randomised, open, parallel, proof of concept trial was conducted. Patients with Budapest research criteria CRPS of >2-year duration and moderate or high pain intensity (numeric rating scale score ≥5) were enrolled. Eligible patients were randomised 1:1 to openly receive mycophenolate as add-on treatment, or their usual treatment alone, over 5.5 months. They then switched to the other treatment arm for 5.5 months. The main outcome was average the patients’ average pain intensity recorded over 14 days, between 5.0 and 5.5 months post randomisation, on 11-point (0–10) numeric rating scales, compared between trial arms. Skin sensitivities and additional outcomes were also assessed. Results: Twelve patients were enrolled. Nine provided outcomes and were analysed for the main outcome. Mycophenolate treatment was significantly more effective than control [drug-group mean (SD): pre: 7.4 (1.2)- post: 5.2 (1.3), n=4, control: pre: 7.7 (1.4)- post: 8.1 (0.9), n=5; −2.8 (95% CI: −4.7, −1.0), p=0.01, analysis of covariance]. There were four treatment responders (to mycophenolate treatment either before, or after switch), whose initial exquisite skin hyper-sensitivities, function and quality of life strongly improved. Side effects including itchiness, skin-cryptitis, increased pain, and increased depression caused 45% of the subjects to stop taking mycophenolate. Conclusions: Mycophenolate appears to reduce pain intensity and improve quality of life in a subgroup of patients with persistent CRPS. Implications: These results support the feasibility of conducting a definite trial to confirm the efficacy and effect size of mycophenolate treatment for persistent CRPS (EudraCT 2015-000263-14).


Cancers ◽  
2021 ◽  
Vol 13 (8) ◽  
pp. 1855
Author(s):  
Roberta Gasparro ◽  
Elena Calabria ◽  
Noemi Coppola ◽  
Gaetano Marenzi ◽  
Gilberto Sammartino ◽  
...  

Quality of sleep (QoS) and mood may impair oral cancer survivors’ wellbeing, however few evidences are currently available. Therefore, we aimed to assess the prevalence of sleep disorders, anxiety and depression among five-year oral cancer survivors (OC survivors). 50 OC survivors were compared with 50 healthy subjects matched for age and sex. The Pittsburgh Sleep Quality Index (PSQI), the Epworth Sleepiness Scale (ESS), the Hamilton Rating Scales for Depression and Anxiety (HAM-D, HAM-A), the Numeric Rating Scale (NRS), the Total Pain Rating Index (T-PRI) were administered. The global score of the PSQI, ESS, HAM-A, HAM-D, NRS, T-PRI, was statistically higher in the OC survivors than the controls (p-value: <0.001). QoS of OC survivors was significantly impaired, especially with regard to some PSQI sub-items as the subjective sleep quality, sleep latency and daytime dysfunction (p-value: 0.001, 0.029, 0.004). Moreover, poor QoS was negatively correlated with years of education (p-value: 0.042 *) and positively correlated with alcohol consumption (p-value: 0.049 *) and with the use of systemic medications (p-value: 0.044 *). Sleep disorders and mood disorders are common comorbidities in OC survivors; therefore, early assessment and management before, during and after treatment should be performed in order to improve the quality of life of OC survivors.


Author(s):  
Matthias Domhardt ◽  
Eva-Maria Messner ◽  
Anna-Sophia Eder ◽  
Sophie Engler ◽  
Lasse B. Sander ◽  
...  

Abstract Background The access to empirically-supported treatments for common mental disorders in children and adolescents is often limited. Mental health apps might extend service supplies, as they are deemed to be cost-efficient, scalable and appealing for youth. However, little is known about the quality of available apps. Therefore, we aimed to systematically evaluate current mobile-based interventions for pediatric anxiety, depression and posttraumatic stress disorder (PTSD). Methods Systematic searches were conducted in Google Play Store and Apple App Store to identify relevant apps. To be eligible for inclusion, apps needed to be: (1) designed to target either anxiety, depression or PTSD in youth (0–18 years); (2) developed for children, adolescents or caregivers; (3) provided in English or German; (4) operative after download. The quality of eligible apps was assessed with two standardized rating systems (i.e., Mobile App Rating Scale (MARS) and ENLIGHT) independently by two reviewers. Results Overall, the searches revealed 3806 apps, with 15 mental health apps (0.39%) fulfilling our inclusion criteria. The mean overall scores suggested a moderate app quality (MARS: M = 3.59, SD = 0.50; ENLIGHT: M = 3.22, SD = 0.73). Moreover, only one app was evaluated in an RCT. The correlation of both rating scales was high (r = .936; p < .001), whereas no significant correlations were found between rating scales and user ratings (p > .05). Conclusions Our results point to a rather poor overall app quality, and indicate an absence of scientific-driven development and lack of methodologically sound evaluation of apps. Thus, future high-quality research is required, both in terms of theoretically informed intervention development and assessment of mental health apps in RCTs. Furthermore, institutionalized best-practices that provide central information on different aspects of apps (e.g., effectiveness, safety, and data security) for patients, caregivers, stakeholders and mental health professionals are urgently needed.


Cephalalgia ◽  
1986 ◽  
Vol 6 (2) ◽  
pp. 69-80 ◽  
Author(s):  
P Bech ◽  
M Kastrup ◽  
D Loldrup

The basic principles of the rating scale procedure have been outlined, including the Likert scale, the Guilford criteria for item definitions, and the Guttman and Rasch criteria for item combinations. With these criteria, headache rates among the core symptoms of anxiety and depression. Next, we have discussed one of the prevailing scales for headache, the Waters Headache Questionnaire (WHQ), with a multiaxial approach. The WHQ thus contains a severity axis, a diagnostic axis, and a personality axis. Previous studies on the validity of the WHQ, including factor analysis, have shown that migraine and muscular headaches are not mutually exclusive categories. Studies to validate a two-dimensional diagnostic system of migraine and non-migraine headache by Rasch models are discussed. In the field of personality it was suggested, when using questionnaires like the WHQ, to focus on the concepts of acquiescence and dissimulation. Supplemental axes such as “severity of psychosocial stressors” and “social functioning” or “quality of life” should be considered in future research.


2016 ◽  
Vol 2016 ◽  
pp. 1-8 ◽  
Author(s):  
Jun-Yu Fan ◽  
Bao-Luen Chang ◽  
Yih-Ru Wu

The aim of this study was to examine the relationships among depression, anxiety, sleep disturbances, Parkinson’s disease (PD) symptoms, PD medications, and health-related quality of life (QOL) and to identify the predictors of health-related QOL in PD patients. To do this, we administered a battery of questionnaires and rating scales (validated Chinese versions), including the Unified Parkinson’s Disease Rating Scale, 39-item Parkinson’s Disease Questionnaire, Parkinson’s Disease Sleep Scale-2, Beck Depression Inventory, and Beck Anxiety Inventory, to 134 patients with PD whose Minimental State Examination scores were ≥24. We found that patients who reported having poorer QOL had longer disease durations, more severe PD symptoms, higher Hoehn and Yahr stages, and higher levodopa dosages, as well as higher levels of anxiety and depression, more sleep disturbances, and poorer overall cognitive statuses. Among these variables, the cognitive status, dependency of activities of daily living, depression, and anxiety were identified as predictors of QOL in PD patients and were all significant and independent factors of poor QOL in PD patients. The clinicians should be aware of the effects of these factors on QOL and attempt to treat comorbid psychiatric conditions to improve the PD patients’ QOL.


1998 ◽  
Vol 13 (1) ◽  
pp. 14-19 ◽  
Author(s):  
L. Noonan ◽  
S. M. Burge

Objective: To employ standardized techniques to measure and characterize the pain associated with leg ulcers of defined causes. Methods: Patients attending leg ulcer clinics were interviewed by one research nurse using a structured questionnaire. Ulcers were classified as venous, arterial or mixed depending on the clinical assessment and ankle–brachial systolic pressure index. Pain was assessed objectively using two validated instruments for scoring pain: a verbal rating scale and a pain-intensity visual analogue scale. The significance of the observations was tested using either the Mann-Whitney U-test (unpaired observations) or the Wilcoxon signed-rank test (paired observations). A profile of the quality of pain was obtained using the short-form McGill Pain Questionnaire (SF-MPQ). Quality of life was assessed using the COOP Chart System. Patients: We assessed 38 patients with venous ulcers, three patients with mixed arterial/venous ulceration and 10 patients with arterial disease. Main outcome measures: Pain scores on verbal rating scales and visual analogue scales. Results: Venous leg ulcers are painful. Although pain scores are greater in arterial ulcers, most patients with venous ulceration suffer at least moderate pain. Night pain disturbed sleep in 73% of all patients and pain affected mood in more than 50%. Dressing changes exacerbated pain. Conclusions: Pain reduces the quality of life in most patients with leg ulcers. Pain control is an essential consideration in all patients with leg ulcers.


2003 ◽  
Vol 3 ◽  
pp. 972-991 ◽  
Author(s):  
Soren Ventegodt ◽  
Joav Merrick ◽  
Niels Jorgen Andersen

The Danish Quality of Life Survey is based on the philosophy of life known as the integrative quality-of-life (IQOL) theory. It consists of eight different quality-of-life concepts, ranging from the superficially subjective via the deeply existential to the superficially objective (well being, satisfaction with life, happiness, meaning in life, biological order, realizing life potential, fulfillment of needs, and objective factors [ability of functioning and fulfilling societal norms]).This paper presents the work underlying the formulation of the theories of a good life and how these theories came to be expressed in a comprehensive, multidimensional, generic questionnaire for the evaluation of the global quality of life � SEQOL (self-evaluation of quality of life) � presented in full length in this paper. The instruments and theories on which the Quality of Life Survey was based are constantly being updated. It is an on-going process due to aspects such as human development, language, and culture. We arrived at eight rating scales for the quality of life that, guided by the IQOL theory, were combined into a global and generic quality-of-life rating scale. This was simplified to the validated QOL5 with only five questions, made for use in clinical databases. Unfortunately, the depth of human existence is to some extent lost in QOL5.We continue to aim towards greater simplicity, precision, and depth in the questions in order to explore the depths of human existence. We have not yet found a final form that enables us to fully rate the quality of life in practice. We hope that the several hundred questions we found necessary to adequately implement the theories of the Quality of Life Survey can be replaced by far fewer; ideally, only eight questions representing the eight component theories. These eight ideal questions have not yet been evaluated, and therefore they should not form the basis of a survey. However, the perspective is clear. If eight simple questions can accurately rate the quality of life as well as its depth, we have found an instrument of immense practical scope.


2020 ◽  
Vol 73 (7) ◽  
pp. 1350-1354
Author(s):  
Igor V. Yaishen ◽  
Karina Y. Andrienko ◽  
Irina O. Pereshivaylova ◽  
Leah G. Salia ◽  
Elena O. Berezhna

The aim: was the evaluation the patient’s quality of life with muscular and joint dysfunction of TMJ with using a modified profile questionnaire at various stages of orthopedic treatment. The study was conducted at the Department of Orthopedic Dentistry on the base of University Dental Center in Kharkiv National Medical University. Materials and methods: We conducted a clinical examination and subjective analysis of 125 patients aged 20 to 60 years (mean age 38.5 ± 3), and 80 of them with a reliable diagnosis of dysfunction of TMJ and a control group of 45 patients of the same age without pathology of TMJ. Our profile questionnaire is intended for filling by the respondent (patient) at the three control stages of orthopedic treatment under the supervision of an orthopedic dentist (before the start of treatment, 1.5 months after the beginning of treatment and 3 months). The data obtained were subjected to a scaling process, converted into percentages to facilitate statistical analysis. Results: The worst values before and after treatment were found in the 3rd and 4th age subgroups (30.5 ± 0.60 and 42.0 ± 0.7 points, respectively), with a mean of 10 and 13%, respectively, according to the proposed rating scale. In this case, the indicators have changed 1.3 times in the direction of increase. The highest level of QL was observed in patients of the 2nd (98.7 ± 0.8 points) and the 1st subgroups (102.3 ± 0.4 points), the average value for the three stages of treatment was 78% and 92% rating scales. Before of orthopedic treatment, the values were approximately the same. Conclusions: The using of profile questionnaire of quality of life in patients with muscular and joint dysfunction of the TMJ is appropriate. The questionnaire can be used to evaluate the dynamics of orthopedic treatment of this complex pathology, and it can also be used as a prognostic criterion for the end of the disease. KEY WORDS: temporomandibular joint, muscular and joint dysfunction, analysis, quality of life, orthopedic treatment, modified profile questionnaire


1995 ◽  
Vol 24 (4) ◽  
pp. 451-460 ◽  
Author(s):  
Douglas E. Pine

Despite the widespread use of task inventories in job analysis, little is known about the validity of the obtained task ratings. One approach for examining the validity of such ratings is the use of a “false reporting” index to identify invalid responding. The purpose of this field experiment was to examine the effects of the type of frequency rating scale and method of task inventory administration on the degree of false reporting in task inventory ratings. A total of 177 Correctional Officers from a state correctional system responded to a 68 item task inventory using frequency and importance rating scales. Five of the items in the task inventory were bogus tasks not performed by the target job and formed a false reporting index. In a 2 × 2 design, the type of frequency rating scale (Relative-Time-Spent vs. Actual-Time-Spent) and method of task inventory administration (anonymous vs. identified) were manipulated. Analysis of variance results showed a significantly greater degree of false reporting in Relative-Time-Spent ratings. No significant differences in false reporting were found for method of task inventory administration or scale × method interactions. Overall, 45% of respondents indicated that they performed tasks that were not part of the job, which raises concerns about whether job incumbents are capable of providing accurate and complete task rating data.


Sign in / Sign up

Export Citation Format

Share Document