scholarly journals Establishing the Reliability and Validity of Web-based Singing Research

2021 ◽  
Vol 38 (4) ◽  
pp. 386-405
Author(s):  
Yi Ting Tan ◽  
Isabelle Peretz ◽  
Gary E. McPherson ◽  
Sarah J. Wilson

In this study, the robustness of an online tool for objectively assessing singing ability was examined by: (1) determining the internal consistency and test-retest reliability of the tool; (2) comparing the task performance of web-based participants (n = 285) with a group (n = 52) completing the tool in a controlled laboratory setting, and then determining the convergent validity between settings, and (3) comparing participants’ task performance with previous research using similar singing tasks and populations. Results indicated that the online singing tool exhibited high internal consistency (Cronbach’s alpha = .92), and moderate-to-high test-retest reliabilities (.65–.80) across an average 4.5-year-span. Task performance for web- and laboratory-based participants (n = 82) matched on age, sex, and music training were not significantly different. Moderate-to-large correlations (|r| =.31–.59) were found between self-rated singing ability and the various singing tasks, supporting convergent validity. Finally, task performance of the web-based sample was not significantly different to previously reported findings. Overall the findings support the robustness of the online tool for objectively measuring singing pitch accuracy beyond a controlled laboratory environment and its potential application in large-scale investigations of singing and music ability.

2021 ◽  
Author(s):  
Qi Zhang ◽  
Ke Zhang ◽  
Miao Li ◽  
Jiaxin Gu ◽  
Xintong Li ◽  
...  

Abstract Objectives To examine the validity and reliability of the Mandarin version of the Treatment Burden Questionnaire (TBQ) among stroke patients. Background Stroke patients need long-term management of symptoms and life situation, and treatment burden has recently emerged as a new concept that can influence the health outcomes during the rehabilitation process. Methods The convenience sampling method was used to recruit 187 cases of stroke patients in a tertiary grade hospital in Tianjin for a formal investigation. Item analysis, reliability and validity tests were carried out. The reliability test included internal consistency and test–retest reliability. And as well as content, structure and convergent validity were performed for the validity test. Results Of the 187 completed questionnaires, only 180 (96.3%) were suitable for analysis. According to the experts’ evaluation, the I-CVI of each item was from 0.833 to 1.000, and the S-CVI was 0.967. The exploratory factor analysis yielded three-factor components with a cumulative variation of 53.054%. Convergent validity was demonstrated using measures of Morisky’s Medication Adherence Scale 8 (r = –0.450, P < 0.01). All correlations between items and global scores ranged from 0.403 to 0.638. Internal consistency reliability and test–retest reliability were found to be acceptable, as indicated by a Cronbach’s α of 0.824 and an intraclass correlation coefficient of 0.846, respectively. Conclusions The Mandarin TBQ had acceptable validity and reliability. The use of TBQ in the assessment of treatment burden of stroke survivor may benefit health resources allocation and provide tailor therapeutic interventions to construct minimally disruptive care.


2010 ◽  
Vol 106 (1) ◽  
pp. 279-296 ◽  
Author(s):  
Isabela S. Fontenelle ◽  
Bernard P. Rangé ◽  
Angélica M. Prazeres ◽  
Manuela C. Borges ◽  
Marcio Versiani ◽  
...  

Pathological hoarding results in clutter that precludes normal activities and creates distress or dysfunction. It may lead to an inability to complete household functions, health problems, social withdrawal, and even death. The aim of this study was to describe the validation of the Brazilian version of the hoarding assessment instrument, the Saving Inventory–Revised. Sixty-five patients with obsessive-compulsive disorder (OCD) and 70 individuals from the community were assessed using the Structured Clinical Interview for the Diagnosis of DSM–IV (clinical sample), the Saving Inventory–Revised, the Obsessive-Compulsive Inventory–Revised, the Beck Depression Inventory, and the Beck Anxiety Inventory. The Brazilian version of the Saving Inventory–Revised exhibited high internal consistency (Cronbach's alpha = .94 for OCD and .84 for controls), high to moderate test-retest reliability and, using the hoarding dimension of the Obsessive-Compulsive Inventory–Revised as a reference point, high to moderate convergent validity. The Saving Inventory–Revised total scores also correlated significantly with comorbid anxiety and depressive symptoms.


2013 ◽  
Vol 2013 ◽  
pp. 1-10 ◽  
Author(s):  
Misuk Lee ◽  
Na Young Bae ◽  
Minwoo Hwang ◽  
Han Chae

Objective. This study was conducted for development and validation of the Sasang Digestive Function Inventory (SDFI) with type-specific digestive function-related symptoms for identification of Sasang type and pathological pattern.Methods and Materials. We selected questionnaire items for pathophysiological symptoms using internal consistency analysis and examined construct validity using 193 healthy participants. Test-retest reliability with a four-week interval as well as convergent validity was examined using the Nepean Dyspepsia Index-Korean (NDIK), Functional Dyspepsia-Related Quality of Life (FDQOL), Dutch Eating Behavior Questionnaire (DEBQ), and Body Mass Index (BMI).Results. The 21-item SDFI showed satisfactory internal consistency (Cronbach’s alpha = 0.743) and test-retest reliability (r=0.886,P<0.001). Three extracted subscales, SDFI-Digestion, SDFI-Appetite, and SDFI-Eating pattern, explained 56.02% of the total variance. The SDFI showed significant (P<0.001) correlation with total symptom score of NDIK, FDRQOL-Eating status, DEBQ-External Eating scale, and BMI. The SDFI score of the Tae-Eum (50.62±8.05) type was significantly (P<0.001) larger than that of the So-Eum (43.11±11.26) type.Conclusion. Current results demonstrated the reliability and validity of the SDFI and its subscales, which can be utilized as an objective instrument for diagnosis of Sasang types and assessment of the type-specific digestive function.


PLoS ONE ◽  
2021 ◽  
Vol 16 (5) ◽  
pp. e0250922
Author(s):  
Klara Malinakova ◽  
Richard Korinek ◽  
Peter Tavel ◽  
Iva Polackova Solcova ◽  
Harold G. Koenig ◽  
...  

Background Measuring implicit attitudes is difficult due to social desirability (SD). A new method, the Emotion Based Approach (EBA), can solve this by using emotions from a display of faces as response categories. We applied this on an EBA Spirituality tool (EBA-SPT) and an Actual Situation tool (EBA-AST). Our aim was to assess the structure, reliability and validity of the tools and to compare two EBA assessment approaches, i.e., an explicit one (only assessing final replies to items) and an implicit one (assessing also the selection process). Methods We obtained data on a sample of Czech adults (n = 522, age 30.3±12.58; 27.0% men) via an online survey; cortisol was assessed in 46 participants. We assessed the structure and psychometric properties (internal consistency and test-retest reliability; convergent, discriminant, and criterion validity) of the EBA, and examined the differences between explicit vs. implicit EBA approaches. Results We found an acceptable-good internal consistency reliability of the EBA tools, acceptable discriminant validity between them and low (neutral expression) to good (joy) test-retest reliability for concrete emotions assessed by the tools. An implicit EBA approach showed stronger correlations between emotions and weaker convergent validity, but higher criterion validity, than an explicit approach and standard questionnaires. Conclusion Compared to standard questionnaires, EBA is a more reliable approach for measuring attitudes, with an implicit approach that reflects the selection process yielding the best results.


2020 ◽  
Vol 103 (11) ◽  
pp. 1194-1199

Objective: To develop and validate a Thai version of the Wisconsin Quality of Life (TH WISQoL) Questionnaire. Materials and Methods: The authors developed the TH WISQoL Questionnaire based on a standard multi-step process. Subsequently, the authors recruited patients with kidney stone and requested them to complete the TH WISQoL and a validated Thai version of the 36-Item Short Form Survey (TH SF-36). The authors calculated the internal consistency and interdomain correlation of TH WISQoL and compared the convergent validity between the two instruments. Results: Thirty kidney stone patients completed the TH WISQoL and the TH SF-36. The TH WISQoL showed acceptable internal consistency for all domains (Cronbach’s alpha 0.768 to 0.909). Interdomain correlation was high for most domains (r=0.698 to 0.779), except for the correlation between Vitality and Disease domains, which showed a moderate correlation (r=0.575). For convergent validity, TH WISQoL demonstrated a good overall correlation to TH SF-36, (r=0.796, p<0.05). Conclusion: The TH WISQoL is valid and reliable for evaluating the quality of life of Thai patients with kidney stone. A further large-scale multi-center study is warranted to confirm its applicability in Thailand. Keywords: Quality of life, Kidney stone, Validation, Outcome measurement


2021 ◽  
Vol 22 (1) ◽  
Author(s):  
Amin Kordi Yoosefinejad ◽  
Fatemeh Karjalian ◽  
Marzieh Momennasab ◽  
Shahrokh Ezzatzadegan Jahromi

Abstract Background Hemodialysis is considered a major therapeutic method for patients with chronic kidney disease. Pruritus is a common complaint of hemodialysis patients. The 5-D pruritus scale is amongst the most common tools to evaluate several dimensions of itch. Psychometric properties of the 5-D scale have not been evaluated in Persian speaking population with hemodialysis; hence, the objective of this study was to assess reliability and validity of the Persian version of the scale. Methods Ninety hemodialysis patients (men: 50, women: 40, mean age: 54.4 years) participated in this cross-sectional study. The final Persian version of 5-D scale was given to the participants. Tests Compared: One-third of the participants completed the scale twice within 3–7 days apart to evaluate test- retest reliability. Other psychometric properties including internal consistency, absolute reliability, convergent, discriminative and construct validity, floor/ceiling effects were also evaluated. Results The Persian 5-D scale has strong test-retest reliability (ICC= 0.98) and internal consistency (Cronbach’s alpha= 0.99). Standard error of measurement and minimal detectable change were 0.33 and 0.91, respectively. Regarding convergent validity, the scale had moderate correlation with numeric rating scale (r =0.67) and quality of life questionnaire related to itch (r = 0.59). Exploratory factor analysis revealed two factors within the scale. No floor or ceiling effect was found for the scale. Conclusion The Persian version of 5-D the itching scale is a brief instrument with acceptable reliability and validity. Therefore, the scale could be used by experts, nurses, and other health service providers to evaluate pruritus among Persian speaking hemodialysis patients.


BMJ Open ◽  
2019 ◽  
Vol 9 (11) ◽  
pp. e033940 ◽  
Author(s):  
Akie Midorikawa-Inomata ◽  
Takenori Inomata ◽  
Shuko Nojiri ◽  
Masahiro Nakamura ◽  
Masao Iwagami ◽  
...  

ObjectivesThe Ocular Surface Disease Index (OSDI) questionnaire is widely used to evaluate subjective symptoms of dry eye disease (DED) as a primary diagnostic criterion. This study aimed to develop a Japanese version of the OSDI (J-OSDI) and assess its reliability and validity.Design and settingHospital-based cross-sectional observational study.ParticipantsA total of 209 patients recruited from the Department of Ophthalmology at Juntendo University Hospital.MethodsWe translated and culturally adapted the OSDI into Japanese. The J-OSDI was then assessed for internal consistency, reliability and validity. We also evaluated the optimal cut-off value to suspect DED using an area under the receiver operating characteristic curve (AUC) analysis.Primary outcome measuresInternal consistency, test–retest reliability and discriminant validity of the J-OSDI as well as the optimal cut-off value to suspect DED.ResultsOf the participants, 152 had DED and 57 did not. The J-OSDI total score showed good internal consistency (Cronbach's alpha=0.884), test–retest reliability (interclass correlation coefficient=0.910) and discriminant validity by known-group comparisons (non-DED, 19.4±16.0; DED, 37.7±22.2; p<0.001). Factor validity was used to confirm three subscales within the J-OSDI according to the original version of the questionnaire. Concurrent validity was assessed by Pearson correlation analysis, and the J-OSDI total score showed a strong positive correlation with the Dry Eye-Related Quality-of-Life Score (γ=0.829). The optimal cut-off value of the J-OSDI total score was 36.3 (AUC=0.744).ConclusionsThe J-OSDI was developed and validated in terms of reliability and validity as an effective tool for DED assessment and monitoring in the Japanese population.


2018 ◽  
Vol 23 (6) ◽  
pp. 246-252
Author(s):  
Saurabh Sharma ◽  
M. Ejaz Hussain

Patient-related outcome measures are often used for assessing and determining management efficacy of shoulder impingement syndrome (SIS) in overhead athletes. This study was undertaken to examine the psychometric properties (structural validity, convergent validity, internal consistency, test-retest reliability, and minimal detectable change) and perform partial confirmatory factor analysis (PCFA) of the Hindi SPADI. Eighty male athletes with a mean age of 21.5 ± 2.20 years were enrolled in the study. Hindi SPADI test-retest reproducibility was calculated by intraclass correlation coefficient (ICC2,1), and Cronbach alpha helped determine internal consistency of the index. Pearson correlation coefficient compared the Hindi SPADI with the Hindi DASH scale to determine convergent validity, while the measurement error was calculated by minimal detectable change (MDC95). Exploratory factor analysis utilized for assessing the structural validity of the index gave a five-factor solution, which explained 70.03% of the variances. The test-retest reliability (ICC2,1), internal consistency, and convergent validity were found to be high, at 0.87, 0.75, and 0.94, respectively. The MDC95was calculated to be 14.20. Additionally, the PCFA confirmed the five-factor solution with fit indices. This Hindi version of SPADI demonstrated satisfactory psychometric properties in overhead athletes with shoulder impingement syndrome.


2014 ◽  
Vol 2 (12_suppl4) ◽  
pp. 2325967114S0023
Author(s):  
Francisco Arcuri ◽  
Fernando Barclay ◽  
Ivan Nacul

Background: The validation of widely used scales facilitates the comparison across international patient samples. Objective: The objective was to translate, culturally adapt and validate the Simple Shoulder Test into Argentinian Spanish. Methods: The Simple Shoulder Test was translated from English into Argentinian Spanish by two independent translators, translated back into English and evaluated for accuracy by an expert committee to correct the possible discrepancies. It was then administered to 50 patients with different shoulder conditions.Psycometric properties were analyzed including internal consistency, measured with Cronbach´s Alpha, test-retest reliability at 15 days with the interclass correlation coefficient. Results: The internal consistency, validation, was an Alpha of 0,808, evaluated as good. The test-retest reliability index as measured by intra-class correlation coefficient (ICC) was 0.835, evaluated as excellent. Conclusion: The Simple Shoulder Test translation and it´s cultural adaptation to Argentinian-Spanish demonstrated adequate internal reliability and validity, ultimately allowing for its use in the comparison with international patient samples.


2019 ◽  
Vol 16 (1) ◽  
Author(s):  
Saman Maroufizadeh ◽  
Reza Omani-Samani ◽  
Amir Almasi-Hashiani ◽  
Payam Amini ◽  
Mahdi Sepidarkish

Abstract Background Depression in patients with infertility often goes undiagnosed and untreated. The Patient Health Questionnaire-9 (PHQ-9) and its ultra-brief version (i.e. PHQ-2) are widely used measures of depressive symptoms. These scales have not been validated in patients with infertility. The aim of the present study was to examine the reliability and validity of the PHQ-9 and PHQ-2 in patients with infertility. Methods In this cross-sectional study, a total of 539 patients with infertility from a referral infertility clinic in Tehran, Iran completed the PHQ-9, along with other relevant scales: the WHO-five Well-being Index (WHO-5), the Hospital Anxiety and Depression Scale (HADS), and the Generalized Anxiety Disorder-7 (GAD-7). Factor structure and internal consistency of PHQ-9 were examined via confirmatory factor analysis (CFA) and Cronbach’s alpha, respectively. Convergent validity was evaluated by relationship with WHO-5, HADS and GAD-7. Results The mean total PHQ-9 and PHQ-2 scores were 8.47 ± 6.17 and 2.42 ± 1.86, respectively, and using a cut-off value of 10 (for PHQ-9) and 3 (for PHQ-2), the prevalence of depressive symptoms was 38.6 and 43.6%, respectively. The Cronbach’s alphas for PHQ-9 and PHQ-2 were, respectively, 0.851 and 0.767, indicating good internal consistency. The CFA results confirmed the one-factor model of the PHQ-9 (χ2/df = 4.29; CFI = 0.98; RMSEA = 0.078 and SRMR = 0.044). Both PHQ-9 and PHQ-2 showed moderate to strong correlation with the measures of WHO-5, HADS-depression, HADS-anxiety, and the GAD-7, confirming convergent validity. In univariate analysis, female sex, long infertility duration, and unsuccessful treatment were significantly associated with depression symptoms. Conclusion Both PHQ-9 and PHQ-2 are brief and easy to use measures of depressive symptoms with good psychometric properties that appear suitable for routine use in patients with infertility.


Sign in / Sign up

Export Citation Format

Share Document