scholarly journals Reliability Measure of a Clinical Test: Appreciation of Music in Cochlear Implantees (AMICI)

2013 ◽  
Vol 24 (10) ◽  
pp. 969-979 ◽  
Author(s):  
Min-Yu Cheng ◽  
Jaclyn B. Spitzer ◽  
Valeriy Shafiro ◽  
Stanley Sheft ◽  
Dean Mancuso

Purpose: The goals of this study were (1) to investigate the reliability of a clinical music perception test, Appreciation of Music in Cochlear Implantees (AMICI), and (2) examine associations between the perception of music and speech. AMICI was developed as a clinical instrument for assessing music perception in persons with cochlear implants (CIs). The test consists of four subtests: (1) music versus environmental noise discrimination, (2) musical instrument identification (closed-set), (3) musical style identification (closed-set), and (4) identification of musical pieces (open-set). To be clinically useful, it is crucial for AMICI to demonstrate high test-retest reliability, so that CI users can be assessed and retested after changes in maps or programming strategies. Research Design: Thirteen CI subjects were tested with AMICI for the initial visit and retested again 10–14 days later. Two speech perception tests (consonant-nucleus-consonant [CNC] and Bamford-Kowal-Bench Speech-in-Noise [BKB-SIN]) were also administered. Data Analysis: Test-retest reliability and equivalence of the test's three forms were analyzed using paired t-tests and correlation coefficients, respectively. Correlation analysis was also conducted between results from the music and speech perception tests. Results: Results showed no significant difference between test and retest (p > 0.05) with adequate power (0.9) as well as high correlations between the three forms (Forms A and B, r = 0.91; Forms A and C, r = 0.91; Forms B and C, r = 0.95). Correlation analysis showed high correlation between AMICI and BKB-SIN (r = −0.71), and moderate correlation between AMICI and CNC (r = 0.4). Conclusions: The study showed AMICI is highly reliable for assessing musical perception in CI users.

2021 ◽  
Vol 11 (2) ◽  
pp. 150-166
Author(s):  
Hanin Rayes ◽  
Ghada Al-Malky ◽  
Deborah Vickers

Objective: The aim of this project was to develop the Arabic CAPT (A-CAPT), a Standard Arabic version of the CHEAR auditory perception test (CAPT) that assesses consonant perception ability in children. Method: This closed-set test was evaluated with normal-hearing children aged 5 to 11 years. Development and validation of the speech materials were accomplished in two experimental phases. Twenty-six children participated in phase I, where the test materials were piloted to ensure that the selected words were age appropriate and that the form of Arabic used was familiar to the children. Sixteen children participated in phase II where test–retest reliability, age effects, and critical differences were measured. A computerized implementation was used to present stimuli and collect responses. Children selected one of four response options displayed on a screen for each trial. Results: Two lists of 32 words were developed with two levels of difficulty, easy and hard. Assessment of test–retest reliability for the final version of the lists showed a strong agreement. A within-subject ANOVA showed no significant difference between test and retest sessions. Performance improved with increasing age. Critical difference values were similar to the British English version of the CAPT. Conclusions: The A-CAPT is an appropriate speech perception test for assessing Arabic-speaking children as young as 5 years old. This test can reliably assess consonant perception ability and monitor changes over time or after an intervention.


2019 ◽  
Vol 11 (3) ◽  
pp. 158-164
Author(s):  
Aparna Nandurkar ◽  
Yaashna Rajani

Introduction: Clinical assessment of speech perception skills is very important for several reasons. However, it is routinely assessed in older children and adults but not in very young children mainly due to lack of appropriate tools, especially in Indian languages. Considering the limitations of closed-set and open-set tests for young children modified open set test would be appropriate. Aim: To develop a modified open set sentence test in Hindi based on the Mr. Potato Head Test framework using appropriate toy and sentence material and employ the developed test to assess children with normal hearing in the age range of 18 to 48 months. Method: Two sentence lists with ten sentences each and one practice list with five sentences were developed. The test was recorded in a professional studio by a sound engineer and sentences were calibrated using the Bruel & Kjaer-Type-2250 sound level meter (SLM) so that the test could be administered via speakers using a laptop. The test was administered in a quiet room, directly through a laptop connected to speakers on 200 Hindi speaking children with normal motor and speech developmental milestones and bilateral pass result on OAE screening. Results and discussion: There was a significant difference in the scores between the 5 age groups of children with normal hearing. There was an increase in scores as age increased, thus indicating improved performance with increasing age. There was also no significant difference in the performance on List 1 and List 2 for all age groups indicating that the two lists were equivalent. Item reliability was also observed to be high. Conclusion: The developed Modified Open Set Sentence Test can be successfully used to assess speech perception skills in young children with normal hearing. This test has a potential to be a useful clinical tool when used as a part of a test battery and also play a role in monitoring the progress of an intervention program.


Author(s):  
Thomas Finkenzeller ◽  
Björn Krenn ◽  
Sabine Würth ◽  
Günter Amesberger

AbstractThe design fluency test (DFT) has been reported to predict successful sports performance of soccer players and has therefore been in the spotlight of sport psychology research. There is, however, a lack of research regarding the psychometric properties of the DFT in elite sports. Thus, the aim of this research was to provide findings of test–retest reliability, practice effects and the diagnostic power of the DFT. Multiple studies of youth and adult elite athletes, as well as nonathlete students, were conducted in applied settings. Test–retest relationship demonstrated poor to acceptable short-term and long-term correlations. Furthermore, significant changes between test and retest were obtained in some variables that differed among samples. The differential value of the DFT was corroborated by significant differences between adolescent students and adolescent elite soccer players. Regarding the prospective value, significant partial correlation coefficients were found between DFT scores and volleyball performance in adult elite players. Although our research partially confirmed previous findings on the differential and prospective power of the DFT, the findings on test–retest reliability indicate that the DFT cannot be recommended for application in sports. The psychometric properties—in particular the findings on test–retest reliability—of the DFT have to be improved before research can be carried out on the application for the selection of team sport athletes and for the prediction of future success in team sports. Further research is needed to develop a scientific instrument for the assessment of game intelligence.


2021 ◽  
pp. 1-8
Author(s):  
Yasemin Eskigülek ◽  
Sultan Kav

Abstract Objective The aim of this study was to investigate the validity and reliability of the Patient Dignity Inventory (PDI) in the Turkish society, which was developed to evaluate dignity-related distress in palliative care patients. Methods One hundred and twenty-seven adults with advanced cancer hospitalized in several clinics of two university hospitals were included in the study. The patients whose Palliative Performance Scale score was at least 40% were recruited to study. The data were collected with a patient demographic form, the Turkish version of Hospital Anxiety and Depression Scale (HADS-TR), and the Turkish version of the PDI (PDI-TR). The PDI-TR was finalized and back-translated after translating into Turkish and obtaining 10 expert opinions. Exploratory and confirmatory factor analysis, internal consistency, concurrent validity, and test–retest reliability analysis were performed. Results The Cronbach's α coefficient of PDI-TR was 0.94. Factor analysis resulted in a five-factor solution, and all items were loaded on factors. Factors were labeled as symptom distress, existential distress, self-confidence, dependency, and supportive care needs and accounted for 68.70% of the overall variance. The model's normed fit index, comparative fit index, and X2/SD were found between acceptable range (0.90, 0.93, and 2.64, respectively). A positive and strong correlation was found between subdimension scores of HADS-TR and the total score of PDI-TR (r = 0.70 for anxiety subdimension; r = 0.73 for depression subdimension). The test–retest reliability was conducted with 32 patients within the sample two weeks after the first application, and no significant difference was found between the two application scores as the result of paired-sample t-test (p > 0.05). An intraclass correlation coefficient of test–retest reliability was r = 0.855. Significance of results PDI-TR was found to be a valid and reliable tool in palliative care patients in Turkish society.


1997 ◽  
Vol 64 (5) ◽  
pp. 270-276 ◽  
Author(s):  
Johanne Desrosiers ◽  
Annie Rochette ◽  
Réjean Hébert ◽  
Gina Bravo

Several dexterity tests have been developed, including the Minnesota Rate of Manipulation Test (MRMT) and a new version, the Minnesota Manual Dexterity Test (MMDT). The objectives of the study were: a) to verify the test-retest reliability of the MMDT; b) to compare the MRMT and the MMDT; c) to study the concurrent validity of the MMDT; and d) to establish reference values for elderly people with the MMDT. Two hundred and forty-seven community-living healthy elderly were evaluated with the MMDT, and two other dexterity tests, the Box and Block Test (BBT) and the Purdue Pegboard (PP). Thirty-five of them were evaluated twice with the MMDT and 44 were evaluated with both the MMDT and MRMT. The results show that the test-retest reliability of the MMDT is acceptable to high (intraclass correlation coefficients of 0.79 to 0.87, depending on the subtest) and the validity of the test is demonstrated by significant correlations between the MMDT, the BBT and the PP (0.63 to 0.67). There is a high correlation (0.85 to 0.95) between the MMDT and the MMRT in spite of different results. The reference values will help occupational therapists to differentiate better between real dexterity difficulties and those that may be attributed to normal aging.


2008 ◽  
Vol 22 (6) ◽  
pp. 737-744 ◽  
Author(s):  
I-Ping Hsueh ◽  
Miao-Ju Hsu ◽  
Ching-Fan Sheu ◽  
Su Lee ◽  
Ching-Lin Hsieh ◽  
...  

Objective. To provide empirical justification for selecting motor scales for stroke patients, the authors compared the psychometric properties (validity, responsiveness, test-retest reliability, and smallest real difference [SRD]) of the Fugl-Meyer Motor Scale (FM), the simplified FM (S-FM), the Stroke Rehabilitation Assessment of Movement instrument (STREAM), and the simplified STREAM (S-STREAM). Methods. For the validity and responsiveness study, 50 inpatients were assessed with the FM and the STREAM at admission and discharge to a rehabilitation department. The scores of the S-FM and the S-STREAM were retrieved from their corresponding scales. For the test-retest reliability study, a therapist administered both scales on a different sample of 60 chronic patients on 2 occasions. Results. Only the S-STREAM had no notable floor or ceiling effects at admission and discharge. The 4 motor scales had good concurrent validity (rho ≥ .91) and satisfactory predictive validity (rho = .72-.77). The scales showed responsiveness (effect size d ≥ 0.34; standardized response mean ≥ 0.95; P < .0001), with the S-STREAM most responsive. The test-retest agreements of the scales were excellent (intraclass correlation coefficients ≥ .96). The SRD of the 4 scales was 10% of their corresponding highest score, indicating acceptable level of measurement error. The upper extremity and the lower extremity subscales of the 4 showed similar results. Conclusions. The 4 motor scales showed acceptable levels of reliability, validity, and responsiveness in stroke patients. The S-STREAM is recommended because it is short, responsive to change, and able to discriminate patients with severe or mild stroke.


2021 ◽  
Vol 12 ◽  
Author(s):  
Wei Xia ◽  
William Ho Cheung Li ◽  
Tingna Liang ◽  
Yuanhui Luo ◽  
Laurie Long Kwan Ho ◽  
...  

Objectives: This study conducted a linguistic and psychometric evaluation of the Chinese Counseling Competencies Scale-Revised (CCS-R).Methods: The Chinese CCS-R was created from the original English version using a standard forward-backward translation process. The psychometric properties of the Chinese CCS-R were examined in a cohort of 208 counselors-in-training by two independent raters. Fifty-three counselors-in-training were asked to undergo another counseling performance evaluation for the test-retest. The confirmatory factor analysis (CFA) was conducted for the Chinese CCS-R, followed by internal consistency, test-retest reliability, inter-rater reliability, convergent validity, and concurrent validity.Results: The results of the CFA supported the factorial validity of the Chinese CCS-R, with adequate construct replicability. The scale had a McDonald's omega of 0.876, and intraclass correlation coefficients of 0.63 and 0.90 for test-retest reliability and inter-rater reliability, respectively. Significantly positive correlations were observed between the Chinese CCS-R score and scores of performance checklist (Pearson's γ = 0.781), indicating a large convergent validity, and knowledge on drug abuse (Pearson's γ = 0.833), indicating a moderate concurrent validity.Conclusion: The results support that the Chinese CCS-R is a valid and reliable measure of the counseling competencies.Practice implication: The CCS-R provides trainers with a reliable tool to evaluate counseling students' competencies and to facilitate discussions with trainees about their areas for growth.


2021 ◽  
Vol 12 ◽  
Author(s):  
Céline Hochstrasser ◽  
Sarah Rieder ◽  
Ursina Jufer-Riedi ◽  
Marie-Noëlle Klein ◽  
Anthony Feinstein ◽  
...  

ObjectiveThe objective of this study was to validate the computerized Symbol Digit Modalities Test (c-SDMT) in a Swiss pediatric cohort, in comparing the Swiss sample to the Canadian norms. Secondly, we evaluated sex effects, age-effects, and test–retest reliability of the c-SDMT in comparison to values obtained for the paper and pencil version of the Symbol Digit Modalities Test (SDMT).MethodsThis longitudinal observational study was conducted in a single-center setting at the University Children’s Hospital of Bern. Our cohort consisted of 86 children (45 male and 41 female) aged from 8 to 16 years. The cohort included both healthy participants (n = 38) and patients (n = 48) hospitalized for a non-neurological disease. Forty eight participants were assessed during two testing sessions with the SDMT and the c-SDMT.ResultsTest–retest reliability was high in both tests (SDMT: ICC = 0.89, c-SDMT: ICC = 0.90). A reliable change index was calculated for the SDMT (RCIp = −3.18, 14.01) and the c-SDMT (RCIp = −5.45, 1.46) corrected for practice effects. While a significant age effect on information processing speed was observed, no such effect was found for sex. When data on the c-SDMT performance of the Swiss cohort was compared with that from a Canadian cohort, no significant difference was found for the mean time per trial in any age group. Norm values for age groups between 8 and 16 years in the Swiss cohort were established.ConclusionNorms for the c-SDMT between the Swiss and the Canadian cohort were comparable. The c-SDMT is a valid alternative to the SDMT. It is a feasible and easy to administer bedside tool due to high reliability and the lack of motor demands.


2020 ◽  
pp. 156918612094453
Author(s):  
Eris CM Ho ◽  
Mona Dür ◽  
Tanja Stamm ◽  
Andrew MH Siu

Background Occupational balance, a fundamental concept in occupational therapy, is the arrangement of right amount and variety of occupations contributes to a person’s health and well-being. This study was aimed to investigate the reliability and validity of the Chinese version of the Occupational Balance Questionnaire (OB-Quest) for people with insomnia. Methods The OB-Quest was translated into traditional Chinese and reviewed by an expert panel for content validity, cultural relevance and translation accuracy. Internal consistency, factor analysis and convergent validity, as well as test–retest reliability, were explored. Results The participants (n = 205), 115 adults with insomnia and 90 adults without insomnia, completed a survey of demographic background, the Chinese version of OB-Quest and the Chinese Insomnia Severity Index (C-ISI). The Chinese version of OB-Quest demonstrated excellent test–retest reliability (ICC= 0.98) and good internal consistency (Cronbach’s α  =  0.80). Factor analysis indicated that a single-factor solution explained 42% of the variance, and 9 out of 10 items had a factor loading of 0.4 or above. The Chinese version of OB-Quest had significant correlations with C-ISI (r = –0.88; p < 0.001). A significant difference was found in occupational balance between groups with different levels of insomnia severity and without insomnia (F = 169.72; p < 0.001). As in a previous study, age, living environment and life role had no significant relationship with occupational balance. Conclusion The Chinese version of OB-Quest is a short, easy to understand and culturally relevant assessment for Chinese. It demonstrates satisfactory psychometric properties and had significant correlations with insomnia.


Sign in / Sign up

Export Citation Format

Share Document