Evaluation of TIMIT Sentence List Equivalency with Adult Cochlear Implant Recipients

Background: Current measures used to determine sentence recognition abilities in cochlear implant recipients often include tests with one talker and one rate of speech. Performance with these measures may not accurately represent the speech recognition abilities of the listeners. Evaluation of cochlear implant performance should include measures that reflect realistic listening conditions. For example, the use of multiple talkers who vary in gender, rate of speech, and regional dialects represent varied communication interactions that people encounter daily. The TIMIT sentences, which use multiple talkers and incorporate these variations, provide additional test material for evaluating speech recognition. Dorman and colleagues created 34 lists of TIMIT sentences that were normalized for equal intelligibility using simulations of cochlear implant processing with normal-hearing listeners. Adults with sensorineural hearing loss who listen with cochlear implants represent a different population. Further study is needed to determine if these lists are equivalent for adult cochlear implant recipients and, if not, to identify a subset of lists that may be used with this population. Purpose: To evaluate the speech recognition equivalence of 34 TIMIT sentence lists with adult cochlear implant recipients. Research Design: A prospective study comparing test-retest results within the same group of listeners. Study Sample: Twenty-two adult cochlear implant recipients who met the inclusion criteria of at least 3 mo device use and a monosyllabic word score of 30% or greater participated in the study. Data Collection and Analysis: Participants were administered 34 TIMIT sentence lists (20 sentences per list) at each of two test sessions several months apart. List order was randomized and results scored as percent of words correct. Test-retest correlations and 95% confidence intervals for the means were used to identify equivalent lists with high test-retest reliability. Results: Mean list scores across participants ranged from 66 to 81% with an overall mean of 73%. Twenty-nine lists had high test-retest reliability. Using the overall mean as a benchmark, the 95% confidence intervals indicated that 25 of the remaining 29 lists were equivalent (e.g., the benchmark of 73% fell within the 95% confidence interval for both test and retest). Conclusions: Twenty-five of the TIMIT lists evaluated are equivalent when used with adult cochlear implant recipients who have open-set word recognition abilities. These lists may prove valuable for monitoring progress, comparing listening conditions or treatments, and developing aural rehabilitation plans for cochlear implant recipients.

Download Full-text

Healthy decisions in the cued-attribute food choice paradigm have high test-retest reliability

Scientific Reports ◽

10.1038/s41598-021-91933-6 ◽

2021 ◽

Vol 11 (1) ◽

Author(s):

Zahra Barakchian ◽

Anjali Raja Beharelle ◽

Todd A. Hare

Keyword(s):

Food Choice ◽

Food Choices ◽

Retest Reliability ◽

Individual Level ◽

Food Items ◽

Intervention Efficacy ◽

The Individual ◽

Test Retest Reliability ◽

Decision Mechanisms ◽

High Test

AbstractFood choice paradigms are commonly used to study decision mechanisms, individual differences, and intervention efficacy. Here, we measured behavior from twenty-three healthy young adults who completed five repetitions of a cued-attribute food choice paradigm over two weeks. This task includes cues prompting participants to explicitly consider the healthiness of the food items before making a selection, or to choose naturally based on whatever freely comes to mind. We found that the average patterns of food choices following both cue types and ratings about the palatability (i.e. taste) and healthiness of the food items were similar across all five repetitions. At the individual level, the test-retest reliability for choices in both conditions and healthiness ratings was excellent. However, test-retest reliability for taste ratings was only fair, suggesting that estimates about palatability may vary more from day to day for the same individual.

Download Full-text

Cardio-ventilatory coupling in young healthy resting subjects

Journal of Applied Physiology ◽

10.1152/japplphysiol.01424.2010 ◽

2012 ◽

Vol 112 (8) ◽

pp. 1248-1257 ◽

Cited By ~ 11

Author(s):

Lee Friedman ◽

Thomas E. Dick ◽

Frank J. Jacono ◽

Kenneth A. Loparo ◽

Amir Yeganeh ◽

...

Keyword(s):

Body Surface ◽

Relative Importance ◽

Statistical Relationship ◽

Sinus Arrhythmia ◽

Retest Reliability ◽

Respiratory Events ◽

Before And After ◽

Test Retest Reliability ◽

Degree Of Coupling ◽

High Test

In this work, cardio-ventilatory coupling (CVC) refers to the statistical relationship between the onset of either inspiration (I) or expiration (E) and the timing of heartbeats (R-waves) before and after these respiratory events. CVC was assessed in healthy, young (<45 yr), resting, supine subjects ( n = 19). Four intervals were analyzed: time from I-onset to both the prior R-wave (R-to-I) and the following R-wave (I-to-R), as well as time from E-onset to both the prior R-wave (R-to-E) and following R-wave (E-to-R). The degree of coupling was quantified in terms of transformed relative Shannon entropy (tRSE), and χ2 tests based on histograms of interval times from 200 breaths. Subjects were studied twice, from 5 to 27 days apart, and the test-retest reliability of CVC measures was computed. Several factors pointed to the relative importance of the R-to-I interval compared with other intervals. Coupling was significantly stronger for the R-to-I interval, coupling reliability was largest for the R-to-I interval, and only tRSE for the R-to-I interval was correlated with height, weight, and body surface area. The high test-retest reliability for CVC in the R-to-I interval provides support for the hypothesis that CVC strength is a subject trait. Across subjects, a peak ∼138 ms prior to I-onset was characteristic of CVC in the R-to-I interval, although individual subjects also had earlier peaks (longer R-to-I intervals). CVC for the R-to-I interval was unrelated to two separate measures of respiratory sinus arrhythmia (RSA), suggesting that these two forms of coupling (CVC and RSA) are independent.

Download Full-text

ShareDisk: A novel visual tool to assess perceptions about who should be responsible for supporting persons with mental health problems

International Journal of Social Psychiatry ◽

10.1177/0020764020913580 ◽

2020 ◽

Vol 66 (4) ◽

pp. 411-418

Author(s):

Srividya N Iyer ◽

Megan A Pope ◽

Gerald Jordan ◽

Greeshma Mohan ◽

Heleen Loohuis ◽

...

Keyword(s):

Mental Health ◽

Psychometric Properties ◽

Clinical Utility ◽

Mental Health Problems ◽

Health Problems ◽

Language And Literacy ◽

Retest Reliability ◽

Visual Tool ◽

Test Retest Reliability ◽

High Test

Objectives: Views on who bears how much responsibility for supporting individuals with mental health problems may vary across stakeholders (patients, families, clinicians) and cultures. Perceptions about responsibility may influence the extent to which stakeholders get involved in treatment. Our objective was to report on the development, psychometric properties and usability of a first-ever tool of this construct. Methods: We created a visual weighting disk called ‘ShareDisk’, measuring perceived extent of responsibility for supporting persons with mental health problems. It was administered (twice, 2 weeks apart) to patients, family members and clinicians in Chennai, India ( N = 30, 30 and 15, respectively) and Montreal, Canada ( N = 30, 32 and 15, respectively). Feedback regarding its usability was also collected. Results: The English, French and Tamil versions of the ShareDisk demonstrated high test–retest reliability ( rs = .69–.98) and were deemed easy to understand and use. Conclusion: The ShareDisk is a promising measure of a hitherto unmeasured construct that is easily deployable in settings varying in language and literacy levels. Its clinical utility lies in clarifying stakeholder roles. It can help researchers investigate how stakeholders’ roles are perceived and how these perceptions may be shaped by and shape the organization and experience of healthcare across settings.

Download Full-text

A Reliability Analysis of the Revised Competitiveness Index

Psychological Reports ◽

10.2466/pr0.106.3.870-874 ◽

2010 ◽

Vol 106 (3) ◽

pp. 870-874 ◽

Cited By ~ 35

Author(s):

Paul B. Harris ◽

John M. Houston

Keyword(s):

Reliability Analysis ◽

Factor Structure ◽

Dynamic State ◽

Retest Reliability ◽

Stable Factor ◽

Competitiveness Index ◽

Test Retest Reliability ◽

High Test

This study examined the reliability of the Revised Competitiveness Index by investigating the test-retest reliability, interitem reliability, and factor structure of the measure based on a sample of 280 undergraduates (200 women, 80 men) ranging in age from 18 to 28 years ( M = 20.1, SD = 2.1). The findings indicate that the Revised Competitiveness Index has high test-retest reliability, high interitem reliability, and a stable factor structure. The results support the assertion that the Revised Competitiveness Index assesses competitiveness as a stable trait rather than a dynamic state.

Download Full-text

High test-retest reliability of a neural index of rapid automatic discrimination of unfamiliar individual faces

Journal of Vision ◽

10.1167/19.10.136c ◽

2019 ◽

Vol 19 (10) ◽

pp. 136c

Author(s):

Milena Dzhelyova ◽

Giulia Dormal ◽

Corentin Jacques ◽

Caroline Michel ◽

Christine Schiltz ◽

...

Keyword(s):

Retest Reliability ◽

Test Retest Reliability ◽

High Test

Download Full-text

Test-Retest Reliability is not a Measure of Reliability or Stability: A Friendly Reminder

10.31234/osf.io/mt49r ◽

2020 ◽

Author(s):

Lukas Röseler ◽

Daniel Wolf ◽

Johannes Leder ◽

Astrid Schütz

Keyword(s):

Confidence Intervals ◽

Simulation Study ◽

Repeated Measurement ◽

Reliability Coefficient ◽

Diagnostic Instrument ◽

Retest Reliability ◽

Cronbach's Alpha ◽

Correction For Attenuation ◽

The Stability ◽

Test Retest Reliability

We argue that the test-retest reliability coefficient, which is the correlation between a measurement and a repeated measurement using the same diagnostic instrument in the same sample (sometimes referred to as repeatability or falsely referred to as stability), is by itself not an appropriate measure of the reliability of the diagnostic instrument or of the stability of the construct in question. In combination with an actual coefficient of reliability such as Cronbach’s alpha, the test-retest reliability coefficient can be used to estimate and compare the stabilities of constructs using a procedure based on the correction for attenuation. However, results from a simulation study showed that classically constructed confidence intervals for the estimator exhibit under-coverage and thus cannot be interpreted correctly.

Download Full-text

Imagery, Concreteness, Emotionality, Meaningfulness, and Pleasantness of Words

Perceptual and Motor Skills ◽

10.2466/pms.1995.80.3.867 ◽

1995 ◽

Vol 80 (3) ◽

pp. 867-880 ◽

Cited By ~ 9

Author(s):

Alfredo Campos

Keyword(s):

Gender Differences ◽

Retest Reliability ◽

Test Retest Reliability ◽

High Test

This account of the literature on the relationships among imagery, concreteness, emotionality, meaningfulness, and pleasantness shows high test-retest reliability for all five attributes which are stable for subjects of both genders and of several nationalities. Gender differences and the influence of attributes on other attributes are also examined.

Download Full-text

Assessing linguistic competence: when are children hard to understand?

Journal of Child Language ◽

10.1017/s0305000900002701 ◽

1980 ◽

Vol 7 (2) ◽

pp. 401-412 ◽

Cited By ~ 2

Author(s):

Veronica Fabian-Kraus ◽

Paul Ammon

Keyword(s):

General Problem ◽

Empirical Relation ◽

Linguistic Competence ◽

Target Structure ◽

Retest Reliability ◽

Test Retest Reliability ◽

High Test

ABSTRACTIt is argued that previous assessments of children's knowledge of the hard to see type of construction were confounded by a variety of extra-linguistic factors. Therefore, the relatively delayed age of comprehension previously reported (6½–8 years) may have been due to younger children's deficiencies in extralinguistic skills. In the present study, with these extralinguistic complications eliminated, the passing age was found to be 5 years, and even 4-year-olds evidenced considerable knowledge of the target structure. Other findings were: variation in sentence difficulty as a function of the syntactic and/or aspectual character of the verb; high test–retest reliability at all levels of performance; and a necessary-but-not-sufficient empirical relation between comprehension of the target construction and the passive. Results are discussed in terms of their implications for the acquisition of this particular structure and for the general problem of detecting linguistic competence from performance.

Download Full-text

Speech Perception Performance in Experienced Cochlear-Implant Patients Receiving the SPEAK Processing Strategy in the Nucleus Spectra-22 Cochlear Implant

Journal of Speech Language and Hearing Research ◽

10.1044/jslhr.4105.1073 ◽

1998 ◽

Vol 41 (5) ◽

pp. 1073-1087 ◽

Cited By ~ 31

Author(s):

Aaron J. Parkinson ◽

Wendy S. Parkinson ◽

Richard S. Tyler ◽

Mary W. Lowder ◽

Bruce J. Gantz

Keyword(s):

Speech Recognition ◽

Speech Perception ◽

Cochlear Implant ◽

Sound Quality ◽

Learning Effects ◽

Processing Strategy ◽

Subjective Ratings ◽

Open Set ◽

Wide Range

Sixteen experienced cochlear implant patients with a wide range of speechperception abilities received the SPEAK processing strategy in the Nucleus Spectra-22 cochlear implant. Speech perception was assessed in quiet and in noise with SPEAK and with the patients' previous strategies (for most, Multipeak) at the study onset, as well as after using SPEAK for 6 months. Comparisons were made within and across the two test sessions to elucidate possible learning effects. Patients were also asked to rate the strategies on seven speech recognition and sound quality scales. After 6 months' experience with SPEAK, patients showed significantly improved mean performance on a range of speech recognition measures in quiet and noise. When mean subjective ratings were compared over time there were no significant differences noted between strategies. However, many individuals rated the SPEAK strategy better for two or more of the seven subjective measures. Ratings for "appreciation of music" and "quality of my own voice" in particular were generally higher for SPEAK. Improvements were realized by patients with a wide range of speech perception abilities, including those with little or no open-set speech recognition.

Download Full-text