A note on interobserver reliability for sequential data

1983 ◽  
Vol 5 (3) ◽  
pp. 217-225 ◽  
Author(s):  
Bruce E. Wampold ◽  
Elizabeth L. Holloway
Keyword(s):  
Interobserver Reliability ◽  
Sequential Data

Interobserver Reliability Using the Phonetic Level Evaluation With Severely and Profoundly Hearing-Impaired Children

1991 ◽  
Vol 34 (5) ◽  
pp. 989-999 ◽  
Author(s):  
Stephanie Shaw ◽  
Truman E. Coggins
Keyword(s):  
Interrater Reliability ◽  
Interobserver Reliability ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Hearing Impaired ◽  
Intraclass Correlation Coefficients ◽  
Assessment Measure ◽  
Impaired Children ◽  
Speech Assessment ◽  
Hearing Impaired Children

This study examines whether observers reliably categorize selected speech production behaviors in hearing-impaired children. A group of experienced speech-language pathologists was trained to score the elicited imitations of 5 profoundly and 5 severely hearing-impaired subjects using the Phonetic Level Evaluation (Ling, 1976). Interrater reliability was calculated using intraclass correlation coefficients. Overall, the magnitude of the coefficients was found to be considerably below what would be accepted in published behavioral research. Failure to obtain acceptably high levels of reliability suggests that the Phonetic Level Evaluation may not yet be an accurate and objective speech assessment measure for hearing-impaired children.

Reliability of the Conversational Interaction Coding Form When Applied to Natural Conversation of Individuals With Aphasia

2010 ◽  
Vol 20 (4) ◽  
pp. 125-135 ◽  
Author(s):  
Ashley Pozzolo Coote ◽  
Jane Pimentel
Keyword(s):  
Best Practice ◽  
Interobserver Reliability ◽  
Training Session ◽  
Clinical Tool ◽  
Group Setting ◽  
Conversational Interaction ◽  
Video Recordings ◽  
Aphasia Therapy ◽  
Natural Conversation ◽  
Point To Point

Purpose: Development of valid and reliable outcome tools to document social approaches to aphasia therapy and to determine best practice is imperative. The aim of this study is to determine whether the Conversational Interaction Coding Form (CICF; Pimentel & Algeo, 2009) can be applied reliably to the natural conversation of individuals with aphasia in a group setting. Method: Eleven graduate students participated in this study. During a 90-minute training session, participants reviewed and practiced coding with the CICF. Then participants independently completed the CICF using video recordings of individuals with non-fluent and fluent aphasia participating in an aphasia group. Interobserver reliability was computed using matrices representative of the point-to-point agreement or disagreement between each participant's coding and the authors' coding for each measure. Interobserver reliability was defined as 80% or better agreement for each measure. Results: On the whole, the CICF was not applied reliably to the natural conversation of individuals with aphasia in a group setting. Conclusion: In an extensive review of the turns that had high disagreement across participants, the poor reliability was attributed to inadequate rules and definitions and inexperienced coders. Further research is needed to improve the reliability of this potentially useful clinical tool.

Classification of Acceleration Waveforms during Walking by Wavelet Transform

1997 ◽  
Vol 36 (04/05) ◽  
pp. 356-359 ◽  
Author(s):  
M. Sekine ◽  
M. Ogawa ◽  
T. Togawa ◽  
Y. Fukui ◽  
T. Tamura
Keyword(s):  
Wavelet Transform ◽  
Wavelet Analysis ◽  
Center Of Gravity ◽  
Dynamic Responses ◽  
Sequential Data ◽  
Acceleration Signal ◽  
Continuous Dynamic

Abstract:In this study we have attempted to classify the acceleration signal, while walking both at horizontal level, and upstairs and downstairs, using wavelet analysis. The acceleration signal close to the body’s center of gravity was measured while the subjects walked in a corridor and up and down a stairway. The data for four steps were analyzed and the Daubecies 3 wavelet transform was applied to the sequential data. The variables to be discriminated were the waveforms related to levels -4 and -5. The sum of the square values at each step was compared at levels -4 and -5. Downstairs walking could be discriminated from other types of walking, showing the largest value for level -5. Walking at horizontal level was compared with upstairs walking for level -4. It was possible to discriminate the continuous dynamic responses to walking by the wavelet transform.

Machine Learning Based Predictive Action on Categorical Non-Sequential Data

2020 ◽  
Vol 13 (5) ◽  
pp. 1020-1030
Author(s):  
Pradeep S. ◽  
Jagadish S. Kallimani
Keyword(s):  
Machine Learning ◽  
Data Analysis ◽  
Categorical Data ◽  
Numerical Data ◽  
Processing Technique ◽  
Machine Learning Algorithms ◽  
Sequential Data ◽  
Industry Standard ◽  
Robust Model ◽  
Future Work

Background: With the advent of data analysis and machine learning, there is a growing impetus of analyzing and generating models on historic data. The data comes in numerous forms and shapes with an abundance of challenges. The most sorted form of data for analysis is the numerical data. With the plethora of algorithms and tools it is quite manageable to deal with such data. Another form of data is of categorical nature, which is subdivided into, ordinal (order wise) and nominal (number wise). This data can be broadly classified as Sequential and Non-Sequential. Sequential data analysis is easier to preprocess using algorithms. Objective: The challenge of applying machine learning algorithms on categorical data of nonsequential nature is dealt in this paper. Methods: Upon implementing several data analysis algorithms on such data, we end up getting a biased result, which makes it impossible to generate a reliable predictive model. In this paper, we will address this problem by walking through a handful of techniques which during our research helped us in dealing with a large categorical data of non-sequential nature. In subsequent sections, we will discuss the possible implementable solutions and shortfalls of these techniques. Results: The methods are applied to sample datasets available in public domain and the results with respect to accuracy of classification are satisfactory. Conclusion: The best pre-processing technique we observed in our research is one hot encoding, which facilitates breaking down the categorical features into binary and feeding it into an Algorithm to predict the outcome. The example that we took is not abstract but it is a real – time production services dataset, which had many complex variations of categorical features. Our Future work includes creating a robust model on such data and deploying it into industry standard applications.

The Kaplan Fibers of the Iliotibial Band Can Be Identified on Routine Knee Magnetic Resonance Imaging

2019 ◽  
Vol 47 (12) ◽  
pp. 2895-2903 ◽  
Author(s):  
Lachlan Batty ◽  
Jerome Murgier ◽  
Richard O’Sullivan ◽  
Kate E. Webster ◽  
Julian A. Feller ◽  
...  
Keyword(s):  
Magnetic Resonance Imaging ◽  
Magnetic Resonance ◽  
Sagittal Plane ◽  
Interobserver Reliability ◽  
Joint Line ◽  
Coronal Plane ◽  
Iliotibial Band ◽  
Resonance Imaging ◽  
Lateral Gastrocnemius ◽  
The Mean

Background: The Kaplan fibers (KFs) of the iliotibial band have been suggested to play a role in anterolateral rotational instability of the knee, particularly in the setting of an anterior cruciate ligament (ACL) rupture. Description of the normal magnetic resonance imaging (MRI) anatomy of the KFs may facilitate subsequent investigation into the MRI signs of injury. Purpose: To assess if the KF complex can be identified on 3-T MRI using standard knee protocols. Study Design: Cohort study (diagnosis); Level of evidence, 3. Methods: 3-T MRI scans of 50 ACL-intact knees were reviewed independently by a musculoskeletal radiologist and 2 orthopaedic surgeons. Identification of the KFs was based on radiological diagnostic criteria developed a priori. Identification of the KFs in the sagittal, coronal, and axial planes was recorded. Interobserver reliability was assessed using the Kappa statistic. Detailed anatomy including distance to the joint line and relationship to adjacent structures was recorded. Results: The mean patient age was 43 years (range, 15-81 years), 58% were male, and 50% were right knees. The KFs were identified by at least 2 reviewers on the sagittal images in 96% of cases, on the axial images in 76% of cases, and on the coronal images in 4% of cases. The mean distance from the KF distal femoral insertion to the lateral joint line was 50.1 mm (SD, 6.6 mm) and the mean distance to the lateral gastrocnemius tendon origin was 10.8 mm (SD, 8.6 mm). The KFs were consistently identified immediately anterior to the superior lateral geniculate artery on sagittal imaging. Interobserver reliability for identification was best in the sagittal plane (Kappa 0.5) and worst in the coronal plane (Kappa 0.1). Conclusion: The KF complex can be identified on routine MRI sequences in the ACL-intact knee; however, there is low to moderate interobserver reliability. Imaging in the sagittal plane had the highest rate of identification and the coronal plane the lowest. There is a consistent relationship between the most distal KF femoral attachment and the lateral joint line, lateral gastrocnemius tendon, and superior lateral geniculate artery.

Classification of thoracic and lumbar injuries: An analysis of interobserver reliability

1999 ◽  
Vol 28 (8) ◽  
pp. 662-681 ◽  
Author(s):  
M. Blauth ◽  
◽  
L. Bastian ◽  
C. Knop ◽  
U. Lange ◽  
...  
Keyword(s):  
Interobserver Reliability

scholarly journals Historical Changes in Aging Trajectories of Two Aspects of Self-Perceptions of Aging

2020 ◽  
Vol 4 (Supplement_1) ◽  
pp. 602-602
Author(s):  
Oliver Huxhold ◽  
Svenja Spuling ◽  
Susanne Wurm
Keyword(s):  
Birth Cohort ◽  
Large Scale ◽  
Sequential Data ◽  
Historical Changes ◽  
Self Perceptions ◽  
Cohort Differences ◽  
Ongoing Development ◽  
Perceptions Of Aging

Abstract In recent years many studies have shown that adults with more positive self-perceptions of aging (SPA) increase their likelihood of aging healthily. Other studies have documented historical changes in individual resources and contextual conditions associated with aging. We explored how these historical changes are reflected in birth-cohort differences in aging trajectories of two aspects of SPA – viewing aging as ongoing development or as increasing physical losses. Using large-scale cohort-sequential data assessed across 21 years (N ≈ 19,000), the analyses modeled birth-cohort differences in aging trajectories of SPA from 40 to 85 years of age. The results illustrated differential birth-cohort differences: Later-born cohorts may experience more potential for ongoing development with advancing age than earlier-born cohorts. However, later-born cohorts seem to view their own aging as more negative than earlier-born cohorts during their early forties but may associate their aging less with physical losses after the age of fifty.

scholarly journals Consistency and Reliability of Ankle Stress Radiography in Patients With Chronic Lateral Ankle Instability

2021 ◽  
Vol 9 (5) ◽  
pp. 232596712110040
Author(s):  
Ji Hye Choi ◽  
Kug Jin Choi ◽  
Chin Youb Chung ◽  
Moon Seok Park ◽  
Ki Hyuk Sung ◽  
...  
Keyword(s):  
Standard Deviation ◽  
Tilt Angle ◽  
Ankle Instability ◽  
Interobserver Reliability ◽  
Initial Presentation ◽  
Lateral Ankle ◽  
Chronic Lateral Ankle Instability ◽  
Stress Radiographs ◽  
Lateral Ankle Instability

Background: Ankle stress radiographs are important tools for evaluating chronic lateral ankle instability. The consistency of a patient’s ankle condition as it affects the reliability of ankle stress radiographs has never been evaluated. Purpose: To investigate the consistency and reliability of ankle stress radiographs in patients with chronic lateral ankle instability without an ankle injury during the study period. Study Design: Cohort study (diagnosis); Level of evidence, 3. Methods: Included were patients with chronic lateral ankle instability who underwent 2 repeated ankle stress radiographs between January 2014 and July 2019; those with an ankle injury during the study period were excluded. The tibiotalar tilt angle on varus stress radiographs and anterior translation of the talus on anterior drawer stress radiographs were measured at initial presentation and final follow-up examination. Interobserver reliability and consistency of ankle stress radiographs were analyzed using the intraclass correlation coefficient (ICC). Results: A total of 45 patients (mean ± standard deviation age, 36.4 ± 13.4 years; 18 men and 27 women; follow-up duration, 9.1 ± 3.2 months) were included. The mean ± standard deviation tibiotalar tilt angle and anterior talar translation at initial presentation were 10.8° ± 5.2° and 6.9 ± 2.7 mm, respectively. The interobserver reliabilities of the tibiotalar tilt angle and anterior talar translation were excellent (ICC = 0.926 [95% CI, 0.874-0.959] and 0.911 [95% CI, 0.766-0.961], respectively). The consistency between the initial and final radiographs was good for tibiotalar tilt angle (ICC = 0.763 [95% CI, 0.607-0.862]) and poor for anterior talar translation (ICC = 0.456 [95% CI, 0.187-0.660]). Conclusion: Although the interobserver reliability of the radiographic measurements was excellent, the consistency of the ankle stress radiographs was not as acceptable. Surgeons need to be cautious when deciding whether to operate on a patient with chronic lateral ankle instability based on a single ankle stress radiograph.

Sign in / Sign up

Export Citation Format

Share Document