scholarly journals Observing Patterns of River Usage

Safety ◽  
2019 ◽  
Vol 5 (4) ◽  
pp. 66
Author(s):  
Peden ◽  
Franklin ◽  
Leggat ◽  
Lindsay
Keyword(s):  
Pilot Study ◽  
Data Collection ◽  
Confidence Interval ◽  
Interrater Reliability ◽  
Univariate Analysis ◽  
Intraclass Correlation ◽  
Simple Approach ◽  
Risk Exposure ◽  
Time Points ◽  
Direct Observations

Rivers are a leading location for drowning, yet little is known about people’s usage of these waterways. This pilot study aimed to test the use of direct observations to calculate river usage. Direct observations were conducted at regular intervals within defined zones at four river drowning locations in Australia (including weekends and the Australia Day national public holiday). Data recorded were date and time of observation; total people (including males, females, children, and adults); and number of people on, in, and beside the water. Univariate analysis with mean (SD) and range was conducted. Interrater reliability for observations was determined using the intraclass correlation coefficient (ICC) (one-way random-effects, average measures model), with a 95% confidence interval (CI). Across 149 time points, 309 observations resulted in 13,326 river interactions observed by multiple observers. There was an average of 39 people (M = 39.4, SD = 29.4, range = 0–137) per observation, 44 people (M = 44.2, SD = 32.7, range = 0–37) on an average weekend, and 97 people (M = 96.8, SD = 58.1, range = 20–190) on Australia Day. More females (M = 20.6, SD = 16.0, range = 0–83) than males (M = 18.3, SD = 14.5, range = 0–68) were observed. More people were observed in the water (M = 20.6, SD = 20.4, range = 0–84) than beside or on the water. Interrater reliability was excellent, consistently above 0.900 for all variables collected (apart from the variable of beside the river). Despite males accounting for 80% of river drowning fatalities, more females were observed than males. Increased visitation on the Australia Day public holiday may be linked to increased drowning risk. This study detailed a simple approach to data collection, exploring exposure within a defined zone at river locations. River usage is dynamic, with people’s movement in and out of the water changing their risk exposure. Observational-based data collection for drowning, particularly for rivers, is an important yet highly neglected area of research.

scholarly journals Understanding Motivations for Gardening Using a Qualitative General Inductive Approach

2018 ◽  
Vol 28 (3) ◽  
pp. 289-295 ◽  
Author(s):  
Amy McFarland ◽  
Tina M. Waliczek ◽  
Coleman Etheredge ◽  
Aime J. Sommerfeld Lillard
Keyword(s):  
Pilot Study ◽  
Interrater Reliability ◽  
Intraclass Correlation ◽  
Age Groups ◽  
Environmental Benefits ◽  
Significant Difference ◽  
Absolute Agreement ◽  
Males And Females ◽  
Personal Productivity ◽  
Nutrition Economics

Although some benefits of gardening have been documented, motivations regarding participation in gardening are often considered based on anecdote. The purpose of this study was to use qualitative analysis to explore reasons gardeners from different genders and generations participate in gardening. The questions developed for this study were intentionally exploratory and left open-ended to gather a large variety of responses. Surveys were collected from 177 individuals between the ages of 7 and 94 years old. Responses were categorized into themes identified through the literature review, the pilot study, and through exploration of the data. Responses could fit into as many categories as were mentioned by the respondents and were categorized by three independent coders. Interrater reliability was assessed using a two-way mixed, absolute agreement, average measures intraclass correlation (ICC) and determined the degree to which coders provided consistency in their ratings across participants. Themes developed through this survey included “social interaction,” “aesthetics,” “food availability/health/nutrition,” “economics,” “therapeutic,” “environmental benefits,” “nostalgia,” and “personal productivity.” Themes of personal productivity and nostalgia are those which have not occurred in previous research. Statistically significant differences were found in comparisons among males and females with more males gardening for food/health/nutrition and for reasons regarding nostalgia. More females reported gardening for personal productivity when compared with males. No significant difference was identified in comparisons of gardeners from various age groups indicating that gardeners across generations have similar intentions and receive similar benefits.

The Design, Development, and Reliability Testing of a New Innovative Device to Measure Ankle Joint Dorsiflexion

2016 ◽  
Vol 106 (5) ◽  
pp. 338-343
Author(s):  
James Charles
Keyword(s):  
Confidence Interval ◽  
Ankle Joint ◽  
Interrater Reliability ◽  
Intraclass Correlation ◽  
Design Development ◽  
Single Measure ◽  
Ankle Joint Dorsiflexion ◽  
Left And Right ◽  
Treatment Table ◽  
Average Measure

Background: In clinical and research settings, ankle joint dorsiflexion needs to be reliably measured. Dorsiflexion is often measured by goniometry, but the intrarater and interrater reliability of this technique have been reported to be poor. Many devices to measure dorsiflexion have been developed for clinical and research use. An evaluation of 12 current tools showed that none met all of the desirable criteria. The purpose of this study was to design and develop a device that rates highly in all of the criteria and that can be proved to be highly reliable. Methods: While supine on a treatment table, 14 participants had a foot placed in the Charles device and ankle joint dorsiflexion measured and recorded three times with a digital inclinometer. The mean of the three readings was determined to be the ankle joint dorsiflexion. Results: The analysis used was intraclass correlation coefficient (ICC). There was very little difference in ICC single or average measures between left and right feet, so data were pooled (N = 28). The single-measure ICC was 0.998 (95% confidence interval, 0.996-0.998). The average-measure ICC was 0.998 (95% confidence interval, 0.995-0.999). Limits of agreement for the average measure were also very good: −1.30° to 1.65°. Conclusions: The Charles device meets all of the desirable criteria and has many innovative features, increasing its appropriateness for clinical and research applications. It has a suitable design for measuring dorsiflexion and high intrarater and interrater reliability.

scholarly journals Reliability of Oncology Value Framework Outputs: Concordance Between Independent Research Groups

2018 ◽  
Vol 2 (3) ◽  
Author(s):  
Joseph C Del Paggio ◽  
Sierra Cheng ◽  
Christopher M Booth ◽  
Matthew C Cheung ◽  
Kelvin K W Chan
Keyword(s):  
Decision Making ◽  
Confidence Interval ◽  
Interrater Reliability ◽  
Medical Oncology ◽  
Intraclass Correlation ◽  
Treatment Decision ◽  
Research Groups ◽  
Independent Research ◽  
Treatment Decision Making ◽  
American Society

Abstract Research groups are increasingly utilizing value frameworks, but little is known of their reliability. To assess framework concordance and interrater reliability between two major value frameworks currently in use, we identified all previously published datasets containing both scores from the American Society of Clinical Oncology Value Framework (ASCO-VF) and grades from the European Society for Medical Oncology-Magnitude of Clinical Benefit Scale (ESMO-MCBS). The intraclass correlation coefficient (ICC) was used to assess interrater reliability. Four eligible studies contained drugs evaluated by both value frameworks, resulting in a dataset of 39 grades/scores for discrete drug indications. ICC was 0.82 (95% confidence interval = 0.70 to 0.90) for ASCO-VF and 0.88 (95% confidence interval = 0.80 to 0.93) for ESMO-MCBS. Absolute concordance was found to be 5% for ASCO-VF and 44% for ESMO-MCBS, increasing to 74% and 80% when deviations within 20 points and 1 grade were considered, respectively. Interrater reliability of ASCO-VF and ESMO-MCBS is, therefore, near perfect, while absolute concordance is poor. This has implications when considering framework outputs in drug funding or treatment decision making.

scholarly journals Intrarater and Interrater Reliability of the Flexicurve Index, Flexicurve Angle, and Manual Inclinometer for the Measurement of Thoracic Kyphosis

2013 ◽  
Vol 2013 ◽  
pp. 1-7 ◽  
Author(s):  
Eva Barrett ◽  
Karen McCreesh ◽  
Jeremy Lewis
Keyword(s):  
Confidence Interval ◽  
Interrater Reliability ◽  
Thoracic Kyphosis ◽  
Intraclass Correlation ◽  
The Other ◽  
Intrarater Reliability ◽  
Secondary Objective ◽  
Standard Error Of Measurement ◽  
Level Of Agreement ◽  
Error Of Measurement

Objective. This study aimed to describe the interrater and intrarater reliability of the flexicurve index, flexicurve angle, and manual inclinometer in swimmers. A secondary objective was to determine the level of agreement between the inclinometer angle and the flexicurve angle and to provide an equation to approximate one angle from the other.Methods. Thirty swimmers participated. Thoracic kyphosis was measured using the flexicurve and the manual inclinometer. Intraclass correlation coefficient, 95% confidence interval, and standard error of measurement were computed.Results. The flexicurve angle and index showed excellent intrarater (ICC = 0.94) and good interrater (ICC = 0.86) reliability. The inclinometer demonstrated excellent intrarater (ICC = 0.92) and interrater (ICC = 0.90) reliability. The flexicurve angle was systematically smaller and correlated poorly with the inclinometer angle (R2=0.384). The following equations can be used for approximate conversions: flexicurve angle = (0.275 × inclinometer angle) + 8.478; inclinometer angle = (1.396 × flexicurve angle) + 8.694.Conclusion. The inclinometer and flexicurve are both reliable instruments for thoracic kyphosis measurement in swimmers. Although the flexicurve and inclinometer angles are not directly comparable, the approximate conversion factors provided will permit translation of flexicurve angle to inclinometer angle and vice versa.

Interobserver Reliability Using the Phonetic Level Evaluation With Severely and Profoundly Hearing-Impaired Children

1991 ◽  
Vol 34 (5) ◽  
pp. 989-999 ◽  
Author(s):  
Stephanie Shaw ◽  
Truman E. Coggins
Keyword(s):  
Interrater Reliability ◽  
Interobserver Reliability ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Hearing Impaired ◽  
Intraclass Correlation Coefficients ◽  
Assessment Measure ◽  
Impaired Children ◽  
Speech Assessment ◽  
Hearing Impaired Children

This study examines whether observers reliably categorize selected speech production behaviors in hearing-impaired children. A group of experienced speech-language pathologists was trained to score the elicited imitations of 5 profoundly and 5 severely hearing-impaired subjects using the Phonetic Level Evaluation (Ling, 1976). Interrater reliability was calculated using intraclass correlation coefficients. Overall, the magnitude of the coefficients was found to be considerably below what would be accepted in published behavioral research. Failure to obtain acceptably high levels of reliability suggests that the Phonetic Level Evaluation may not yet be an accurate and objective speech assessment measure for hearing-impaired children.

CODEM Instrument

GeroPsych ◽  
2014 ◽  
Vol 27 (1) ◽  
pp. 23-31 ◽  
Author(s):  
Anne Kuemmel (This author contributed eq ◽  
Julia Haberstroh (This author contributed ◽  
Johannes Pantel
Keyword(s):  
Convergent Validity ◽  
Interrater Reliability ◽  
Discriminant Validity ◽  
Assessment Tool ◽  
Intraclass Correlation ◽  
Well Being ◽  
Communication Behavior ◽  
People With Dementia ◽  
Pearson's R ◽  
Pearson’S R

Communication and communication behaviors in situational contexts are essential conditions for well-being and quality of life in people with dementia. Measuring methods, however, are limited. The CODEM instrument, a standardized observational communication behavior assessment tool, was developed and evaluated on the basis of the current state of research in dementia care and social-communicative behavior. Initially, interrater reliability was examined by means of videoratings (N = 10 people with dementia). Thereupon, six caregivers in six German nursing homes observed 69 residents suffering from dementia and used CODEM to rate their communication behavior. The interrater reliability of CODEM was excellent (mean κ = .79; intraclass correlation = .91). Statistical analysis indicated that CODEM had excellent internal consistency (Cronbach’s α = .95). CODEM also showed excellent convergent validity (Pearson’s R = .88) as well as discriminant validity (Pearson’s R = .63). Confirmatory factor analysis verified the two-factor solution of verbal/content aspects and nonverbal/relationship aspects. With regard to the severity of the disease, the content and relational aspects of communication exhibited different trends. CODEM proved to be a reliable, valid, and sensitive assessment tool for examining communication behavior in the field of dementia. CODEM also provides researchers a feasible examination tool for measuring effects of psychosocial intervention studies that strive to improve communication behavior and well-being in dementia.

Determinants of Interrater Reliability of Job Analysis: A Meta-analysis

2002 ◽  
Vol 18 (1) ◽  
pp. 52-62 ◽  
Author(s):  
Olga F. Voskuijl ◽  
Tjarda van Sliedregt
Keyword(s):  
Data Collection ◽  
Interrater Reliability ◽  
Meta Analysis ◽  
Job Analysis ◽  
Job Descriptions ◽  
Job Description ◽  
Research And Practice ◽  
Descriptive Information ◽  
Interrater Reliability Coefficients ◽  
Reliability Coefficients

Summary: This paper presents a meta-analysis of published job analysis interrater reliability data in order to predict the expected levels of interrater reliability within specific combinations of moderators, such as rater source, experience of the rater, and type of job descriptive information. The overall mean interrater reliability of 91 reliability coefficients reported in the literature was .59. The results of experienced professionals (job analysts) showed the highest reliability coefficients (.76). The method of data collection (job contact versus job description) only affected the results of experienced job analysts. For this group higher interrater reliability coefficients were obtained for analyses based on job contact (.87) than for those based on job descriptions (.71). For other rater categories (e.g., students, organization members) neither the method of data collection nor training had a significant effect on the interrater reliability. Analyses based on scales with defined levels resulted in significantly higher interrater reliability coefficients than analyses based on scales with undefined levels. Behavior and job worth dimensions were rated more reliable (.62 and .60, respectively) than attributes and tasks (.49 and .29, respectively). Furthermore, the results indicated that if nonprofessional raters are used (e.g., incumbents or students), at least two to four raters are required to obtain a reliability coefficient of .80. These findings have implications for research and practice.

scholarly journals The Family Psychoeducation Fidelity Scale: Psychometric Properties

2020 ◽  
Vol 47 (6) ◽  
pp. 894-900 ◽  
Author(s):  
I. Joa ◽  
J. O. Johannessen ◽  
K. S. Heiervang ◽  
A. A. Sviland ◽  
H. A. Nordin ◽  
...  
Keyword(s):  
Psychometric Properties ◽  
Internal Consistency ◽  
Interrater Reliability ◽  
Review Process ◽  
Trial Registration ◽  
Family Psychoeducation ◽  
Time Points ◽  
The Family ◽  
Fidelity Scale

Abstract This study examined psychometric properties and feasibility of the Family Psychoeducation (FPE) Fidelity Scale. Fidelity assessors conducted reviews using the FPE fidelity scale four times over 18 months at five sites in Norway. After completing fidelity reviews, assessors rated feasibility of the fidelity review process. The FPE fidelity scale showed excellent interrater reliability (.99), interrater item agreement (88%), and internal consistency (mean = .84 across four time points). By the 18-month follow-up, all five sites increased fidelity and three reached adequate fidelity. Fidelity assessors rated feasibility as excellent. The FPE fidelity scale has good psychometric properties and is feasible for evaluating the implementation of FPE programs. Trial registration ClinicalTrials.gov Identifier: NCT03271242.

Reliability of a Modified Medication Appropriateness Index in Community Pharmacies

2003 ◽  
Vol 37 (1) ◽  
pp. 40-46
Author(s):  
Rosemin Kassam ◽  
Linda G Martin ◽  
Karen B Farris ◽  
Homero A Monsanto ◽  
Jean-Marie Kaiser
Keyword(s):  
Community Pharmacy ◽  
Interrater Reliability ◽  
Intraclass Correlation ◽  
Community Setting ◽  
Medication Appropriateness Index ◽  
Paired Samples ◽  
Psychometric Data ◽  
Ambulatory Patients ◽  
Pharmacy Setting ◽  
Medication Appropriateness

Background The medication appropriateness index (MAI) has demonstrated reliability in selected outpatient clinics where medical data were easily accessible from medical charts. However, its use in the community setting where patient data may be limited has not been examined. Objective To evaluate the usefulness of a modified MAI for use in the community pharmacy setting by testing interrater reliability using 3 different rating schemes. Methods Two raters evaluated 160 medications for 32 elderly ambulatory patients. Patient information was acquired using community pharmacist-collected medication histories. A summated MAI score, percent agreement, κ, positive agreement, negative agreement, and intraclass correlation coefficient were calculated for each criterion using 3 scoring schemes. A paired samples t-test (95% CI) was used to test interrater reliability. Results The κ statistics were >0.75 for indication and effectiveness, but good (0.41–0.66) for the remaining criteria using the Hanlon scoring scheme. The intraclass coefficients (0.82, 0.86, 0.87) and overall κ (0.65, 0.66, 0.61) were similar for the 3 schemes. Conclusions This study suggests that the modified MAI has the potential to detect medication appropriateness and inappropriateness in the community pharmacy setting; however, it is not without limitations. Because the MAI has the most clinimetric and psychometric data available, the instrument should be studied further to increase its reliability and generalizability.

scholarly journals Eccentric Force-Velocity Characteristics during a Novel Squat Protocol in Trained Rugby Union Athletes—Pilot Study

2021 ◽  
Vol 6 (2) ◽  
pp. 32
Author(s):  
Conor McNeill ◽  
C. Martyn Beaven ◽  
Daniel T. McMaster ◽  
Nicholas Gill
Keyword(s):  
Pilot Study ◽  
Dynamic Performance ◽  
Intraclass Correlation ◽  
Rugby Union ◽  
Mean Velocity ◽  
Force Development ◽  
Back Squat ◽  
Force Velocity ◽  
Force Time ◽  
Change In Mean

Eccentric strength characteristics have been shown to be important factors in physical performance. Many eccentric tests have been performed in isolation or with supramaximal loading. The purpose of this study was to investigate within- and between- session reliability of an incremental eccentric back squat protocol. Force plates and a linear position transducer captured force-time-displacement data across six loading conditions, separated by at least seven days. The reliability of eccentric specific measurements was assessed using coefficient of variation (CV), change in mean, and intraclass correlation coefficient (ICC). Eccentric peak force demonstrated good ICC (≥0.82) and TE (≤7.3%) for each load. Variables based on mean data were generally less reliable (e.g., mean rate of force development, mean force, mean velocity). This novel protocol meets acceptable levels of reliability for different eccentric-specific measurements although the extent to which these variables affect dynamic performance requires further research.

Sign in / Sign up

Export Citation Format

Share Document