scholarly journals Evaluating Professionalism and Interpersonal and Communication Skills: Implementing a 360-Degree Evaluation Instrument in an Anesthesiology Residency Program

2009 ◽  
Vol 1 (2) ◽  
pp. 216-220 ◽  
Author(s):  
Li Meng ◽  
David G. Metro ◽  
Rita M. Patel
Keyword(s):  
Communication Skills ◽  
Assessment Tool ◽  
Pearson Correlation ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Postanesthesia Care Unit ◽  
Staff Nurse ◽  
Evaluation Instrument ◽  
Intraclass Correlation Coefficients ◽  
Resident Assessment

Abstract Objectives To implement a 360-degree resident evaluation instrument on the postanesthesia care unit (PACU) rotation and to determine the reliability, feasibility, and validity of this tool for assessing residents' professionalism and interpersonal and communication skills. Methods Thirteen areas of evaluation were selected to assess the professionalism and interpersonal and communication skills of residents during their PACU rotation. Each area was measured on a 9-point Likert scale (1, unsatisfactory performance, to 9, outstanding performance). Rating forms were distributed to raters after the completion of the PACU rotation. Raters included PACU nurses, secretarial staff, nurse aides, and medical technicians. Residents were aware of the 360-degree assessment and participated voluntarily. The multiple raters' evaluations were then compared with those of the traditional faculty. Intraclass correlation coefficients were calculated to measure the reliability of ratings within each category of raters by the Pearson correlation coefficient. Results Four hundred twenty-nine rating forms were returned during the study period. Fifteen residents were evaluated. The response rate was 88%. Residents were ranked highest on availability and lowest on management skill. The average rating across all areas was high (8.23). The average mean rating across all items from PACU nurses was higher (8.34) than from secretarial staff (7.99, P > .08). The highest ranked resident ranked high with all raters and the lowest ranked was low with most raters. The intraclass coefficients of correlations were 0.8719, 0.7860, 0.8268, and 0.8575. Conclusions This type of resident assessment tool may be useful for PACU rotations. It appears to correlate with traditional faculty ratings, is feasible to use, and provides formative feedback to residents regarding their professionalism and interpersonal and communication skills.

scholarly journals A Quantitative Comparison of Multispectral Refraction Topography and Autorefractometer in Young Adults

2021 ◽  
Vol 8 ◽  
Author(s):  
Yunru Liao ◽  
Zhenlan Yang ◽  
Zijing Li ◽  
Rui Zeng ◽  
Jing Wang ◽  
...  
Keyword(s):  
Correlation Coefficient ◽  
Pearson Correlation ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Cross Sectional Study ◽  
Cross Sectional ◽  
High Agreement ◽  
Intraclass Correlation Coefficients ◽  
Repeatability And Reproducibility ◽  
The Mean

Purpose: Purpose of this study is to evaluate the measuring consistency of central refraction between multispectral refraction topography (MRT) and autorefractometry.Methods: This was a descriptive cross-sectional study including subjects in Sun Yat-sen Memorial Hospital from September 1, 2020, to December 31, 2020, ages 20 to 35 years with a best corrected visual acuity of 20/20 or better. All patients underwent cycloplegia, and the refractive status was estimated with autorefractometer, experienced optometrist and MRT. We analyzed the central refraction of the autorefractometer and MRT. The repeatability and reproducibility of values measured using both devices were evaluated using intraclass correlation coefficients (ICCs).Results: A total of 145 subjects ages 20 to 35 (290 eyes) were enrolled. The mean central refraction of the autorefractometer was −4.69 ± 2.64 diopters (D) (range −9.50 to +4.75 D), while the mean central refraction of MRT was −4.49 ± 2.61 diopters (D) (range −8.79 to +5.02 D). Pearson correlation analysis revealed a high correlation between the two devices. The intraclass correlation coefficient (ICC) also showed high agreement. The intrarater and interrater ICC values of central refraction were more than 0.90 in both devices and conditions. At the same time, the mean central refraction of experienced optometrist was −4.74 ± 2.66 diopters (D) (range −9.50 to +4.75D). The intra-class correlation coefficient of central refraction measured by MRT and subjective refraction was 0.939.Conclusions: Results revealed that autorefractometry, experienced optometrist and MRT show high agreement in measuring central refraction. MRT could provide a potential objective method to assess peripheral refraction.

scholarly journals Reproducibility and Validity of the 10-Meter Shuttle Ride Test in Wheelchair-Using Children and Adolescents With Cerebral Palsy

2013 ◽  
Vol 93 (7) ◽  
pp. 967-974 ◽  
Author(s):  
Olaf Verschuren ◽  
Maremka Zwinkels ◽  
Marjolijn Ketelaar ◽  
Femke Reijnders-van Son ◽  
Tim Takken
Keyword(s):  
Cerebral Palsy ◽  
Cardiorespiratory Fitness ◽  
Gold Standard ◽  
Pearson Correlation ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Peak Oxygen Uptake ◽  
Repeated Measurements ◽  
Manual Wheelchair ◽  
Intraclass Correlation Coefficients

BackgroundFor children with cerebral palsy (CP) who are able to walk or run, the 10-m shuttle run test is currently the test of choice to assess cardiorespiratory fitness. This test, however, has not yet been examined in wheelchair-using youth with CP.ObjectiveThe purpose of this study was to investigate the test-retest reproducibility and validity of the 10-m shuttle ride test (SRiT) in youth with CP.DesignRepeated measurements of the SRiT were obtained.MethodsTwenty-three individuals with spastic CP (18 boys, 5 girls; mean age=13.3 years, SD=3.6 years) using a manual wheelchair for at least part of the day participated in this study. During the study, all participants performed one graded arm exercise test (GAET) and 2 identical SRiTs within 2 weeks. Peak oxygen uptake (V̇o2peak), peak heart rate (HRpeak), and respiratory exchange ratio (RER) were recorded. Intraclass correlation coefficients (2,1), the smallest detectable difference, and the limits of agreement (LOA) were calculated. The association between the results of the SRiT and GAET was tested using Pearson correlation coefficients.ResultsIntraclass correlation coefficients (.99, 95% confidence interval=.98–1.00) for all variables indicated highly acceptable reproducibility. The LOA analysis revealed satisfactory levels of agreement. The SRiT variables demonstrated strong, significant positive correlations for V̇o2peak values obtained during the SRiT and the GAET (r=.84, P<.01).LimitationsAlthough the GAET is considered the gold standard, the cardiorespiratory demand during the GAET was significantly lower compared with during the SRiT. Future studies should determine whether the GAET can still be accepted as the gold standard for upper-extremity exercise.ConclusionsThe SRiT is a reproducible and valid test for measuring cardiorespiratory fitness in youth with spastic CP who self-propel a manual wheelchair.

Assessing the Motor Status Score: A Scale for the Evaluation of Upper Limb Motor Outcomes in Patients after Stroke

2002 ◽  
Vol 16 (3) ◽  
pp. 283-289 ◽  
Author(s):  
Mark Ferraro ◽  
Jennifer Hogan Demaio ◽  
Jennifer Krol ◽  
Chris Trudell ◽  
Keren Rannekleiv ◽  
...  
Keyword(s):  
Correlation Coefficient ◽  
Upper Limb ◽  
Pearson Correlation ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Pearson Correlation Coefficient ◽  
Maximum Score ◽  
Intraclass Correlation Coefficients ◽  
Upper Extremity Impairment ◽  
Motor Outcomes

The Motor Status Scale (MSS) measures shoulder, elbow (maximum score = 40), wrist, hand, and finger movements (maximum score = 42), and expands the measurement of upper extremity impairment and disability provided by the Fugl-Meyer (FM) score. This work examines the interrater reliability and criterion validity of the MSS performed in patients admitted to a rehabilitation hospital 21 ± 4 days after stroke. Using the MSS and the FM, 7 occupational therapists masked to each other’s judgments, evaluated 12 consecutive patients with stroke. Two therapists evaluated 6 additional patients on consecutive days. Intraclass correlation coefficients were significant for each group of raters for the shoulder/elbow and for the wrist/hand (P < 0.0001); test-retest measures were also significant for the shoulder/elbow (Pearson correlation coefficient r = 0.99, P < 0.004) and for the wrist/hand (Pearson correlation coefficient r = 0.99, P < 0.003). The internal item consistency for the overall MSS was significant (Cronbach alpha = 0.98, P < 0.0001). Finally the correlation between the MSS and the FM (R 2 = 0.964) was significant (P < 0.0001). The MSS affords a reliable and valid assessment of upper limb impairment and disability following stroke.

scholarly journals Reliability of a Three-Dimensional Wound Camera and Correlation With Routine Ruler Measurement in Diabetes-Related Foot Ulceration

2020 ◽  
pp. 193229682097465
Author(s):  
Joel Willem Johan Lasschuit ◽  
Jill Featherston ◽  
Katherine Thuy Trang Tonks
Keyword(s):  
Interobserver Reliability ◽  
Pearson Correlation ◽  
Intraclass Correlation ◽  
Three Dimensional ◽  
Correlation Coefficients ◽  
Area Measurement ◽  
Foot Care ◽  
Foot Ulceration ◽  
Intraclass Correlation Coefficients ◽  
Service Setting

Background: In an era of increasing technology and telehealth utilization, three-dimensional (3D) wound cameras promise reliable, rapid, and touch-free ulceration measurements. However, reliability data for commercially available devices in the diabetes foot service setting is lacking. We aimed to evaluate the reliability of diabetes-related foot ulceration measurement using a 3D wound camera in comparison to the routinely used ruler and probe. Method: Participants were prospectively recruited from a tertiary interdisciplinary diabetes foot service. Ulcerations were measured at each visit by two blinded observers, first by ruler and probe, and then using a 3D wound camera twice. Reliability was evaluated using intraclass correlation coefficients (ICC). Measurement methods were compared by Pearson correlation. Results: Sixty-three ulcerations affecting 38 participants were measured over 122 visits. Interobserver reliability of ruler measurement was excellent for estimated area (ICC 0.98, 95% CI 0.97-0.98) and depth (ICC 0.93, 95% CI 0.90-0.95). Intraobserver and interobserver reliability of the 3D wound camera area was excellent (ICC 0.96, 95%CI 0.95-0.97 and 0.97 95% CI 0.96-0.98, respectively). Depth was unrecordable in over half of 3D wound camera measurements, and reliability was inferior to probe measurement. Area correlation between methods was good ( R = 0.88 and 0.94 per observer); however, depth correlation was poor ( R = 0.49 and 0.65). Conclusions: 3D wound cameras offer practical advantages over ruler-based measurement. In diabetes-related foot ulceration, the reliability and comparability of area measurement was excellent across both methods, although depth was more reliably obtained by the probe. These limitations, together with cost, are important considerations if implementing this technology in diabetes foot care.

Development and Validation of the Japanese Version of the Consensus Auditory-Perceptual Evaluation of Voice

2021 ◽  
pp. 1-8
Author(s):  
Kanako Kondo ◽  
Masanobu Mizuta ◽  
Yoshitaka Kawai ◽  
Tohru Sogami ◽  
Shintaro Fujimura ◽  
...  
Keyword(s):  
Intraclass Correlation ◽  
Voice Quality ◽  
Reliability And Validity ◽  
Correlation Coefficients ◽  
Japanese Version ◽  
Evaluation Instrument ◽  
Intraclass Correlation Coefficients ◽  
Perceptual Evaluation ◽  
Highly Correlated ◽  
Development And Validation

Purpose: Auditory-perceptual evaluation is essential for the assessment of voice quality. The Consensus Auditory-Perceptual Evaluation of Voice (CAPE-V) provides a standardized protocol and assessment form for clinicians to analyze the voice quality and has been adapted into several different languages. The aims of this study were to develop the Japanese version of the CAPE-V and to investigate its reliability and validity. Method: The Japanese CAPE-V consisted of the same three speech contexts (vowels, sentences, and conversation) as developed in the original English version. The sentences were designed according to the concepts of the original version and reviewed by Japanese phoneticians. To validate the usefulness of the Japanese CAPE-V, voices of 173 Japanese-speaking subjects (76 subjects with dysphonia and 97 without voice complaints) were evaluated by five experienced judges, according to the Japanese CAPE-V as well as the GRBAS (Grade, Roughness, Breathiness, Asthenia, Strain) scale. Results: The Japanese CAPE-V provided a high interrater reliability (intraclass correlation coefficients [ICCs] > .85 for all the parameters) as well as a high intrarater reliability (ICCs > .85 for all the parameters). In addition, overall severity, roughness, and breathiness in the Japanese CAPE-V were highly correlated with the corresponding dimensions in the GRBAS scale, having Spearman correlation coefficients greater than .8. Conclusion: This study demonstrated the reliability and validity of the newly developed Japanese CAPE-V as an auditory-perceptual evaluation instrument.

The Youth Throwing Score: Validating Injury Assessment in Young Baseball Players

2016 ◽  
Vol 45 (2) ◽  
pp. 317-324 ◽  
Author(s):  
Christopher S. Ahmad ◽  
Ajay S. Padaki ◽  
Manish S. Noticewala ◽  
Eric C. Makhni ◽  
Charles A. Popkin
Keyword(s):  
Upper Extremity ◽  
Assessment Tool ◽  
Pearson Correlation ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Importance Rating ◽  
Extremity Injury ◽  
Level Of Evidence ◽  
Baseball Players ◽  
Upper Extremity Injury

Background: Epidemic levels of shoulder and elbow injuries have been reported recently in youth and adolescent baseball players. Despite the concerning frequency of these injuries, no instrument has been validated to assess upper extremity injury in this patient population. Purpose/Hypothesis: The purpose of this study was to validate an upper extremity assessment tool specifically designed for young baseball players. We hypothesized that this tool will be both reliable and valid. Study Design: Cohort study (diagnosis); Level of evidence, 2. Methods: The Youth Throwing Score (YTS) was constructed by an interdisciplinary team of providers and coaches as a tool to assess upper extremity injury in youth and adolescent baseball players (age range, 10-18 years). The psychometric properties of the test were then determined. Results: A total of 223 players completed the final survey. The players’ mean age was 14.3 ± 2.7 years. Pilot analysis showed that none of the 14 questions received a mean athlete importance rating less than 3 of 5, and the final survey read at a Flesch-Kincaid level of 4.1, which is appropriate for patients aged 9 years and older. The players self-assigned their injury status, resulting in a mean instrument score of 59.7 ± 8.4 for the 148 players “playing without pain,” 42.0 ± 11.5 for the 60 players “playing with pain,” and 40.4 ± 10.5 for the 15 players “not playing due to pain.” Players playing without pain scored significantly higher than those playing with pain and those not playing due to pain ( P < .001). Psychometric analysis showed a test-retest intraclass correlation coefficient of 0.90 and a Cronbach alpha intra-item reliability coefficient of 0.93, indicating excellent reliability and internal consistency. Pearson correlation coefficients of 0.65, 0.62, and 0.31 were calculated between the YTS and the Pediatric Outcomes Data Collection Instrument sports/physical functioning module, the Kerlan-Jobe Orthopaedic Clinic Shoulder and Elbow score, and the Quick Disabilities of the Arm, Shoulder, and Hand (QuickDASH) score, respectively. Injured players scored a mean of 9.4 points higher after treatment ( P < .001), and players who improved in their self-assigned pain categorization scored 16.5 points higher ( P < .001). Conclusion: The YTS is the first valid and reliable instrument for assessing young baseball players’ upper extremity health.

scholarly journals Reliability and Validity of the INFOOT Three-dimensional Foot Digitizer for Patients with Rheumatoid Arthritis

2011 ◽  
Vol 101 (3) ◽  
pp. 198-207 ◽  
Author(s):  
Sophie De Mits ◽  
Pascal Coorevits ◽  
Dirk De Clercq ◽  
Dirk Elewaut ◽  
James Woodburn ◽  
...  
Keyword(s):  
Rheumatoid Arthritis ◽  
Pearson Correlation ◽  
Intraclass Correlation ◽  
Three Dimensional ◽  
Correlation Coefficients ◽  
Measurement Tool ◽  
Intraclass Correlation Coefficients ◽  
Detectable Difference ◽  
Smallest Detectable Difference ◽  
Clinical Measurements

Background: Abnormal foot posture and deformities are identified as important features in rheumatoid arthritis. There is still no consensus regarding the optimum technique(s) for quantifying these features; hence, a foot digitizer might be used as an objective measurement tool. We sought to assess the validity and reliability of the INFOOT digitizer. Methods: To investigate the validity of the INFOOT digitizer compared with clinical measurements, we calculated Pearson correlation coefficients. To investigate the reliability of the INFOOT digitizer, we calculated intraclass correlation coefficients, SEMs, smallest detectable differences, and smallest detectable difference percentages. Results: Most of the 38 parameters showed good intraclass correlation coefficients, with values greater than 0.9 for 30 parameters and greater than 0.8 for seven parameters. The left heel bone angle expressed a moderate correlation, with a value of 0.609. The SEM values varied between 0.31 and 3.51 mm for the length and width measures, between 0.74 and 5.58 mm for the height data, between 0.75 and 5.9 mm for the circumferences, and between 0.78° and 2.98° for the angles. The smallest detectable difference values ranged from 0.86 to 16.36 mm for length, width, height, and circumference measures and from 2.17° to 8.26° for the angle measures. For the validity of the INFOOT three-dimensional foot digitizer, Pearson correlation coefficients varied between 0.750 and 0.997. Conclusions: In this rheumatoid arthritis population, good validity was demonstrated compared with clinical measurements, and most of the obtained parameters proved to be reliable. (J Am Podiatr Med Assoc 101(3): 198–207, 2011)

scholarly journals Comparison of Methods for Estimating Retinal Shape: Peripheral Refraction vs. Optical Coherence Tomography

2021 ◽  
Vol 10 (2) ◽  
pp. 174
Author(s):  
Katharina Breher ◽  
Alejandro Calabuig ◽  
Laura Kühlewein ◽  
Focke Ziemssen ◽  
Arne Ohlendorf ◽  
...  
Keyword(s):  
Optical Coherence Tomography ◽  
Axial Length ◽  
Pearson Correlation ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Clinical Parameter ◽  
Mean Difference ◽  
Optical Coherence ◽  
Shape Estimation ◽  
Intraclass Correlation Coefficients

Retinal shape presents a clinical parameter of interest for myopia, and has commonly been inferred indirectly from peripheral refraction (PRX) profiles. Distortion-corrected optical coherence tomography (OCT) scans offer a new and direct possibility for retinal shape estimation. The current study compared retinal curvatures derived from OCT scans vs. PRX measurements in three refractive profiles (0° and 90° meridians, plus spherical equivalent) for 25 participants via Bland–Altman analysis. The radial differences between both procedures were correlated to axial length using Pearson correlation. In general, PRX- and OCT-based retinal radii showed low correlation (all intraclass correlation coefficients < 0.21). PRX found flatter retinal curvatures compared to OCT, with the highest absolute agreement found with the 90° meridian (mean difference +0.08 mm) and lowest in the 0° meridian (mean difference +0.89 mm). Moreover, a negative relation between axial length and the agreement of both methods was detected especially in the 90° meridian (R = −0.38, p = 0.06). PRX measurements tend to underestimate the retinal radius with increasing myopia when compared to OCT measurements. Therefore, future conclusions from PRX on retinal shape should be made cautiously. Rather, faster and more clinically feasible OCT imaging should be performed for this purpose.

scholarly journals Tests for clinical assessment of the stand-to-sit/sit-to-stand in subjects post-stroke: a systematic review.

2014 ◽  
Vol 12 ◽  
pp. 173 ◽  
Author(s):  
Paula Fernanda de Sousa Silva ◽  
Amanda Ferreira Gusmão ◽  
Juliane Franco ◽  
Ludmylla Ferreira Quintino ◽  
Christina Danielli Coelho de Morais Faria
Keyword(s):  
Pearson Correlation ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Measurement Properties ◽  
Clinical Test ◽  
Intraclass Correlation Coefficients ◽  
Sit To Stand ◽  
Literature Searches ◽  
Determining Factors ◽  
Meta Analyses

Introduction: Individuals with stroke usually show limitations in the performance of daily activities. Among the most limited activities is the stand-up/sit-down, which limitation in performance is a major cause of disability in this population. Objective: The aim of the present study was to describe the clinical tests used to evaluate the stand-up/sit-down in individuals with stroke, considering their protocols and properties. Method: A systematic literature review following the PRISMA (Preferred Reporting Items for Systematic reviews and Meta-Analyses) protocol was performed.  Systematic literature searches on the following databases MEDLINE/SCIELO/LILACS/PEDro was performed, using search strategies that included terms referring to tests and individuals with stroke. The inclusion criteria were: use of a clinical test to evaluate the stand-up/sit-down in individuals with stroke and be published in any language until april/2013. Results: Fifteen studies were included, which used the test of three repetitions (n=1/15), number of repetitions in 30s (n=1/15) and 60s (n=1/15), and the five repetitions test (n=12/15), for which was investigated reliability with intraclass correlation coefficients (ICC) (n=2/12, 0.89≤ICC≤0.99), sensibility/specificity (n=2/12, 67%-83%/72-75%) and validity with pearson correlation coefficients (r) (n=1/12, 0.75≤r≤0.83). Most part of the studies (n=8/15) used chair with seat height fixed and reported the number of repetitions of the test (n=7/15), performed with one (n=3/8), two (n=2/8) or three repetitions (n=3/8). Conclusion: The test of five repetitions was used more often in individuals with stroke and the only one for which measurement properties was investigated, which results were adequate. However, standardization of this test considering determining factors for the evaluation of stand-up/sit-down, as chair height and number of repetitions, are still needed.

Comparison and Validation of Preoperative Planning Techniques for Distal Femoral Osteotomies and Proximal Tibial Osteotomies

2020 ◽  
Author(s):  
David T. Zhang ◽  
Peter S. Principe ◽  
Austin T. Fragomen ◽  
S Robert Rozbruch
Keyword(s):  
Current Practice ◽  
Preoperative Planning ◽  
Pearson Correlation ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Descriptive Statistics ◽  
Planning Techniques ◽  
Future Studies ◽  
Intraclass Correlation Coefficients ◽  
Accepted Standard

AbstractPreoperative planning is important for accurate intraoperative execution in many surgical fields. Planning for distal femoral osteotomies (DFOs) and proximal tibial osteotomies (PTOs) consists of choosing the level of the osteotomy, measuring the angle of the osteotomy based on hip-knee-ankle alignment, and choosing a proper osteotomy wedge size. Medical imaging IT solutions company Sectra has implemented a new osteotomy tool in their radiographic system that is simpler than the accepted standard of modified center of rotation of angulation (mCORA) technique, yet unvalidated. In this study, we aim to compare the Sectra osteotomy tool versus the mCORA technique to measure the osteotomy angles as well as wedge sizes in both DFOs and PTOs to validate this new tool.We enrolled n = 30 consecutive patients with DFOs and n = 30 PTOs from the last year. The Pearson correlation coefficient (PCC) along with descriptive statistics was used to evaluate for similarity between the two techniques. We also compared interobserver and intraobserver reliability using intraclass correlation coefficients (ICC).The PCC for osteotomy angles in DFOs and PTOs were both 0.998 (p < 0.001 for both). For wedge sizes, the PCC in DFOs was 0.993 and 0.980 in PTOs (p < 0.001 for both). ICCs were high for both interobserver measurements in osteotomy angles and wedge sizes (range: 0.989–0.999) as well as intraobserver measurements (0.994–0.999).The Sectra osteotomy tool is a validated tool for preoperative measurements of DFOs and PTOs. It is reliable and simpler than the current practice of the mCORA technique. We suggest future studies to analyze this Sectra osteotomy tool in other settings as to incorporate it into widespread clinical use.

Sign in / Sign up

Export Citation Format

Share Document