Inter- and intra-rater reliability and clinical utility of the Brachial Plexus Outcome Measure: A pilot study

Hand Therapy ◽  
2019 ◽  
Vol 24 (4) ◽  
pp. 123-129
Author(s):  
Hazel Brown ◽  
Paul Bassett ◽  
Tom J Quick
Keyword(s):  
Pilot Study ◽  
Brachial Plexus ◽  
Clinical Utility ◽  
Outcome Measure ◽  
Rater Reliability

scholarly journals Durometry in SSc: The hard facts. A systematic literature review and additional pilot study

Rheumatology ◽  
2021 ◽  
Author(s):  
Amber Vanhaecke ◽  
Sven Verschuere ◽  
Veronica Vilela ◽  
Lise Heeman ◽  
Maurizio Cutolo ◽  
...  
Keyword(s):  
Systematic Review ◽  
Clinical Trials ◽  
Systemic Sclerosis ◽  
Pilot Study ◽  
Literature Review ◽  
Correlation Coefficient ◽  
Outcome Measure ◽  
Rater Reliability ◽  
Intra Class Correlation ◽  
Intra Class Correlation Coefficient

Abstract Objectives To investigate the reliability of durometry in systemic sclerosis (SSc), by means of a systematic review and additional pilot study. Methods Literature was systematically reviewed according to the PRISMA guidelines to identify all original studies assessing the reliability of durometry in SSc. Additionally, in the pilot study, intra-rater reliability was evaluated in a first cohort of 74 SSc patients (61 female, 13 LSSc/53 LcSSc/8 DcSSc). In a second separate set of 30 SSc patients (21 female, 4 LSSc/20 LcSSc/6 DcSSc), intra- and inter-rater reliability were evaluated. Results Only two unique records identified through the systematic review were qualified to generate conclusions. Regarding intra-rater reliability, Kissin reported excellent intra-class correlation coefficient values (ICC, 0.86–0.94) for measurements at nine skin sites in two DcSSc patients. Merkel and Kissin described, both in five DcSSc patients, good to excellent inter-rater reliability (ICC, 0.82–0.96 and 0.61–0.85) for measurements at respectively, six and nine skin sites. In our pilot study, ICC for intra-rater reliability at 17 standardized skin sites were excellent in both cohorts, ranging 0.93–0.99 and 0.78–0.98, respectively. ICC for inter-rater reliability at 17 standardized skin sites were good to excellent 0.63–0.93, except for the feet (0.48 and 0.52). Conclusion The preliminary findings in the literature are supported by our pilot study in which we have attested the reliability of durometry in SSc patients. However, prior to including durometry as an (additional) outcome measure in SSc clinical trials, its validation status in the assessment of skin fibrosis needs to be completely attested.

scholarly journals Piloting the Play Cycle Observation Method in ‘real time’: Recording children’s Play Cycles in pre-school provision

2020 ◽  
pp. 1476718X2096985
Author(s):  
Pete King ◽  
LaDonna Atkins ◽  
Brandon Burr
Keyword(s):  
Pilot Study ◽  
Real Time ◽  
School Setting ◽  
Early Years ◽  
Good Reliability ◽  
Rater Reliability ◽  
Children's Play ◽  
Observational Tool ◽  
Observation Method ◽  
And Training

The Play Cycle Observation Method (PCOM) is an observational tool developed to focus on the process of play and has shown good reliability when watching videos of children playing. This study piloted use of the PCOM in ‘real time’ in a pre-school setting where 3-year-old children play. The results from two independent observers not familiar with the concept of the Play Cycle or the PCOM found good inter-rater reliability using Cohen Kappa (k) when observing play cues to form play cycles, as well as observing play cues within established play cycles. In addition, the recording of the nature of the play cues and play returns, the play frame and how the play cycle finishes (annihilation) were shown to be consistent between the two inter-rater observers. The results of this pilot study indicate the PCOM can be used as an observational tool to record the process of play by both students and practitioners working in a range of contexts including playwork, childcare, early years and statutory education. The PCOM can also be used as a teaching and training aid for trainers and lecturers.

High doses of mepivacaine for brachial plexus block in patients with end-stage chronic renal failure. A pilot study

2001 ◽  
Vol 18 (3) ◽  
pp. 171-176 ◽  
Author(s):  
J. Rodríguez ◽  
O. Quintela ◽  
M. López-Rivadulla ◽  
M. Bárcena ◽  
C. Diz ◽  
...  
Keyword(s):  
Renal Failure ◽  
Chronic Renal Failure ◽  
Pilot Study ◽  
Brachial Plexus ◽  
Brachial Plexus Block ◽  
High Doses ◽  
End Stage ◽  
Plexus Block

scholarly journals Self-Regulated Learning Microanalysis For The Study Of The Performance Of Clinical Examinations By Physiotherapy Students

2020 ◽  
Author(s):  
Raquel Medina ◽  
Daniel David Álamo-Arce ◽  
Felipe Rodríguez de Castro ◽  
Dario Cecilio Fernandez ◽  
John Sandars ◽  
...  
Keyword(s):  
Pilot Study ◽  
Strategic Planning ◽  
Student Performance ◽  
Clinical Skill ◽  
Potential Usefulness ◽  
Rater Reliability ◽  
Self Monitoring ◽  
Self Regulated Learning ◽  
Regulated Learning ◽  
Physiotherapy Students

Abstract Background Students require feedback on their self-regulated learning (SRL) processes to improve the performance of clinical examinations. The key SRL processes used by students can be identified by SRL-micro-analysis but, this method has not been previously applied to physiotherapy students. The aim of this pilot study was to test a research design that might allow the evaluation of the potential usefulness of SRL microanalysis for the identification of key SRL processes used by physiotherapy students during the performance of a clinical examination skill.. The objectives of the pilot study were: 1) to evaluate whether SRL-microanalysis could identify differences in the use of SRL processes between successful and unsuccessful students; 2) to evaluate the reliability of SRL microanalysis ratings produced by different assessors.Methods SRL-microanalysis was used with second year physiotherapy students of a Spanish university (n= 26) as they performed a goniometric task. The task required students to obtain a goniometric measurement of the shoulder joint of a peer. Two assessors evaluated student performance and conducted the SRL- microanalysis with all students. An analysis of inter-rater reliability was performed to evaluate the degree of agreement between assessors. Results The SRL-microanalysis revealed differences in the use of key SRL processes between successful (n= 15: 57.0%) and unsuccessful performers (n= 11: 43.0%): The differences were particularly evident in strategic planning and self-monitoring skills. There was good inter-rater reliability for scoring of strategic planning (k=0.792), self-monitoring (k=0.946) and self-evaluation (k=0.846).Conclusion The use of SRL microanalysis characterized the key SRL processes of physiotherapy students performing a clinical skill with reliability between the assessors. This pilot study supports the potential usefulness of SRL-microanalysis for the identification of key SRL processes in physiotherapy education. Therefore, this study paves the way to the development of a full study, with a larger number of students and more diverse clinical tasks, to evaluate the SRL processes in successful and unsuccessful students.

Pilot study on the European Portuguese version of the Confusion Assessment Method

2014 ◽  
Vol 26 (5) ◽  
pp. 321-324
Author(s):  
Sónia Martins ◽  
Patrícia Moldes ◽  
João Pinto-de-Sousa ◽  
Filipe Conceição ◽  
José Artur Paiva ◽  
...  
Keyword(s):  
Pilot Study ◽  
Confusion Assessment Method ◽  
Assessment Method ◽  
Translation Process ◽  
Rater Reliability ◽  
Confusion Assessment ◽  
Research Guidelines ◽  
European Portuguese ◽  
Scale Total Score ◽  
Moderate Sensitivity

ObjectiveTo present the pilot study on the European Portuguese validation of the Confusion Assessment Method (CAM).MethodsThe translation process was carried out according to International Society Pharmacoeconomics and Outcomes Research guidelines with trained researchers and inter-rater reliability assessment. The study included 50 elderly patients, admitted (≥24 h) to two intermediate care units. Exclusion criteria were: Glasgow Coma Scale (total score ≤11), blindness/deafness, inability to communicate and not able to speak Portuguese. The sensitivity and specificity of CAM were assessed, with DSM-IV-TR criteria of delirium used as a reference standard.ResultsFindings revealed excellent inter-rater reliability (k>0.81), moderate sensitivity (73%) and excellent specificity (95%).ConclusionThese preliminary results suggested that this version emerges as a promising diagnostic instrument for delirium.

Student Pharmacist Perceptions of the Utility of a Medication Therapy Management-Based, Medication-Related, Falls Risk-Assessment Tool

2020 ◽  
Vol 35 (10) ◽  
pp. 439-445
Author(s):  
Collin M. Clark ◽  
Scott V. Monte ◽  
Mary Hejna ◽  
Robert G. Wahler
Keyword(s):  
Risk Assessment ◽  
Clinical Utility ◽  
Outcome Measure ◽  
Assessment Tool ◽  
Medication Therapy Management ◽  
Risk Assessment Tool ◽  
Patient Acceptance ◽  
Main Outcome Measure ◽  
Therapy Management ◽  
Medication Therapy

OBJECTIVE: To evaluate student pharmacists' perceptions of the Medication Fall Risk-Assessment Tool (MFRAT), a novel medication therapy management (MTM)-based clinical decision support tool.<br/> DESIGN: A cross-sectional study<br/> SETTING: One school of pharmacy<br/> PARTICIPANTS: Participants were eligible if they had used the MFRAT as part of a wellness clinic or as part of required coursework prior to April 2016.<br/> INTERVENTIONS: An online, author developed survey was distributed to assess previous MFRAT use, perceptions of the tool on a 5-point Likert-type scale, and qualitative feedback related in the areas of pharmacy workflow, clinical utility, and perceived patient acceptance.<br/> MAIN OUTCOME MEASURE(S): Positive agreement to survey items served as the main outcome measure. A chi-square test was used to test for a difference in positive response between naive and experienced MFRAT users. Cronbach's alpha was calculated to assess internal consistency of items in each domain.<br/> RESULTS: Of the 127 potential participants surveyed, 110 completed the survey for an overall response rate of 87%. Greater than 85% of participants found the MFRAT's report clinically useful. Eighty-seven percent of respondents agreed or strongly agreed that the information provided by the tool could easily be understood by patients. The most significant limitation to the use if the MFRAT in existing workflow was time required to enter a patient's medication profile.<br/> CONCLUSION: The MFRAT was viewed positively in terms of clinical utility and perceived patient acceptance. Improvements will need to be made to make using the tool more time efficient in pharmacy MTM workflow.

Sign in / Sign up

Export Citation Format

Share Document