The Clinical Usefulness of the Rivermead Perceptual Assessment Battery: Statistical Considerations

1993 ◽  
Vol 56 (10) ◽  
pp. 365-370 ◽  
Author(s):  
Stephen Matthey ◽  
Sharon M Donnelly ◽  
Donna L Hextell
Keyword(s):  
Assessment Tool ◽  
Reliability And Validity ◽  
Occupational Therapists ◽  
Clinical Usefulness ◽  
Test Results ◽  
Assessment Battery ◽  
Statistical Background ◽  
Perceptual Assessment ◽  
Time Required ◽  
Score Range

The Rivermead Perceptual Assessment Battery (RPAB) is designed to assess visual perception deficits in people suffering from stroke and head Injury. It Is one of the few standardised perceptual assessments specifically developed for occupational therapists. This article examines some aspects of the statistical background of the RPAB. The RPAB authors have reported limited statistical data, which Is Insufficient to understand fully the clinical usefulness of this assessment tool. Reliability and validity are examined and the implications of test results are discussed. The true score range for patients on each subtest is calculated, as well as the amount of change over time required before clinicians can be confident that such change represents a real improvement or decline In the patient's ability. Further, the discriminative power of each subtest is examined, as are the criteria for determining the presence and type of perceptual deficit. These statistical analyses were based on the data reported in the test's manual, as well as from patients assessed at The Prince Henry Hospital, Sydney, over a 2-year period.

The use of the objective structured clinical examination (OSCE) in a practice-based health discipline: Academic and student experience in paramedicine

2020 ◽  
Vol 3 (2) ◽  
Author(s):  
Andy Bell ◽  
Jennifer Kelly ◽  
Peter Lewis
Keyword(s):  
Clinical Examination ◽  
Best Practice ◽  
Assessment Tool ◽  
Clinical Performance ◽  
Reliability And Validity ◽  
Specific Area ◽  
Training Model ◽  
Objective Structured Clinical Examination ◽  
Evidence Based ◽  
Effective Measure

Abstract:Purpose:Over the past two decades, the discipline of Paramedicine has seen expediential growth as it moved from a work-based training model to that of an autonomous profession grounded in academia.  With limited evidence-based literature examining assessment in paramedicine, this paper aims to describe student and academic views on the preference for OSCE as an assessment modality, the sufficiency of pre-OSCE instruction, and whether or not OSCE performance is a perceived indicator of clinical performance.Design/Methods:A voluntary, anonymous survey was conducted to examine the perception of the reliability and validity of the Objective Structured Clinical Examination (OSCE) as an assessment tool by students sitting the examination and the academics that facilitate the assessment. Findings:The results of this study revealed that the more confident the students are in the reliability and validity of the assessment, the more likely they are to perceive the assessment as an effective measure of their clinical performance.  The perception of reliability and validity differs when acted upon by additional variables, with the level of anxiety associated with the assessment and the adequacy of feedback of performance cited as major influencers. Research Implications:The findings from this study indicate the need for further paramedicine discipline specific research into assessment methodologies to determine best practice models for high quality assessment.Practical Implications:The development of evidence based best practice guidelines for the assessment of student paramedics should be of the upmost importance to a young, developing profession such as paramedicine.Originality/Value: There is very little research in the discipline specific area of assessment for paramedicine and discipline specific education research is essential for professional growth.Limitations:The principal researcher was a faculty member of one of the institutions surveyed.  However, all data was non identifiable at time of data collection.  Key WordsParamedic; paramedicine; objective structured clinical examinations; OSCE; education; assessment.

scholarly journals Testing a self-assessment tool for HP competencies with participants of training courses in Austria

2020 ◽  
Vol 30 (Supplement_5) ◽  
Author(s):  
G Lang
Keyword(s):  
Assessment Tool ◽  
Core Competencies ◽  
Empirical Studies ◽  
Reliability And Validity ◽  
International Standards ◽  
Online Questionnaire ◽  
Self Assessment ◽  
High Quality ◽  
Training Courses ◽  
Training Programmes

Abstract Background High quality health promotion (HP) depends on a competent workforce for which professional development programmes for practitioners are essential. The “CompHP Core Competencies Framework in HP” defines crucial competency domains but a recent review concluded that the implementation and use of the framework is lacking. The aim was to develop and validate a self-assessment tool for HP competencies, which should help evaluate training courses. Methods A brief self-assessment tool was employed in 2018 in Austria. 584 participants of 77 training courses submitted their post-course assessment (paper-pencil, RR = 78.1%). In addition, longitudinal data are available for 148 participants who filled in a pre-course online questionnaire. Measurement reliability and validity was tested by single factor, bifactor, multigroup, and multilevel CFA. A SEM proved for predictive and concurrent validity, controlling gender and age. Results A bifactor model (X2/df=3.69, RMSEA=.07, CFI=.95, sRMR=.07) showed superior results with a strong general CompHP factor (FL>.65, wH=.90, ECV=.85), configurally invariant for two training programmes. On course level, there was only minimal variance between trainings (ICC<.08). Structurally, there was a significant increase in HP competencies when comparing pre- and post-course measurements (b=.33, p<.01). Participants showed different levels of competencies due to prior knowledge (b=.38, p<.001) and course format (b=.16, p<.06). The total scale had good properties (m = 49.8, sd = 10.3, 95%-CI: 49.0-50.7) and discriminated between groups (eg by training length). Conclusions The results justify the creation of an overall scale to assess core HP competencies. It is recommended to use the scale for evaluating training courses. The work compensates for the lack of empirical studies on the CompHP concept and facilitates a broader empirical application of a uniform competency framework for HP in accordance with international standards in HP and public health. Key messages The self-assessment tool provides a good and compact foundation for assessing HP competencies. It provides a basis for holistic, high quality and sustainable capacity building or development in HP.

Reliability and Validity Analyses of the Youth Level of Service/Case Management Inventory

2005 ◽  
Vol 32 (3) ◽  
pp. 329-344 ◽  
Author(s):  
Fred Schmidt ◽  
Robert D. Hoge ◽  
Lezlie Gomes
Keyword(s):  
Juvenile Offenders ◽  
Case Management ◽  
Interrater Reliability ◽  
Assessment Tool ◽  
Reliability And Validity ◽  
Level Of Service ◽  
Risk Level ◽  
Criminogenic Needs ◽  
Health Assessments ◽  
Males And Females

The Youth Level of Service/Case Management Inventory (YLS/CMI) is a structured assessment tool designed to facilitate the effective intervention and rehabilitation of juvenile offenders by assessing each youth’s risk level and criminogenic needs. The present study examined the YLS/CMI’s reliability and validity in a sample of 107 juvenile offenders who were court-referred for mental health assessments. Results demonstrated the YLS/CMI’s internal consistency and interrater reliability. Moreover, the instrument’s predictive validity was substantiated on a number of recidivism measures for both males and females. Limitations of the current findings are discussed.

scholarly journals Assessing Housing Accessibility for Older Adults in Japan: A Content Validity Study

2020 ◽  
Vol 4 (Supplement_1) ◽  
pp. 108-108
Author(s):  
Rumiko Tsuchiya-Ito ◽  
Björn Slaug ◽  
Tomonori Sano ◽  
Miki Tajima ◽  
Sakiko Itoh ◽  
...  
Keyword(s):  
Older Adults ◽  
Content Validity ◽  
Assessment Tool ◽  
Occupational Therapists ◽  
Building Design ◽  
Validity Study ◽  
Housing Enabler ◽  
Item List ◽  
Existing Housing ◽  
Rigorous Procedure

Abstract Scientifically validated tools to assess housing accessibility for older adults in Japan have been lacking. To address this, a rigorous procedure of adapting an existing housing assessment tool—the Housing Enabler, developed in Sweden—for valid use in Japan was conducted. The original tool was translated into the Japanese language, using established translation procedures. In the process, researchers checked the appropriateness of technical terms and adjusted specifications to be in accordance with Japanese standards. An expert panel approach was used to validate the content of the Japanese Housing Enabler. Thirteen certified occupational therapists, architects and care-managers (average experience=14.5 years) participated as experts in the content validity study. They rated each item with regard to relevance for assessing housing accessibility in Japan, on a scale from 1(=Not relevant) to 4(= Highly relevant). They suggested adjustments and additions that they found to be relevant to capture particularities of Japanese housing and building design. After individual ratings, the experts gathered for consensus discussions on suggested revisions of the item list. As a result, the number of items was substantially increased (from 161 to 283). A content validity index (CVI) was calculated for each item (i.e., the proportion of experts rating the relevance as at least 3). Using a recommended threshold of CVI ≥0.78, more than 90% of the items were considered relevant, thus supporting the content validity. However, the large amount of items might jeopardize the feasibility of the instrument. Further studies are needed to evaluate feasibility, criterion-related validity and aspects of reliability.

scholarly journals Classroom Instructional Practices of Islamic Education Teachers in the Basic Stage at Al-Mafraq Governorate and Its Relation to Gender and Experience Variables

2015 ◽  
Vol 7 (3) ◽  
pp. 77
Author(s):  
Nosiba Ali Al-Mousa
Keyword(s):  
Standard Deviation ◽  
Instructional Practices ◽  
Reliability And Validity ◽  
T Test ◽  
Islamic Education ◽  
Test Results ◽  
Social Standard ◽  
Basic Stage ◽  
The Relationship

<p>This study aimed to identify Classroom Instructional Practices of Islamic education teachers<br />at basic stage in AL- Mafraq and to identify the relationship between these practices and<br />gender and experience variables as well as interaction between them. The researcher prepared<br />a scale which its reliability and validity were checked to measure the level of classroom<br />instructional practices. The sample of study which consisted of (64) teachers (male and<br />female) was chosen randomly.<br />Data were collected and analyzed statistically using means, standard deviation, t-test and<br />Tuky test. Results revealed that the classroom studying practices of Islamic education<br />teachers in basic stage in AL- Mafraq agreed with acceptable educational and social standard<br />(80%), whereas the percentage of the classroom instructional practices was (81-89%). The<br />results also revealed lack of statistical significant differences in the classroom instructional<br />practices of Islamic education teachers in the basic stage in AL- Mafraq due to the gender<br />variable but there were statistical significant differences at (0,05=OC) in classroom<br />instructional practices due to experience variable in favor of respondents with experiences ( 4<br />years and less) and 10 years and more).Additionally, there were no statistical significant<br />differences in the classroom instructional practices of Islamic education teachers due to<br />interaction between gender and experience variable. The researcher recommended conducting<br />further studies with different variables.</p>

Field test results of an automated exposure assessment tool, the local positioning system (LPS)

2005 ◽  
Vol 7 (7) ◽  
pp. 736 ◽  
Author(s):  
L. A. Lee ◽  
S. C. Soderholm ◽  
M. M. Flemmer ◽  
J. L. Hornsby-Myers
Keyword(s):  
Exposure Assessment ◽  
Field Test ◽  
Assessment Tool ◽  
Positioning System ◽  
Test Results ◽  
Local Positioning System

Reliability and Validity of the Italian Eating Assessment Tool

2013 ◽  
Vol 122 (11) ◽  
pp. 717-724 ◽  
Author(s):  
Antonio Schindler ◽  
Francesco Mozzanica ◽  
Anna Monzani ◽  
Eleonora Ceriani ◽  
Murat Atac ◽  
...  
Keyword(s):  
Assessment Tool ◽  
Reliability And Validity

scholarly journals Oxygen Monitoring Equipment for Sewage-Sludge Composting and Its Application to Aeration Optimization

Sensors ◽  
2018 ◽  
Vol 18 (11) ◽  
pp. 4017
Author(s):  
Guodi Zheng ◽  
Yuewei Wang ◽  
Xiankai Wang ◽  
Junxing Yang ◽  
Tongbin Chen
Keyword(s):  
Real Time ◽  
Oxygen Concentration ◽  
Consumption Rate ◽  
Continuous Control ◽  
Test Results ◽  
Monitoring Equipment ◽  
Decomposition Of Organic Matter ◽  
Good Repeatability ◽  
Oxygen Monitoring ◽  
Time Required

Oxygen is an important parameter for organic-waste composting, and continuous control of the oxygen in a composting pile may be beneficial. The oxygen consumption rate can be used to measure the degree of biological oxidation and decomposition of organic matter. However, without having a real-time online device to monitor oxygen levels in the composting pile, the adjustment and optimization of the composting process cannot be directly implemented. In the present study, we researched and developed such a system, and then tested its stability, reliability, and characteristics. The test results showed that the equipment was accurate and stable, and produced good responses with good repeatability. The equilibrium time required to detect oxygen concentration in the composting pile was 50 s, and the response time for oxygen detection was less than 2 s. The equipment could monitor oxygen concentration online and in real time to optimize the aeration strategy for the compost depending on the concentration indicated by the oxygen-measuring equipment.

scholarly journals Arabic Language Surveys Measuring Mothers’ Satisfaction During Childbirth: A Review

2019 ◽  
Vol 11 (6) ◽  
pp. 169
Author(s):  
Waleed Al Nadabi ◽  
Mohammed A Mohammed
Keyword(s):  
Psychometric Properties ◽  
Reliability And Validity ◽  
Arabic Language ◽  
Face Validity ◽  
Test Results ◽  
Inclusion Criteria ◽  
Internal Reliability ◽  
Maternal Experience ◽  
Still Births ◽  
Interpersonal Care

PURPOSE: To review Arabic surveys used to measure maternal satisfaction. METHODOLOGY: Peer-reviewed studies published in English and Arabic since 2000 were reviewed across eight databases. Surveys were assessed by: survey construction, reliability, and validity. FINDINGS: The seven studies that met the inclusion criteria were in English and included seven different Arabic surveys. Survey items ranged from eight to 32 and were translated from English (3/7) or were originally written in Arabic (4/7). Six surveys were pilot tested. Dimensions covered by the surveys varied but all measured satisfaction about providers&rsquo; interpersonal care. Internal reliability was reported for four surveys and none reported the test-re-test results. Three studies reported content validity, one reported face validity, one reported construct validity, and none reported criterion validity. Participants&rsquo; inclusion criteria varied but all studies excluded women with still births or obstetric complications. When surveyed within hospital (3/7), participants were approached within 72 hours after delivery while those surveyed outside the hospital were approached two weeks, seven weeks, or two months after discharge. Overall, the eight-item survey was found short, well tested with good psychometric properties. CONCLUSIONS: The psychometric properties of Arabic surveys were determined in limited settings, were not well reported, and varied. The eight-item survey is a well-tested survey with good psychometric properties. Furthermore, rigorous evaluation of Arabic surveys in different contexts with wider inclusion criteria is required. Our findings will promote further research in this area and will help enhance maternal experience with childbearing.

scholarly journals Validity and reliability of Korean version Competency Assessment Tool-Mental Health

2020 ◽  
Vol 7 (2) ◽  
pp. 143-152
Author(s):  
Hyun Mee Cho ◽  
Jeong Won Han ◽  
Eun Joung Choi ◽  
Hyo Eun Jeong ◽  
Bo Ram Hong ◽  
...  
Keyword(s):  
Mental Health ◽  
Health Care ◽  
Mental Health Care ◽  
Internal Consistency ◽  
Assessment Tool ◽  
Reliability And Validity ◽  
Basic Data ◽  
Measurement Tool ◽  
Competency Assessment ◽  
Validity And Reliability

AbstractObjectiveTo establish basic data for identifying the level of mental health care competency of general nurses through verification of the reliability and validity of Competency Assessment Tool-Mental Health in the development of a measurement tool for mental health care competency in Korea.MethodsThis study was conducted on nurses working at general wards, excluding those working at the Department of Psychiatry, in five hospitals with 200 beds or more located in Korea. Content, construct, concurrent validity, and internal consistency of the measurement were confirmed.ResultsAs a result of the construct validity, the section on importance of skills and knowledge for mental health care had 21 items, whereas the section on benefits of additional education had 22 items. The internal consistency of measurement was confirmed as follows: Cronbach's α = 0.96 for the section on importance and 0.96 for the section on benefits section.ConclusionsThis study verified the high validity and reliability of the tool in assessing the mental health care competency of nurses, and it is believed to be significant as basic data for enhancing such competency.

Sign in / Sign up

Export Citation Format

Share Document