scholarly journals Validation of the Equine Behaviour Assessment and Research Questionnaire (E-BARQ): A New Survey Instrument for Exploring and Monitoring the Domestic Equine Triad

Animals ◽  
2020 ◽  
Vol 10 (11) ◽  
pp. 1982 ◽  
Author(s):  
Kate Fenner ◽  
Sarah Matlock ◽  
Jane Williams ◽  
Bethany Wilson ◽  
Andrew McLean ◽  
...  
Keyword(s):  
Construct Validity ◽  
Quantitative Data ◽  
Assessment Tool ◽  
Questionnaire Validation ◽  
Subjective Ratings ◽  
Validity And Reliability ◽  
Rater Reliability ◽  
Validity Testing ◽  
Significant Alignment ◽  
Behavioural Assessment

The Equine Behaviour Assessment and Research Questionnaire (E-BARQ) was developed to obtain quantitative data on the domestic equine triad: training, management and behaviour. It can be taken repeatedly, thus collecting longitudinal data to enable evaluation of how changes in a horse’s training and management are reflected in that horse’s behaviour over time and how these changes can impact horse welfare in the longer term. Questionnaire validation and reliability were tested by determining (a) whether an owner’s subjective ratings of their horse’s problematic behaviours or undesirable temperament traits were reflected in the questionnaire scores obtained for that horse (construct validity), (b) whether two respondents, equally familiar with a particular horse, reported comparable scores for that horse through the questionnaire (inter-rater reliability), and (c) whether the same respondent, scoring the same horse after a known interval of time, recorded similar responses (intra-rater reliability). Construct validity testing of 1923 responses showed significant alignment between owners’ reported experience of focal horses’ behaviour and those horses’ E-BARQ scores, with scores varying from 1.13 to 1.34 for ridden horse behaviour (all p < 0.001) and from 1.06 to 1.43 for non-ridden horse behaviour (all p < 0.001). Inter-rater reliability testing of ten horse–rider pairs revealed that 203 of the 215 question items were significantly aligned (p < 0.001) when tested by two independent raters. Of the remaining 19 items, four had fair alignment (ĸ = 0.174–0.316; p = 0.281) and ten items, largely related to whether the horse shows behavioural signs related to anxiety when taken away from home, did not align (ĸ = 0; p = 1). Intra-rater reliability tests showed that the responses significantly aligned on all 215 question items tested (p < 0.001). The results of these tests confirmed the construct validity and reliability of E-BARQ as a standardised behavioural assessment tool for horses.

scholarly journals Validity and Reliability Assessment Tool of Nursing Students Professional Behavior

Jurnal NERS ◽  
2015 ◽  
Vol 10 (2) ◽  
pp. 208
Author(s):  
Fatikhu Yatuni Asmara
Keyword(s):  
Nursing Students ◽  
Construct Validity ◽  
Content Validity ◽  
Assessment Tool ◽  
Reliability Assessment ◽  
Reliability Test ◽  
Validity And Reliability ◽  
Professional Behaviour ◽  
Rater Reliability ◽  
Validity Test

Introduction: Shieffield Peer Review Assessment (SPRAT) is an instrument to assess medical student’s performance using Multi Source Feedback (MSF) method. The previous study stated that MSF with SPRAT is an effective tool assessing professional behaviour (PB) of nursing students both in clinical setting and community setting. However it needs more items to be added. Based on that explanation, it needs conducting validity and reliability test to make sure that the tool is valid and reliable. Method: There were two types of validity test used, content validity test and construct validity test as well as reliability test, namely inter-rater reliability test and item covariance test. Participants were four clinical instructors and 116 nursing students. Result: Content validity test showed that two items must be added as part of assessment item, namely diciplines and faithness. Furthermore construct validity test showed that five items were not valid since they had pearson correlation score <0.3. However the items were included as consideration of nursing students’s PB. Inter-rater reliability test and item covariance reliability test showed that the tool was reliable with score 0.460 and 0.912 respectively. Discussion: The assessment tool can be applied to assess PB of nursing students since it valid and reliable. It needs to investigate the effectiveness of the tool in difference of PB of nursing students.Keywords: validity, reliability, assessment tool of PB (professional behaviour)

Urdu Translation and Validation of Activities-Specific Balance Confidence (ABC) Scale

2021 ◽  
Vol 15 (12) ◽  
pp. 3505-3508
Author(s):  
Noor Ul Ain Fatima ◽  
Qurat-Ul- Ain ◽  
Fareeha Kausar ◽  
Mian Ali Raza ◽  
Misbah Waris ◽  
...  
Keyword(s):  
Older Adults ◽  
Construct Validity ◽  
Correlation Coefficient ◽  
Content Validity ◽  
Assessment Tool ◽  
Test Reliability ◽  
Validity And Reliability ◽  
A Value ◽  
Abc Scale ◽  
Translation And Validation

Objective: To translate and validate the ABC-Scale in Urdu language to predict risk of fall in older population. Study design: Cross-cultural Translation and validation Place and Duration: Study was conducted in older adult community of Sialkot from March 2020 to December 2020. Methodology: Translation of ABC in Urdu was conducted by using Beaton et al guidelines. Two bilingual translators translated the original version into Urdu language step wise, correction process was followed. Then two backward translations were done by language expert. After all this process, the translated version was reviewed by the professionals and the final version was applied on 15 individuals. Its reliability and validity was tested on 60 older adults. Results: For test re test reliability, intra class correlation coefficient ICC was measured with a value of 0.984 Which shows good test re-test reliability. The internal consistency and reliability of ABC was calculated by Cronbach’s alpha for total score with a value of 0.985. Content validity was good with values of CVI ranging from 0.767 to 0.955. To test the discriminative validity, independent t test was used to show the difference between the healthy and unhealthy adults. Factor analysis of UABC showed total variance 81.277 and cumulative variance was also 81.277. To calculate construct validity of U-ABC Pearson’s correlation coefficient was used and measured as 0.558. Conclusion: It was concluded that Urdu version of UABC is a valid assessment tool for older adults with fear of fall. It has good content validity, construct validity and reliability. Keywords: activities specific balance scale, validation, Urdu translation, reliability, tool translation

scholarly journals Short Assessment of Health Literacy for Portuguese-speaking Adults

2012 ◽  
Vol 46 (4) ◽  
pp. 702-711 ◽  
Author(s):  
Daniel Apolinario ◽  
Rafaela de Castro Oliveira Pereira Braga ◽  
Regina Miksian Magaldi ◽  
Alexandre Leopold Busse ◽  
Flavia Campora ◽  
...  
Keyword(s):  
Older Adults ◽  
Health Literacy ◽  
Construct Validity ◽  
Psychometric Properties ◽  
Assessment Tool ◽  
Characteristic Curve ◽  
Intraclass Correlation ◽  
Validity And Reliability ◽  
Convenience Sample ◽  
Inadequate Health Literacy

OBJECTIVE: To develop and validate a short health literacy assessment tool for Portuguese-speaking adults. METHODS: The Short Assessment of Health Literacy for Portuguese-speaking Adults is an assessment tool which consists of 50 items that assess an individual's ability to correctly pronounce and understand common medical terms. We evaluated the instrument's psychometric properties in a convenience sample of 226 Brazilian older adults. Construct validity was assessed by correlating the tool scores with years of schooling, self-reported literacy, and global cognitive functioning. Discrimination validity was assessed by testing the tool's accuracy in detecting inadequate health literacy, defined as failure to fully understand standard medical prescriptions. RESULTS: Moderate to high correlations were found in the assessment of construct validity (Spearman's coefficients ranging from 0.63 to 0.76). The instrument showed adequate internal consistency (Cronbach's alpha=0.93) and adequate test-retest reliability (intraclass correlation coefficient=0.95). The area under the receiver operating characteristic curve for detection of inadequate health literacy was 0.82. A version consisting of 18 items was tested and showed similar psychometric properties. CONCLUSIONS: The instrument developed showed good validity and reliability in a sample of Brazilian older adults. It can be used in research and clinical settings for screening inadequate health literacy.

scholarly journals Reliability testing of a portfolio assessment tool for postgraduate family medicine training in South Africa

2013 ◽  
Vol 5 (1) ◽  
Author(s):  
Louis Jenkins ◽  
Bob Mash ◽  
Anselme Derese
Keyword(s):  
South Africa ◽  
Family Medicine ◽  
Assessment Tool ◽  
Portfolio Assessment ◽  
Validity And Reliability ◽  
Rater Reliability ◽  
Retest Reliability ◽  
Competency Based ◽  
The Difference ◽  
Test Retest Reliability

Background: Competency-based education and the validity and reliability of workplace-based assessment of postgraduate trainees have received increasing attention worldwide.Family medicine was recognised as a speciality in South Africa six years ago and a satisfactory portfolio of learning is a prerequisite to sit the national exit exam. A massive scaling up of the number of family physicians is needed in order to meet the health needs of the country.Aim: The aim of this study was to develop a reliable, robust and feasible portfolio assessment tool (PAT) for South Africa.Methods: Six raters each rated nine portfolios from the Stellenbosch University programme, using the PAT, to test for inter-rater reliability. This rating was repeated three months later to determine test–retest reliability. Following initial analysis and feedback the PAT was modified and the inter-rater reliability again assessed on nine new portfolios. An acceptable intra-classcorrelation was considered to be > 0.80.Results: The total score was found to be reliable, with a coefficient of 0.92. For test–retest reliability, the difference in mean total score was 1.7%, which was not statistically significant. Amongst the subsections, only assessment of the educational meetings and the logbook showed reliability coefficients > 0.80.Conclusion: This was the first attempt to develop a reliable, robust and feasible national portfolio assessment tool to assess postgraduate family medicine training in the South African context. The tool was reliable for the total score, but the low reliability of several sections in the PAT helped us to develop 12 recommendations regarding the use of the portfolio, the design of the PAT and the training of raters.

scholarly journals Application of Rasch to Verify Different Building Competency Sub Constructs for Competency Evaluation of Graduates in Nigeria

2020 ◽  
Vol 9 (6) ◽  
pp. 253-260
Keyword(s):  
Construct Validity ◽  
Assessment Tool ◽  
Survey Design ◽  
Sampling Technique ◽  
Survey Instrument ◽  
Assessment Instrument ◽  
Theoretical Interpretation ◽  
Validity And Reliability ◽  
Expert Opinions ◽  
Competency Evaluation

Incessant concerns from employers and private sectors about the incompetence of graduates in Nigeria call for the creation of an assessment tool that could verify their skills. But there is no clear generally accepted and validated assessment instrument available for evaluating graduate performance. The aim of this study was to develop a valid instrument for assessing competency levels of building construction graduates in Nigeria. Survey design was adopted to obtain expert opinions on the validity of the sub-constructs and the related items about the employers 'needs. Three experts from the academic, public, and private sectors subjected the survey instrument to face, content, and construct validity and reliability. The survey instrument, which was analysed using IBM SPSS and WINSTEP version 3.73.3 was answered by a total of 200 building experts selected by proportionate stratified sampling technique. The consistency of the instrument was determined by fit statistics and point measure correlation (PTMEA Corr), for construct validity. The results revealed a very good items and person reliability of 0.97 and 0.94 respectively. Likewise, appropriate PTMEA Corr range from 0.36 to 0.68. Infit and outfit means square range obtained between 0.58 to 1.39. The findings give students, employers and academic institution a realistic and theoretical interpretation of the reality of labour market needs.

scholarly journals Validitas dan Reliabilitas Ujian SOCA (Students Oral Case Analysis): Studi di Salah Satu Fakultas Kedokteran di Indonesia

2016 ◽  
Vol 5 (3) ◽  
pp. 148
Author(s):  
Rizka Aries Putranti ◽  
Ova Emilia ◽  
Efrayim Suryadi
Keyword(s):  
Construct Validity ◽  
Internal Consistency ◽  
Content Validity ◽  
Cognitive Complexity ◽  
Case Analysis ◽  
Medical Faculty ◽  
Validity And Reliability ◽  
Rater Reliability ◽  
Significant Difference ◽  
Kappa Value

Background: Medical faculty has to make sure that the students meet the minimal competence needed using apropriate exam. While the exam itself should facilitate students to learn. Oral examination has known for its ability to facilitate students learn but low in validity and reliability. Medical faculty of Lampung University (FK Unila) apply the student oral case analysis (SOCA) exam as one of block assessment component, as with MCQ, tutorial, and laboratory exam. This study aimed to evaluate validity and reliability of SOCA examination at FK UnilaMethod: Video of 65 students doing SOCA examination and 28 question rubrics had taken when odd semester exam year 2014-2015 has been carying out at FK Unila. Video and question rubrics were assessed by 5 panelis and analysed using Lawshe's content validity ratio (CVR) to determinate its content validity. Students performance on the video were re-assessed by another assessor to see inter-rater reliability, than analysed using kappa Cohen. Two expert in medical education assessed the cognitive comlpexity of the question rubrics. Data of SOCA's student's mark from year II, III, and IV were analysed for construct valdity and internal consistency.Results: 93,7% of the overall question in 65 video were valid (CVR>99%) and 71,8% question number in 28 question rubrics also valid according to 5 panelis. SOCA cognitive complexity were at level of analyse, know how and 4a. Inter-rater reliability analysis showed 0,549 (moderate agreement) kappa value. Mann Whitney analysis for construct validity showed no significant difference of all year. Cronbach alpha analysis showed internal consistency at the point 0,575.Conclusion: FK Unila's SOCA of odd semester examination year 2014-2015 has sufficient content validity, sufficient cognitive complexity and sufficent inter-rater reliability but lack in construct validity and internal consistency. Keywords: SOCA, validity, reliability

Construct validity and reliability of tests for sacroiliac dysfunction: standing flexion test (STFT) and sitting flexion test (SIFT)

2021 ◽  
Vol 0 (0) ◽  
Author(s):  
Rafael P. Ribeiro ◽  
Filipe G. Guerrero ◽  
Eduardo N. Camargo ◽  
Luiza R. Pivotto ◽  
Mateus A. Aimi ◽  
...  
Keyword(s):  
Construct Validity ◽  
Kappa Statistic ◽  
Measurement Properties ◽  
Clinical Tests ◽  
Validity And Reliability ◽  
Evaluation Team ◽  
Rater Reliability ◽  
3 Dimensional ◽  
Dimensional Measurements ◽  
Flexion Test

Abstract Context Sacroiliac dysfunction is characterized by a hypomobility of the range of motion of the joint, followed by a positional change regarding the relationship between the sacrum and the iliac. In general, the clinical tests that evaluate the sacroiliac joint (SIJ) and its dysfunctions lack validity and reliability values. Objectives This article aims to evaluate the construct validity and intra- and inter-rater reliability of the standing flexion test (STFT) and sitting flexion test (SIFT). Methods In this prospective study, the sample consisted of 30 individuals of both sexes, and the evaluation team was composed of five researchers. The evaluations took place on two different days: first day, inter-rater reliability and construct validity; and second day, intra-rater reliability. The reference standard for the construct validity was 3-dimensional measurements obtained utilizing the BTS SMART-DX system. For statistical analysis, the percentage (%) agreement and the kappa statistic (K) were utilized. Results The construct validity was determined for STFT (70% agreement; K=0.49; p<0.01) and SIFT (56.7% agreement; K=0.29; p<0.05). The intra-rater reliability was determined for STFT (66.3% agreement; K=0.43; p<0.01) and SIFT (56.7% agreement; K=0.38; p<0.01). The inter-rater reliability was determined for STFT (10% agreement; K=−0.02; p=0.825) and SIFT (13.3% agreement; K=0.01; p=0.836). Conclusions The STFT confirmed the construct validity and was reliable when applied by the same rater to healthy people, even if the rater had no experience. It was not possible to achieve minimum scores using the SIFT either for construct validity or reliability. We suggest that further studies be conducted to investigate the measurement properties of palpatory clinical tests for SIJ mobility, especially in symptomatic patients.

scholarly journals The Construct Validity and Reliability of an Assessment Tool for Competency in Cochlear Implant Surgery

2014 ◽  
Vol 2014 ◽  
pp. 1-8 ◽  
Author(s):  
Patorn Piromchai ◽  
Pornthep Kasemsiri ◽  
Sudanthi Wijewickrema ◽  
Ioanna Ioannou ◽  
Gregor Kennedy ◽  
...  
Keyword(s):  
Construct Validity ◽  
Cochlear Implant ◽  
Assessment Tool ◽  
Intraclass Correlation ◽  
Assessment Instrument ◽  
Validity And Reliability ◽  
Implant Surgery ◽  
Surgical Trainees ◽  
Cochlear Implant Surgery ◽  
Objective Feedback

Introduction. We introduce a rating tool that objectively evaluates the skills of surgical trainees performing cochlear implant surgery.Methods. Seven residents and seven experts performed cochlear implant surgery sessions from mastoidectomy to cochleostomy on a standardized virtual reality temporal bone. A total of twenty-eight assessment videos were recorded and two consultant otolaryngologists evaluated the performance of each participant using these videos.Results. Interrater reliability was calculated using the intraclass correlation coefficient for both the global and checklist components of the assessment instrument. The overall agreement was high. The construct validity of this instrument was strongly supported by the significantly higher scores in the expert group for both components.Conclusion. Our results indicate that the proposed assessment tool for cochlear implant surgery is reliable, accurate, and easy to use. This instrument can thus be used to provide objective feedback on overall and task-specific competency in cochlear implantation.

scholarly journals Portuguese Translation and Validation of the Body-Esteem Scale for Adolescents and Adults (BESAA) in University Students

2021 ◽  
Author(s):  
Maria Piedade Brandão ◽  
Vera Vale ◽  
Margaret Gomes ◽  
Anabela Pereira
Keyword(s):  
Construct Validity ◽  
Assessment Tool ◽  
Factor Model ◽  
Body Esteem ◽  
Principal Component ◽  
The Body ◽  
Three Dimensions ◽  
Validity And Reliability ◽  
Appearance Schemas ◽  
Adolescents And Adults

Body-Esteem Scale is an assessment tool for adolescents and adults that evaluate three dimensions of self-evaluations of one&rsquo;s body. Body-Esteem Scale has been translated and validated in some countries since America down to Europe. Lack of translation and reliability evidence in Portugal was detected. This study aimed to translate and test the validity and reliability of the Body Esteem Scale for Adolescents and Adults (BESAA) in students in the context of Portuguese higher educa-tion. A total of 173 students (60.7% are female) with a mean age of 19.7 (standard deviation = 2.2) years participated. Categorical Principal Component Analysis was used to assess the underlying dimensions of BESAA. Construct validity was evaluated through correlation with the Appearance Schemas Inventory &ndash; Revised and a three-factor model (&ldquo;Appearance&rdquo;, &lsquo;&lsquo;Weight&rsquo;&rsquo; and &ldquo;Attribu-tion&rsquo;&rsquo;) was established. Confirmatory factor analysis was performed to verify the construct validity of the instrument. Items that had factor weights (&lambda;)&lt;.40 were removed, as well as those that were considered redundant by the modification indices estimated by the Lagrange Multipliers (LM) method (LM&gt;11, p&lt;.001). We observed high correlations between theoretically similar factors, and low correlations between different factors. The Portuguese BESAA showed adequate validity and reliability.

Sign in / Sign up

Export Citation Format

Share Document