Psychometric properties of the Assessment of Motor and Process Skills in patients undergoing rehabilitation following hand-related disorders

Hand Therapy ◽  
2020 ◽  
Vol 25 (2) ◽  
pp. 63-72
Author(s):  
Thea Birch Ransby ◽  
Alice Ørts Hansen ◽  
Nanna Rolving
Keyword(s):  
Construct Validity ◽  
Performance Measure ◽  
Small Sample ◽  
The Other ◽  
Global Rating Scale ◽  
Measurement Tool ◽  
Global Rating ◽  
Process Skills ◽  
Baseline Score ◽  
Measurement Tools

Introduction Assessment of Motor and Process Skills (AMPS) has been proven to be a suitable measurement tool for assessing performance-based ADL ability; however, its reliability and validity have not been tested on patients with hand-related disorders. Methods Patients referred for outpatient hand rehabilitation were assessed with AMPS, The Canadian Occupational Performance Measure (COPM), dynamometer and goniometer at baseline and after eight weeks of hand therapy. Construct validity and responsiveness of AMPS were assessed by hypothesis testing. Construct validity was assessed by correlating the baseline score of AMPS with the baseline score of the other measurement tools. Responsiveness was assessed by correlating the change scores of each measurement tool with a Global Rating Scale. Results Fifty-one patients were recruited. The construct validity of AMPS indicated that the various measurement tools captured different aspects to functioning from the AMPS, as the correlations between AMPS and the other measurement tools were generally weak to low (r < 0.25 to 0.49). AMPS was less responsive than COPM when correlated with the GRS. The correlation between COPM and GRS was r = 0.62 compared with the AMPS motor, r = 0.45 and AMPS process, r = 0.33. Relative responsiveness of AMPS is similar to that of the dynamometer (r = 0.39) and goniometer (r = –0.34). Discussion In a sample of 51 patients, this study found that the construct validity of AMPS seemed to be moderate, while the responsiveness of AMPS seemed to be poor. However, due to the small sample size no conclusions can be made, and should be further assessed in larger studies.

Direct Observation versus Endoscopic Video Recording-Based Rating with the Objective Structured Assessment of Technical Skills for Training of Laparoscopic Cholecystectomy

2016 ◽  
Vol 57 (1-2) ◽  
pp. 1-9 ◽  
Author(s):  
Felix Nickel ◽  
Jonathan D. Hendrie ◽  
Christian Stock ◽  
Mohamed Salama ◽  
Anas A. Preukschas ◽  
...  
Keyword(s):  
Laparoscopic Cholecystectomy ◽  
Construct Validity ◽  
Direct Observation ◽  
Operative Time ◽  
Video Recording ◽  
Technical Skills ◽  
Global Rating Scale ◽  
Global Rating ◽  
Endoscopic Video ◽  
Novices And Experts

Purpose: The validated Objective Structured Assessment of Technical Skills (OSATS) score is used for evaluating laparoscopic surgical performance. It consists of two subscores, a Global Rating Scale (GRS) and a Specific Technical Skills (STS) scale. The OSATS has accepted construct validity for direct observation ratings by experts to discriminate between trainees' levels of experience. Expert time is scarce. Endoscopic video recordings would facilitate assessment with the OSATS. We aimed to compare video OSATS with direct OSATS. Methods: We included 79 participants with different levels of experience [58 medical students, 15 junior residents (novices), and 6 experts]. Performance of a cadaveric porcine laparoscopic cholecystectomy (LC) was evaluated with OSATS by blinded expert raters by direct observation and then as an endoscopic video recording. Operative time was recorded. Results: Direct OSATS rating and video OSATS rating correlated significantly (ρ = 0.33, p = 0.005). Significant construct validity was found for direct OSATS in distinguishing between students or novices and experts. Students and novices were not different in direct OSATS or video OSATS. Mean operative times varied for students (73.4 ± 9.0 min), novices (65.2 ± 22.3 min), and experts (46.8 ± 19.9 min). Internal consistency was high between the GRS and STS subscores for both direct and video OSATS with Cronbach's α of 0.76 and 0.86, respectively. Video OSATS and operative time in combination was a better predictor of direct OSATS than each single parameter. Conclusion: Direct OSATS rating was better than endoscopic video rating for differentiating between students or novices and experts for LC and should remain the standard approach for the discrimination of experience levels. However, in the absence of experts for direct rating, video OSATS supplemented with operative time should be used instead of single parameters for predicting direct OSATS scores.

Assessment of Robotic Console Skills (ARCS): construct validity of a novel global rating scale for technical skills in robotically assisted surgery

2017 ◽  
Vol 32 (1) ◽  
pp. 526-535 ◽  
Author(s):  
May Liu ◽  
Shreya Purohit ◽  
Joshua Mazanetz ◽  
Whitney Allen ◽  
Usha S. Kreaden ◽  
...  
Keyword(s):  
Construct Validity ◽  
Rating Scale ◽  
Technical Skills ◽  
Global Rating Scale ◽  
Global Rating

Assessing Personality With Multi-Descriptor Items

2019 ◽  
Vol 35 (1) ◽  
pp. 117-125
Author(s):  
Johannes Schult ◽  
Rebecca Schneider ◽  
Jörn R. Sparfeldt
Keyword(s):  
University Students ◽  
Construct Validity ◽  
Big Five ◽  
Reliability And Validity ◽  
Personality Inventory ◽  
The Other ◽  
Short Version ◽  
Big Five Inventory ◽  
Personality Inventories

Abstract. The need for efficient personality inventories has led to the wide use of short instruments. The corresponding items often contain multiple, potentially conflicting descriptors within one item. In Study 1 ( N = 198 university students), the reliability and validity of the TIPI (Ten-Item Personality Inventory) was compared with the reliability and validity of a modified TIPI based on items that rephrased each two-descriptor item into two single-descriptor items. In Study 2 ( N = 268 university students), we administered the BFI-10 (Big Five Inventory short version) and a similarly modified version of the BFI-10 without two-descriptor items. In both studies, reliability and construct validity values occasionally improved for separated multi-descriptor items. The inventories with multi-descriptor items showed shortcomings in some factors of the TIPI and the BFI-10. However, the other scales worked comparably well in the original and modified inventories. The limitations of short personality inventories with multi-descriptor items are discussed.

scholarly journals A Scoping Review of Health Literacy Measurement Tools in the Context of Cardiovascular Health

2019 ◽  
Vol 46 (4) ◽  
pp. 677-688 ◽  
Author(s):  
Rita Wai Yu Chan ◽  
Adnan Kisa
Keyword(s):  
Health Literacy ◽  
Scoping Review ◽  
Cardiovascular Health ◽  
Measurement Tool ◽  
Care Providers ◽  
Valid Measurement ◽  
Broad Concept ◽  
Measurement Tools ◽  
Health Literacy Measurement ◽  
Print Literacy

Background. Despite the strong link between health literacy and cardiovascular health outcomes, health literacy measurements remain flawed and fragmented. There exists a gap in the knowledge when formulating a valid measurement to capture the broad concept of health literacy. The existence of various tools for health literacy measurement also hampers the availability of health literacy data. Additionally, little research is available on a valid measurement tool for cardiovascular health literacy. Objective. This study aims to provide an overview of the health literacy measurement tools used in the context of cardiovascular health. Method. A scoping review was conducted. Two electronic databases, Medline and Embase, were searched to identify studies that described a tool for the measurement of health literacy in the context of cardiovascular health. Results. After reviewing the available studies, 53 studies met the inclusion criteria. A total of 26 health literacy measurement tools were identified in the studies. Among the 26 tools, 16 used an objective measurement approach, 9 adopted a subjective approach, and 1 employed a mixed approach. Additionally, 28 studies used tools to measure print literacy, 15 studies measured print literacy and numeracy, and 5 studies measured print literacy, oral literacy, and numeracy. Conclusions. STOFHLA, TOFHLA, and REALM were the mostly commonly used tools in the selected studies. The majority of tools were based heavily on reading skills and word recognition. Researchers should focus on the development of more comprehensive and reliable health literacy measurement tool(s) specific to cardiovascular health to assist health care providers to more efficiently and accurately identify people with cardiovascular problems who have inadequate health literacy.

On the Measurement of Interfirm Power in Channels of Distribution

1983 ◽  
Vol 20 (2) ◽  
pp. 158-166 ◽  
Author(s):  
Gary L. Frazier
Keyword(s):  
Construct Validity ◽  
Marketing Channels ◽  
The Other ◽  
Role Performance ◽  
Channel System ◽  
Empirical Results ◽  
Channels Of Distribution ◽  
Channel Relationship ◽  
Primary Channel

Based in part on previous research reported in the marketing channels literature, an approach for measuring interfirm power is developed which centers on power's hypothesized sources. Within a dyadic channel relationship, the role performance of a firm in its primary channel responsibilities is seen to drive the level of the other firm's dependence in their relationship. This dependence, in turn, determines the former firm's level of power over the latter firm. Empirical results from a study in a franchise channel system are used to evaluate the reliability and construct validity of the proposed measures.

scholarly journals Otoskills training during covid-19 pandemic: a before-after study

2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Maxime Fieux ◽  
Antoine Gavoille ◽  
Fabien Subtil ◽  
Sophie Bartier ◽  
Stéphane Tringali
Keyword(s):  
Surgical Training ◽  
Rating Scale ◽  
Surgical Simulation ◽  
Global Rating Scale ◽  
Middle Ear Surgery ◽  
Global Rating ◽  
Training Requirements ◽  
Significant Difference ◽  
Before And After ◽  
Total Performance

Abstract Background The ongoing COVID-19 pandemic has disrupted the surgical training of residents. There is a real concern that trainees will not be able to meet their training requirements. Low-fidelity surgical simulation appears to be an alternative for surgical training. The educational benefits of repeating ossiculoplasty simulations under a microscope have never been evaluated. With this study we aimed to evaluate the differences in performance scores and on a global rating scale before and after training on an ossiculoplasty simulator. Methods In this quasi-experimental, prospective, single-centre, before-after study with blinded rater evaluation, residents performed five microscopic ossiculoplasty tasks with a difficulty gradient (sliding beads onto rods, the insertion of a partial prosthesis, the insertion of a total prosthesis, and the insertion of a stapedotomy piston under microscopic or endoscopic surgery) before and after training on the same simulator. Performance scores were defined for each task, and total performance scores (score/min) were calculated. All data were collected prospectively. Results Six out of seven intermediate residents and 8/9 novices strongly agreed that the simulator was an effective training device and should be included in the ENT residency program. The mean effect of training was a significant increase in the total performance score (+ 0.52 points/min, [95 % CI, 0.40–0.64], p < 0.001), without a significant difference between novice and intermediate residents. Conclusions This preliminary study shows that techniques for middle-ear surgery can be acquired using a simulator, avoiding any risk for patients, even under lockdown measures.

scholarly journals PROBING THE CONSTRUCT VALIDITY OF LLAMA_D AS A MEASURE OF IMPLICIT LEARNING APTITUDE

2021 ◽  
pp. 1-14
Author(s):  
Yuichi Suzuki
Keyword(s):  
Reaction Time ◽  
Construct Validity ◽  
Implicit Learning ◽  
Incidental Learning ◽  
The Other ◽  
Aptitude Test ◽  
Oral Fluency ◽  
The Relationship ◽  
Potential Test ◽  
Confidence Ratings

Abstract A subtest of the LLAMA test battery (LLAMA_D) has been proposed as a potential test of implicit learning aptitude. To improve its construct validity, in the present study, the original LLAMA_D (a) instructions for incidental learning were modified, and (b) confidence ratings of test responses and (c) reaction time (RT) measurements were added. This revised LLAMA_D was administered along with the other LLAMA subtests (LLAMA-B, -E, and -F). Unconscious knowledge that may (not) result from the exposure was assessed through the relationship between the accuracy/RT and confidence ratings. The results suggest that LLAMA_D accuracy largely reflects conscious retrieval of previously heard sound sequences. However, an index derived from the LLAMA_D RT measure (coefficient of variance) was associated with an aspect of oral fluency, which is presumably dependent on proceduralization. Several recommendations are proposed to redesign and extend LLAMA_D as a potential aptitude test for proceduralization.

scholarly journals Suitability of Measurement Tools for Assessing the Prevalence of Child Domestic Work: A Rapid Systematic Review

2021 ◽  
Vol 18 (5) ◽  
pp. 2357
Author(s):  
Nicola S. Pocock ◽  
Clara W. Chan ◽  
Cathy Zimmerman
Keyword(s):  
Systematic Review ◽  
Domestic Work ◽  
Quality Measurement ◽  
Measurement Tool ◽  
Current Standard ◽  
Middle Income ◽  
Middle Income Countries ◽  
Measurement Tools ◽  
Survey Instruments ◽  
Nationally Representative

Child domestic work (CDW) is a hidden form of child labour. Globally, there were an estimated 17.2 million CDWs aged 5–17 in 2012, but there has been little critical analysis of methods and survey instruments used to capture prevalence of CDW. This rapid systematic review identified and critically reviewed the measurement tools used to estimate CDWs in Low- and Middle-Income Countries, following PRISMA guidelines (PROSPERO registration: CRD42019148702). Fourteen studies were included. In nationally representative surveys, CDW prevalence ranged from 17% among 13–24-year-old females in Haiti to 2% of children aged 10–17 in Brazil. Two good quality studies and one good quality measurement tool were identified. CDW prevalence was assessed using occupation-based methods (n = 9/14), household roster (n = 7) and industry methods (n = 4). Six studies combined approaches. Four studies included task-based questions; one study used this method to formally calculate prevalence. The task-based study estimated 30,000 more CDWs compared to other methods. CDWs are probably being undercounted, based on current standard measurement approaches. We recommend use of more sensitive, task-based methods for inclusion in household surveys. The cognitive and pilot testing of newly developed task-based questions is essential to ensure comprehension. In analyses, researchers should consider CDWs who may be disguised as distant or non-relatives.

Objective structured assessment of technical skill in temporal bone dissection: validation of a novel tool

2021 ◽  
pp. 1-11
Author(s):  
M Stavrakas ◽  
G Menexes ◽  
S Triaridis ◽  
P Bamidis ◽  
J Constantinidis ◽  
...  
Keyword(s):  
Temporal Bone ◽  
Rating Scale ◽  
Assessment Tool ◽  
Three Dimensional ◽  
Technical Skills ◽  
Technical Skill ◽  
Global Rating Scale ◽  
Global Rating ◽  
Validity And Reliability ◽  
Cortical Mastoidectomy

Abstract Objective This study developed an assessment tool that was based on the objective structured assessment for technical skills principles, to be used for evaluation of surgical skills in cortical mastoidectomy. The objective structured assessment of technical skill is a well-established tool for evaluation of surgical ability. This study also aimed to identify the best material and printing method to make a three-dimensional printed temporal bone model. Methods Twenty-four otolaryngologists in training were asked to perform a cortical mastoidectomy on a three-dimensional printed temporal bone (selective laser sintering resin). They were scored according to the objective structured assessment of technical skill in temporal bone dissection tool developed in this study and an already validated global rating scale. Results Two external assessors scored the candidates, and it was concluded that the objective structured assessment of technical skill in temporal bone dissection tool demonstrated some main aspects of validity and reliability that can be used in training and performance evaluation of technical skills in mastoid surgery. Conclusion Apart from validating the new tool for temporal bone dissection training, the study showed that evolving three-dimensional printing technologies is of high value in simulation training with several advantages over traditional teaching methods.

Sign in / Sign up

Export Citation Format

Share Document