Interaction between Objective Performance Measures and Subjective User Perceptions in the Evaluation of Medical Devices: A Case Study—ADDENDUM

2019 ◽  
Vol 35 (4) ◽  
pp. 361-361
Author(s):  
Matthew D. Haydock ◽  
Anubhav Mittal ◽  
Carissa F. Wilkes ◽  
David H. Lim ◽  
Elizabeth Broadbent ◽  
...  
Keyword(s):  
Performance Measures ◽  
Medical Devices ◽  
User Perceptions ◽  
Objective Performance ◽  
Objective Performance Measures

INTERACTION BETWEEN OBJECTIVE PERFORMANCE MEASURES AND SUBJECTIVE USER PERCEPTIONS IN THE EVALUATION OF MEDICAL DEVICES: A CASE STUDY

2015 ◽  
Vol 31 (5) ◽  
pp. 297-303 ◽  
Author(s):  
Matthew D. Haydock ◽  
Anubhav Mittal ◽  
Carissa F. Wilkes ◽  
David H. Lim ◽  
Elizabeth Broadbent ◽  
...  
Keyword(s):  
Performance Measures ◽  
Medical Devices ◽  
Medical Technology ◽  
Subjective Assessment ◽  
User Perceptions ◽  
Subjective Assessments ◽  
Objective Performance ◽  
Objective Performance Measures ◽  
Method Of Evaluation

Objectives: Medical technology is a large and expanding industry. Introducing new medical devices is important but several challenges exist in implementing the optimal method of evaluation. Both objective and subjective measures can be used for evaluation. The former is the mainstay of evaluation, yet subjective assessment is often the basis for the introduction of new medical technology. The aim of this study was to determine the interaction and concordance between objective and subjective assessment of new medical technology.Methods: This study used both objective performance measures and subjective user perceptions in the evaluation of a new medical device designed to improve the accuracy of gravity-assisted delivery of intravenous fluids, compared with the current, widely used “roller-clamp” device. The concordance of objective and subjective assessments was evaluated using comparative analysis.Results: Objective assessment of the accuracy of intravenous fluid delivery revealed no difference between the two devices (p = .636). Subjective assessment revealed that the new device was perceived to be significantly more accurate (p = .001). This lack of concordance can be partially explained by both device and demand characteristics.Conclusions: This case study reveals a significant discordance between the objective and subjective assessments. It provides some explanation for why new medical devices are adopted without objective evidence of benefit. This phenomenon has been termed “persuasive design” and its influence should be controlled for in the evaluation, purchase and introduction of new medical devices. This should help reduce the risk and associated cost of premature introduction.

The Journey From Development to Appraisal

2019 ◽  
pp. 327-342
Author(s):  
Tracy M. Maylett
Keyword(s):  
Performance Management ◽  
Performance Appraisal ◽  
Performance Measures ◽  
Past Performance ◽  
360 Feedback ◽  
Objective Performance ◽  
Objective Performance Measures ◽  
Performance Appraisal Process ◽  
Measures Of Performance

This case study describes an initiative to change a long-standing performance management process at a large manufacturing facility within General Mills that emphasized the attainment of objective performance measures (the “what” of performance) to one that also included the “how” of goal achievement. The organization embarked on a 3-year pilot evaluation of the use of 360 Feedback as a possible solution to replace or supplement their traditional single-source (supervisor) performance appraisal process. The two systems ran in parallel using 140 randomly selected employees. Results showed little correlation between the what measures of performance from the traditional appraisals and the how data collected using the 360 Feedback, supporting the view that job performance should be viewed as requiring both aspects of evaluation, using different methods of assessment. Ultimately, the organization maintained both systems but integrated 360 Feedback into the traditional appraisals as well, creating complementary processes that looked “forward” (development) and “past” (performance).

Improving service operations: linking safety culture to hospital performance

2017 ◽  
Vol 28 (1) ◽  
pp. 57-84 ◽  
Author(s):  
Gregory N. Stock ◽  
Kathleen L. McFadden
Keyword(s):  
Patient Safety ◽  
Performance Measures ◽  
Safety Culture ◽  
Linear Regression Analysis ◽  
Patient Safety Culture ◽  
Hospital Performance ◽  
Data Set ◽  
Content Type ◽  
Objective Performance ◽  
Objective Performance Measures

Purpose The purpose of this paper is to examine the relationship between patient safety culture and hospital performance using objective performance measures and secondary data on patient safety culture. Design/methodology/approach Patient safety culture is measured using data from the Agency for Healthcare Research and Quality’s Hospital Survey on Patient Safety Culture. Hospital performance is measured using objective patient safety and operational performance metrics collected by the Centers for Medicare and Medicaid Services (CMS). Control variables were obtained from the CMS Provider of Service database. The merged data included 154 US hospitals, with an average of 848 respondents per hospital providing culture data. Hierarchical linear regression analysis is used to test the proposed relationships. Findings The findings indicate that patient safety culture is positively associated with patient safety, process quality and patient satisfaction. Practical implications Hospital managers should focus on building a stronger patient safety culture due to its positive relationship with hospital performance. Originality/value This is the first study to test these relationships using several objective performance measures and a comprehensive patient safety culture data set that includes a substantial number of respondents per hospital. The study contributes to the literature by explicitly mapping high-reliability organization (HRO) theory to patient safety culture, thereby illustrating how HRO theory can be applied to safety culture in the hospital operations context.

Redundancy in Coding of a Visual Display as Assessed by a Signal Detection Paradigm

1982 ◽  
Vol 26 (6) ◽  
pp. 586-588 ◽  
Author(s):  
Lawrence J. Najjar ◽  
Michael J. Patterson ◽  
Gregory M. Corso
Keyword(s):  
Visual Search ◽  
Signal Detection ◽  
Performance Measures ◽  
Search Task ◽  
Visual Search Task ◽  
Visual Display ◽  
Black And White ◽  
Objective Performance ◽  
Objective Performance Measures ◽  
Preference Ratings

A signal detection paradigm was applied to performance of a visual search task under varying degrees of shape-color redundant coding and two levels of practice. The coding conditions were (1) Black and White, (2) Totally Nonredundant, (3) Partially Redundant, and (4) Totally Redundant. In addition to the traditional signal detection measures, subjective coding condition preference ratings were also recorded. Generally, the objective performance measures were influenced by practice. However, neither the objective nor the subjective measures were affected by coding conditions. A significant Coding Condition by Practice interaction on the percentage of correct responses was also found.

Multiobjective trajectory planner for industrial robots with payload constraints

Robotica ◽  
2008 ◽  
Vol 26 (6) ◽  
pp. 753-765 ◽  
Author(s):  
R. Saravanan ◽  
S. Ramabalan ◽  
C. Balamurugan
Keyword(s):  
Performance Measures ◽  
Industrial Robot ◽  
Industrial Robots ◽  
Fuzzy Membership Function ◽  
Pareto Optimal ◽  
Nsga Ii ◽  
Multi Objective ◽  
Objective Performance ◽  
Objective Performance Measures ◽  
Pareto Optimal Fronts

SUMMARYA general new methodology using evolutionary algorithms viz., Elitist Non-dominated Sorting Genetic Algorithm (NSGA-II) and Multi-objective Differential Evolution (MODE), for obtaining optimal trajectory planning of an industrial robot manipulator (PUMA 560 robot) in the presence of fixed and moving obstacles with payload constraint is presented. The problem has a multi-criterion character in which six objective functions, 32 constraints and 288 variables are considered. A cubic NURBS curve is used to define the trajectory. The average fuzzy membership function method is used to select the best optimal solution from Pareto optimal fronts. Two multi-objective performance measures namely solution spread measure and ratio of non-dominated individuals are used to evaluate the strength of Pareto optimal fronts. Two more multi-objective performance measures namely optimiser overhead and algorithm effort are used to find computational effort of the NSGA-II and MODE algorithms. The Pareto optimal fronts and results obtained from various techniques are compared and analysed. Both NSGA-II and MODE are best for this problem.

Effects of Peyton's Four-Step Approach on Objective Performance Measures in Technical Skills Training: A Controlled Trial

2011 ◽  
Vol 23 (3) ◽  
pp. 244-250 ◽  
Author(s):  
Markus Krautter ◽  
Peter Weyrich ◽  
Jobst-Hendrik Schultz ◽  
Sebastian J. Buss ◽  
Imad Maatouk ◽  
...  
Keyword(s):  
Performance Measures ◽  
Controlled Trial ◽  
Technical Skills ◽  
Skills Training ◽  
Objective Performance ◽  
Objective Performance Measures ◽  
Technical Skills Training
Sign in / Sign up

Export Citation Format

Share Document