Computer-Aided Generation of Performance Measures for Man-Machine Systems

1974 ◽  
Vol 18 (3) ◽  
pp. 359-367 ◽  
Author(s):  
Edward M. Connelly ◽  
Patricia A. Knoop ◽  
Francis J. Bourne ◽  
Diane G. Loental

The design, application, and evaluation of man-machine systems are limited by our ability to measure system performance in a reliable and sensitive manner. Without adequate performance measures, there is no way to test system designs, to plan and execute training systems, or to effectively evaluate operational systems. Typically, measures are manually produced by selecting a set of candidate performance measures which are subsequently tested for reliability and validity. Since the measurement value of a given candidate measure is not known until these tests are complete, this process, which may be an iterative process, can be both time consuming and costly. Also, since only a few candidate measures can be investigated manually, there is a high probability that superior measures are not even considered. Automating at least some of the manual operations required can result in improved performance measures in less time and at lower cost. The performance measurement generating processor described in this paper accepts demonstration data representing various levels of performance, and under user control, analyzes the data to provide candidate performance measures. The processor also conducts validation tests and orders candidate measures according to their measurement value. Output from the FORTRAN IV processor includes results from validation tests and specifications for objective performance measures.

1982 ◽  
Vol 26 (10) ◽  
pp. 825-829 ◽  
Author(s):  
Edward M. Connelly ◽  
Brian D. Shipley

Performance of operator controlled systems is limited by our ability to measure system and component subsystem performance in a reliable and sensitive manner. Without adequate performance measures, there is no way to produce and test system designs, plan and execute training systems, or evaluate operational systems. Methods of developing these performance measures can be characterized by the way in which performance criteria are obtained. One approach which can be used when all factors that limit performance are known and quantified is an analytical method. For example, if a problem requires that an aircraft climb to a specified altitude while conserving fuel during the climb, the criterion, i.e., minimization of fuel, could be precisely defined analytically. Frequently, however, problems cannot be solved analytically, but demonstrations of superior as well as less than superior performances are available. In these cases an empirical approach can be used. This paper describes an empirical method for analyzing simulator flight data to develop weightings that permit performance discrimination between two groups of student pilots (one group of students successfully passed the initial Army rotary wing training program at Ft. Rucker, Alabama. The other group of students did not pass that training course.). The paper provides a description of the job sample (flight training) tests used to collect the data, the method for synthesizing the performance measures, and the results from using the measures to score student pilots.


Author(s):  
Edward M. Connelly ◽  
Patricia A. Knoop ◽  
Francis J. Bourne ◽  
Diane G. Loental

2020 ◽  
Author(s):  
Moira Pryhoda ◽  
Rachel Wathen ◽  
Jay Dicharry ◽  
Kevin Shelburne ◽  
Bradley Davidson

The objective of this research was to determine if three alternative shoe upper closures improve biomechanical performance measures relative to a standard lace closure in court-based movements. NCAA Division 1 and club-level male athletes recruited from lacrosse, soccer, tennis, and rugby performed four court-based movements: Lateral Skater Jump repeats (LSJ), Countermovement Jump repeats (CMJ), Triangle Drop Step drill (TDS), and Anterior-Posterior drill (AP). Each athlete performed the movements in four shoe upper closures: Standard Closure, Lace Replacement, Y Wrap, and Tri Strap. Ground contact time, peak eccentric rate of force development (RFD), peak concentric GRF, peak concentric COM power, eccentric work, concentric work, and movement completion time were measured. Tri Strap saw improvements in four of seven biomechanical variables during CMJ and LSJ and one variable during TDS. Lace Replacement delivered improvements in one performance measure during CMJ, LSJ, and AP, and two variables in TDS. Y Wrap improved performance in three performance measures during LSJ and impaired performance in two measures during CMJ and three measures during AP. Tri Strap provided the most consistent performance improvements across all movements. This study allowed for the mechanical properties of the shoe lower to remain consistent across designs to examine if an alternative shoe upper closure could enhance performance. Our results indicate that increased proprioception and/or mechanical properties due to the alternative closures, especially Tri Strap, improves athlete performance, which concludes that the design of the shoe upper is an essential consideration in shoe design.


2017 ◽  
Vol 28 (1) ◽  
pp. 57-84 ◽  
Author(s):  
Gregory N. Stock ◽  
Kathleen L. McFadden

Purpose The purpose of this paper is to examine the relationship between patient safety culture and hospital performance using objective performance measures and secondary data on patient safety culture. Design/methodology/approach Patient safety culture is measured using data from the Agency for Healthcare Research and Quality’s Hospital Survey on Patient Safety Culture. Hospital performance is measured using objective patient safety and operational performance metrics collected by the Centers for Medicare and Medicaid Services (CMS). Control variables were obtained from the CMS Provider of Service database. The merged data included 154 US hospitals, with an average of 848 respondents per hospital providing culture data. Hierarchical linear regression analysis is used to test the proposed relationships. Findings The findings indicate that patient safety culture is positively associated with patient safety, process quality and patient satisfaction. Practical implications Hospital managers should focus on building a stronger patient safety culture due to its positive relationship with hospital performance. Originality/value This is the first study to test these relationships using several objective performance measures and a comprehensive patient safety culture data set that includes a substantial number of respondents per hospital. The study contributes to the literature by explicitly mapping high-reliability organization (HRO) theory to patient safety culture, thereby illustrating how HRO theory can be applied to safety culture in the hospital operations context.


Author(s):  
Tracy M. Maylett

This case study describes an initiative to change a long-standing performance management process at a large manufacturing facility within General Mills that emphasized the attainment of objective performance measures (the “what” of performance) to one that also included the “how” of goal achievement. The organization embarked on a 3-year pilot evaluation of the use of 360 Feedback as a possible solution to replace or supplement their traditional single-source (supervisor) performance appraisal process. The two systems ran in parallel using 140 randomly selected employees. Results showed little correlation between the what measures of performance from the traditional appraisals and the how data collected using the 360 Feedback, supporting the view that job performance should be viewed as requiring both aspects of evaluation, using different methods of assessment. Ultimately, the organization maintained both systems but integrated 360 Feedback into the traditional appraisals as well, creating complementary processes that looked “forward” (development) and “past” (performance).


2011 ◽  
Vol 1 (1) ◽  
pp. 1-17 ◽  
Author(s):  
Peter Cariani

In this paper, a semiotic framework for natural and artificial adaptive percept-action systems is presented. The functional organizations and operational structures of percept-action systems with different degrees of adaptivity and self-construction are considered in terms of syntactic, semantic, and pragmatic relations. Operational systems-theoretic criteria for distinguishing semiotic, sign-systems from nonsemiotic physical systems are proposed. A system is semiotic if a set of functional sign-states can be identified, such that the system’s behavior can be effectively described in terms of operations on sign-types. Semiotic relations involved in the operational structure of the observer are outlined and illustrated using the Hertzian commutation diagram. Percept-action systems are observers endowed with effectors that permit them to act on their surrounds. Percept-action systems consist of sensors, effectors, and a coordinative part that determines which actions will be taken. Cybernetic systems adaptively steer behavior by altering percept-action mappings contingent on evaluated performance measures via embedded goals. Self-constructing cybernetic systems use signs to direct the physical construction of all parts of the system to create new syntactic, semantic, and pragmatic relations. When a system gains the ability to construct its material hardware and choose its semiotic relations, it achieves a degree of epistemic autonomy, semantic closure, and pragmatic self-direction.


2007 ◽  
Vol 06 (01) ◽  
pp. 21-38 ◽  
Author(s):  
ABHIJEET K. DIGALWAR ◽  
KULDIP SINGH SANGWAN

This paper aims to develop and validate performance measures for world class manufacturing (WCM) in Indian context that could be used by managers/ practitioners in assessing and improving their manufacturing performance. Using a thorough synthesis of the world class manufacturing literature, sixteen performance measures — top management commitment, knowledge management, employee training, innovation and technology, employee empowerment, environmental health and safety, supplier management, production planning and control, quality, flexibility, speed, cost, customer involvement, customer satisfaction, customer services and company growth — of world class manufacturing and their 89 variables have been developed. Using the data obtained from a survey of manufacturing industries in India, the identified performance measures were subjected to appropriate statistical tests to establish reliability and validity. Statistical computing package SPSS 11.5 for Windows was used for reliability and validity analysis. The validated instrument of world class manufacturing measures developed here may be used by manufacturing organizations to prioritise their management efforts to assess and implement WCM. The validated results are in Indian context, however, the instrument developed can be used in global context.


Sign in / Sign up

Export Citation Format

Share Document