scholarly journals An adaptive human sensor framework for human–robot collaboration

Author(s):  
Achim Buerkle ◽  
Harveen Matharu ◽  
Ali Al-Yacoub ◽  
Niels Lohse ◽  
Thomas Bamber ◽  
...  

AbstractManufacturing challenges are increasing the demands for more agile and dexterous means of production. At the same time, these systems aim to maintain or even increase productivity. The challenges risen from these developments can be tackled through human–robot collaboration (HRC). HRC requires effective task distribution according to each party’s distinctive strengths, which is envisioned to generate synergetic effects. To enable a seamless collaboration, the human and robot require a mutual awareness, which is challenging, due to the human and robot “speaking” different languages as in analogue and digital. This challenge can be addressed by equipping the robot with a model of the human. Despite a range of models being available, data-driven models of the human are still at an early stage. For this purpose, this paper proposes an adaptive human sensor framework, which incorporates objective, subjective, and physiological metrics, as well as associated machine learning. Thus, it is envisioned to adapt to the uniqueness and dynamic nature of human behavior. To test the framework, a validation experiment was performed, including 18 participants, which aims to predict perceived workload during two scenarios, namely a manual and an HRC assembly task. Perceived workloads are described to have a substantial impact on a human operator’s task performance. Throughout the experiment, physiological data from an electroencephalogram (EEG), an electrocardiogram (ECG), and respiration sensor was collected and interpreted. For subjective metrics, the standardized NASA Task Load Index was used. Objective metrics included task completion time and number of errors/assistance requests. Overall, the framework revealed a promising potential towards an adaptive behavior, which is ultimately envisioned to enable a more effective HRC.

2021 ◽  
Author(s):  
Achim Buerkle ◽  
Harveen Matharu ◽  
Ali Al-Yacoub ◽  
Niels Lohse ◽  
Thomas Bamber ◽  
...  

Abstract Manufacturing challenges are increasing the demands for more agile and dexterous means of production. At the same time, these systems aim to maintain or even increase productivity. The challenges risen from these developments can be tackled through Human-Robot Collaboration (HRC). HRC requires effective task distribution according to each parties’ distinctive strengths, which is envisioned to generate synergetic effects. To enable a seamless collaboration, the human and robot require a mutual awareness, which is challenging, due to the human and robot “speaking” different languages as in analogue and digital. Thus, this challenge can be addressed by equipping the robot with a model of the human. Despite a range of models being available, data-driven models of the human are still at an early stage. This paper proposes an adaptive human sensor framework, which incorporates objective, subjective, and physiological metrics, as well as associated Machine Learning. Thus, it is envisioned to adapt to the uniqueness and dynamic nature of human behavior. To test the framework, a validation experiment was performed, including 18 participants, which aims to predict Perceived Workload during two scenarios, namely a manual and an HRC assembly task. Perceived Workloads are described to have a substantial impact on a human operator’s task performance. Throughout the experiment physiological data from an electroencephalogram (EEG), an electrocardiogram (ECG), and respiration sensor was collected and interpreted. For subjective metrics, the standardized NASA Task Load Index was used. Objective metrics included task completion time and number of errors/assistance requests. Overall, the framework revealed a promising potential towards an adaptive behavior, which is ultimately envisioned to enable a more effective HRC.


2012 ◽  
Vol 30 (34_suppl) ◽  
pp. 245-245
Author(s):  
Lukasz M. Mazur ◽  
Prithima Mosaly ◽  
Ellen Jones ◽  
Lesley Hoyle ◽  
Bhishamjit S. Chera ◽  
...  

245 Background: Workload is a hypothetical construct representing the overall human cost incurred during a task. Across disciplines, the NASA Task Load Index (TLX) has been used as a subjective measure of workload. It quantifies six dimensions of work (mental, physical, and temporal demands, frustration, effort, and performance) on a scale of 1-100 scale, with scores >55 (i.e. overworked) associated with lesser performance. We herein quantify differences in physician workload for planning a relatively “simple” (palliative 2 field opposed lateral brain) versus relatively “complex” (curative 4 field pancreas) case. Further, we explore the association between workload and performance to define TLX levels where performance could be expected to decline. Methods: Nine physicians planned two cases, each case involving three tasks (i.e., task 1 - review written patient medical records; task 2 - review diagnostic images and design of treatment fields; and task 3 - review and approval of the treatment plan). After completing each case, TLX scores of each case/task was collected. Differences in workload between cases/tasks were assessed via ANOVA. The association between workload and performance (assessed using time-to-task completion and self-assessments) was assessed via Pearson’s correlation test. Results: 54 TLX workload and performance assessments were obtained. Workloads for the simple brain case/tasks averaged 41-48, versus 62-69 for the complex pancreas case/tasks (p<0.001 via ANOVA). There were no differences between tasks for the individual cases (p>0.1). There was a correlation between TLX scores and time-to-complete (r=0.54, p<0.001), and with physician self-assessments (r=-0.74, p<0.001). There was a trend towards reduced performance with TLX scores > 55. Conclusions: Physician workload levels are markedly lower for “simple” versus “complex” cases, indicating that TLX is a reliable tool to quantify workload. Performance appears to decline at TLX levels > 55, which is consistent with findings from other industries. Thus, we propose workload assessment (via TLX) to be considered as an independent quality measure to assess the quality assurance (QA) of processes used to deliver radiation therapy.


2019 ◽  
Author(s):  
Nathaniel R. Olsen ◽  
Jacob A. George ◽  
Mark R. Brinton ◽  
Michael D. Paskett ◽  
David T. Kluger ◽  
...  

AbstractMany presently available prostheses lack a functional wrist. To fill this niche and to better understand the impact a wrist has in prosthetic functionality, we designed a low-cost, adaptable, 3D-printable prosthetic wrist that can be adapted to various prosthetic hands and sockets. The wrist utilizes inexpensive but powerful servo motors to provide simultaneous and proportional control of two degrees of freedom: pronation/supination and flexion/extension or radial/ulnar deviation. Participants used both our wrist and a commercially available wrist (DEKA “LUKE” Arm) to complete a modified version of the clothespin relocation task with and without the wrists enabled. Through use of the NASA Task Load Index we found that both wrists significantly reduced the subjective workload associated with clothespin relocation task (p < 0.05). However, we found no significant difference in task completion speed, presumably due to compensation strategies. This inexpensive and adaptable prosthetic wrist can be used by amputees to reduce task workload, or by researchers to further explore the importance of wrist function.


2020 ◽  
Vol 14 ◽  
Author(s):  
Isabela Albuquerque ◽  
Abhishek Tiwari ◽  
Mark Parent ◽  
Raymundo Cassani ◽  
Jean-François Gagnon ◽  
...  

Assessment of mental workload is crucial for applications that require sustained attention and where conditions such as mental fatigue and drowsiness must be avoided. Previous work that attempted to devise objective methods to model mental workload were mainly based on neurological or physiological data collected when the participants performed tasks that did not involve physical activity. While such models may be useful for scenarios that involve static operators, they may not apply in real-world situations where operators are performing tasks under varying levels of physical activity, such as those faced by first responders, firefighters, and police officers. Here, we describe WAUC, a multimodal database of mental Workload Assessment Under physical aCtivity. The study involved 48 participants who performed the NASA Revised Multi-Attribute Task Battery II under three different activity level conditions. Physical activity was manipulated by changing the speed of a stationary bike or a treadmill. During data collection, six neural and physiological modalities were recorded, namely: electroencephalography, electrocardiography, breathing rate, skin temperature, galvanic skin response, and blood volume pulse, in addition to 3-axis accelerometry. Moreover, participants were asked to answer the NASA Task Load Index questionnaire after each experimental section, as well as rate their physical fatigue level on the Borg fatigue scale. In order to bring our experimental setup closer to real-world situations, all signals were monitored using wearable, off-the-shelf devices. In this paper, we describe the adopted experimental protocol, as well as validate the subjective, neural, and physiological data collected. The WAUC database, including the raw data and features, subjective ratings, and scripts to reproduce the experiments reported herein will be made available at: http://musaelab.ca/resources/.


Author(s):  
Lauren Kennedy ◽  
Sarah Henrickson Parker

The purpose of this project was to adapt an existing computer-based task called Multi-Attribute Task Battery (MATB-II), developed by NASA and frequently used to induce acute stress among air craft crew members and general populations, for use in medical populations. We gathered continuous electrocardiography (ECG) data while medical students completed four different versions of the MATB-II of varying difficulties alongside questions probing medical knowledge, comprising a new task called medically-focused multitasking game (MFMG). After completing each version, participants responded to questionnaires to assess subjective states of stress (State Trait Anxiety Inventory for Adults) and cognitive workload (NASA Task Load Index). Responses to these questionnaires, physiological data from continuous ECG, and overall performance scores were combined to determine one version of MFMG that represented the highest level of elicited stress, and one that represented the lowest level of elicited stress. The results of this pilot study are promising, and have converged to reveal one high-stress and one low-stress version of MFMG, which will later be used to induce acute stress in biofeedback intervention studies among surgical residents and fellows. Beyond this specific application, MFMG can have broader applications in measuring acute stress induction and/or reduction among populations of healthcare practitioners.


Work ◽  
2021 ◽  
Vol 68 (s1) ◽  
pp. S209-S221
Author(s):  
Lu Han ◽  
Hechen Zhang ◽  
Zhongxia Xiang ◽  
Jinze Shang ◽  
Shabila Anjani ◽  
...  

BACKGROUND: The contrast between a bright computer screen and a dark ambient environment may influence comfort of the users, especially on their eyes. OBJECTIVE: The objective of this research is to identify the optimal desktop lighting for the comfortable use of the computer screen in a dark environment. METHODS: An experiment was designed where seven illumination setups were introduced for the users to perform their leisure tasks on a computer screen. Fifteen healthy subjects participated in the experiments. During each session, durations of the eye blinks, fixations and saccades of the user were recorded by an eye tracker. His/her neck and trunk movements were recorded by a motion tracking system as well. The comfort/discomfort questionnaire, localized postural discomfort questionnaire, NASA task load index and computer user questionnaire were used to record the overall comfort/discomfort, the local perceived physical discomfort, the cognitive workload, and general/eye health problems, respectively. RESULTS: Subjective and objective measurement results indicated that users felt more comfortable with high intensity warm lights using a computer screen. We also identified that the eye fixation durations, as well as the scores of two questions in the computer user questionnaire, have significant negative correlations with comfort. On the other side, the durations of blinks and the scores of three questions in the computer user questionnaire, were significantly correlated with discomfort. CONCLUSION: The warm (3000K) and high intensity (1500 lux) light reduced the visual and cognitive fatigue of the user and therefore improve the comfort of the user during the use of a computer screen.


Author(s):  
Joseph K. Nuamah ◽  
Younho Seong

Psychophysiological measures can be used to determine whether a particular display produces a general difference in brain function. Such information might be valuable in efforts to improve usability in display design. In this preliminary study, we aimed to use the electroencephalography (EEG) task load index (TLI), given by the ratio of mean frontal midline theta energy to mean parietal alpha energy, to provide insight into the mental effort required by participants performing intuition-inducing and analysis-inducing tasks. We employed behavioral measures (reaction time and percent correct), and a subjective measure (NASA-Task Load Index) to validate the objective measure (TLI). The results we obtained were consistent with our hypothesis that mental effort required for analysis-inducing tasks would be different from that required for intuition-inducing tasks. Although our sample size was small, we were able to obtain a significant positive correlation between NASA-Task Load Index and TLI.


2017 ◽  
Vol 5 (1) ◽  
pp. 148-159 ◽  
Author(s):  
Louisa D. Raisbeck ◽  
Jed A. Diekfuss

Performance benefits exist for an external focus of attention compared with an internal focus of attention for performance and learning (Wulf, 2013). It is unknown, however, if varying the number of verbal cues affects learning and performance. Focus of attention and the number of verbal cues were manipulated during a simulated handgun-shooting task. For the internal focus conditions, participants were told to focus on their hand, arm, and wrist, whereas the external focus instructions were to focus on the gun, gun barrel, and gun stock. To manipulate the number of verbal cues, participants received instruction to focus on a single verbal cue or multiple verbal cues. Shooting performance was assessed at baseline, acquisition, and at two separate retention phases (immediate, delayed) that included transfer tests. Participants completed the NASA—Task Load Index to assess workload following all trials. Participants who received one verbal cue performed significantly better during immediate retention than those who received three verbal cues. Participants who used external focus of attention instructions had higher performance and reported less workload at delayed retention compared to those who used internal focus instructions. This research provides further support for the benefits of an external focus and highlights the importance of minimizing the number of verbal cues.


2021 ◽  
Author(s):  
Taiwo Amida

The majority of Unmanned Aerial Vehicle (UAV) accidents can be directly related to human error. For this reason, standards and guidelines focusing on human factors have been published by various organizations such as Transport Canada, FAA, EASA, NASA and military agencies. The objective of this thesis is to present a methodology for designing a Ground Control Station (GCS) using available standards and guidelines for human factors. During the design process, a detailed analysis was performed using human factors methods to ensure all requirements were met; each phase of the design follows the guidelines presented in the compiled human factors standards and guidelines. The GCS interface was developed using advanced programming techniques and commercial off-the-shelf software. Moreover, an operator workload evaluation was carried out using NASA task load index for validation of design methodology. It was found that the applied methodology not only improved the pilot workload, but also ensured that all user and stakeholders’ requirements are met.


2020 ◽  
Vol 19 (6) ◽  
pp. 38-49
Author(s):  
D. M. Kuz’min ◽  
◽  
A. A. Fedotova ◽  

The main priority of middle ear surgery is to create a safe and optimal view of the surgical field, as well as the most accurate visualization of anatomical structures, which is a driving factor in the evolution of otosurgery. The additional information provided by three-dimensional (3D) images has been proven to improve understanding of the temporal bone anatomy and improve the operator’s ability to assess associated diseases, thereby optimizing surgical management. In the presented experimental research work, a new technique for visualizing the surgical field is described, which improves the quality of the operator’s work and expands the possibilities of middle ear surgery. On the basis of the Chair of Otorhinolaryngology of the Mechnikov North-Western State Medical University a remote adapter for an endoscopic tube was created, which allows you to broadcast the video image received from its distal end to virtual reality glasses. For a detailed understanding of the principle of information transmission in a new three-dimensional reality, we used concepts such as disparity and stereopsis. All research results were evaluated according to the NASA Task Load Index scale. Analyzing the results of the experiment, in the conditions of three-dimensional visualization of the surgical field, a lower level of subjective workload was revealed, which was regarded as a positive effect of the realization of the phenomenon of stereopsis, when performing manipulations on the middle ear.


Sign in / Sign up

Export Citation Format

Share Document