scholarly journals Fusing Hand Postures and Speech Recognition for Tasks Performed by an Integrated Leg–Arm Hexapod Robot

2020 ◽  
Vol 10 (19) ◽  
pp. 6995
Author(s):  
Jing Qi ◽  
Xilun Ding ◽  
Weiwei Li ◽  
Zhonghua Han ◽  
Kun Xu
Keyword(s):  
Speech Recognition ◽  
Human Robot Interaction ◽  
Area Network ◽  
Hand Posture ◽  
Hexapod Robot ◽  
Wide Area Network ◽  
Robot Interaction ◽  
Localization And Mapping ◽  
And Control ◽  
Slot Structure

Hand postures and speech are convenient means of communication for humans and can be used in human–robot interaction. Based on structural and functional characteristics of our integrated leg-arm hexapod robot, to perform reconnaissance and rescue tasks in public security application, a method of linkage of movement and manipulation of robots is proposed based on the visual and auditory channels, and a system based on hand postures and speech recognition is described. The developed system contains: a speech module, hand posture module, fusion module, mechanical structure module, control module, path planning module and a 3D SLAM (Simultaneous Localization and Mapping) module. In this system, three modes, i.e., the hand posture mode, speech mode, and a combination of the hand posture and speech modes, are used in different situations. The hand posture mode is used for reconnaissance tasks, and the speech mode is used to query the path and control the movement and manipulation of the robot. The combination of the two modes can be used to avoid ambiguity during interaction. A semantic understanding-based task slot structure is developed by using the visual and auditory channels. In addition, a method of task planning based on answer-set programming is developed, and a system of network-based data interaction is designed to control movements of the robot using Chinese instructions remotely based on a wide area network. Experiments were carried out to verify the performance of the proposed system.

scholarly journals Environmental effects on reliability and accuracy of MFCC based voice recognition for industrial human-robot-interaction

2021 ◽  
pp. 095440542110144
Author(s):  
B Birch ◽  
CA Griffiths ◽  
A Morgan
Keyword(s):  
Speech Recognition ◽  
Voice Recognition ◽  
Human Robot Interaction ◽  
Hole Drilling ◽  
Time Warping ◽  
Mel Frequency Cepstral Coefficients ◽  
Robot Interaction ◽  
Extraction Algorithm ◽  
Dynamic Time ◽  
Manufacturing Environments

Collaborative robots are becoming increasingly important for advanced manufacturing processes. The purpose of this paper is to determine the capability of a novel Human-Robot-interface to be used for machine hole drilling. Using a developed voice activation system, environmental factors on speech recognition accuracy are considered. The research investigates the accuracy of a Mel Frequency Cepstral Coefficients-based feature extraction algorithm which uses Dynamic Time Warping to compare an utterance to a limited, user-dependent dictionary. The developed Speech Recognition method allows for Human-Robot-Interaction using a novel integration method between the voice recognition and robot. The system can be utilised in many manufacturing environments where robot motions can be coupled to voice inputs rather than using time consuming physical interfaces. However, there are limitations to uptake in industries where the volume of background machine noise is high.

scholarly journals Human-robot-interaction using cloud-based speech recognition systems

Procedia CIRP ◽  
2021 ◽  
Vol 97 ◽  
pp. 130-135
Author(s):  
Christian Deuerlein ◽  
Moritz Langer ◽  
Julian Seßner ◽  
Peter Heß ◽  
Jörg Franke
Keyword(s):  
Speech Recognition ◽  
Human Robot Interaction ◽  
Robot Interaction ◽  
Recognition Systems

scholarly journals Real-Time Hand Posture Recognition for Human-Robot Interaction Tasks

Sensors ◽  
2016 ◽  
Vol 16 (1) ◽  
pp. 36 ◽  
Author(s):  
Uriel Hernandez-Belmonte ◽  
Victor Ayala-Ramirez
Keyword(s):  
Real Time ◽  
Human Robot Interaction ◽  
Hand Posture ◽  
Robot Interaction ◽  
Hand Posture Recognition ◽  
Posture Recognition

scholarly journals A Brief Review of Neural Networks Based Learning and Control and Their Applications for Robots

Complexity ◽  
2017 ◽  
Vol 2017 ◽  
pp. 1-14 ◽  
Author(s):  
Yiming Jiang ◽  
Chenguang Yang ◽  
Jing Na ◽  
Guang Li ◽  
Yanan Li ◽  
...  
Keyword(s):  
Neural Networks ◽  
Nonlinear Systems ◽  
Human Robot Interaction ◽  
Learning Tools ◽  
Robot Interaction ◽  
Practical Applications ◽  
Powerful Learning ◽  
Wide Range ◽  
Complex Nonlinear Systems ◽  
And Control

As an imitation of the biological nervous systems, neural networks (NNs), which have been characterized as powerful learning tools, are employed in a wide range of applications, such as control of complex nonlinear systems, optimization, system identification, and patterns recognition. This article aims to bring a brief review of the state-of-the-art NNs for the complex nonlinear systems by summarizing recent progress of NNs in both theory and practical applications. Specifically, this survey also reviews a number of NN based robot control algorithms, including NN based manipulator control, NN based human-robot interaction, and NN based cognitive control.

scholarly journals Child Speech Recognition in Human-Robot Interaction

2017 ◽  
Author(s):  
James Kennedy ◽  
Séverin Lemaignan ◽  
Caroline Montassier ◽  
Pauline Lavalade ◽  
Bahar Irfan ◽  
...  
Keyword(s):  
Speech Recognition ◽  
Human Robot Interaction ◽  
Robot Interaction ◽  
Child Speech

GAIT GENERATION AND OPTIMIZATION USING THE ESTIMATION OF DISTRIBUTION ALGORITHM FOR TEENSIZE HUMANOID SOCCER ROBOT RESr-1

2008 ◽  
Vol 05 (03) ◽  
pp. 437-456 ◽  
Author(s):  
LINGYUN HU ◽  
CHANGJIU ZHOU
Keyword(s):  
Hierarchical Control ◽  
Estimation Of Distribution Algorithm ◽  
Human Robot Interaction ◽  
Cooperative Research ◽  
Soccer Robot ◽  
Robot Interaction ◽  
Planning And Control ◽  
Hierarchical Control Architecture ◽  
Estimation Of Distribution ◽  
And Control

This paper gives an overview of locomotion planning and control of a TeenSize humanoid soccer robot, Robo-Erectus Senior (RESr-1), which has been developed as an experimental platform for human–robot interaction and cooperative research in general and robotics soccer games in particular. The locomotion planning and control, along with an introduction of hierarchical control architecture, vision-based behavior and its application in the Humanoid TeenSize soccer challenge, are elaborated. The Estimation of Distribution Algorithm (EDA) is used in locomotion generation and optimization to achieves dynamically stable walk and a powerful kick. By setting different objective functions, smooth walking and powerful kicking can be generated quickly. RESr-1 made its debut at RoboCup 2007, and got fourth place in the Humanoid TeenSize penalty kick competition. In addition, some experimental results on RESr-1's walking, tracking and kicking are presented.

scholarly journals A simulated risk assessment of human-robot interaction in the domestic environment

2020 ◽  
Vol 9 (4) ◽  
pp. 300
Author(s):  
Tamanna E Kaonain ◽  
Mohd Azizi Abdul Rahman ◽  
Mohd Hatta Mohammed Ariff ◽  
Kuheli Mondal
Keyword(s):  
Simulation Software ◽  
Human Robot Interaction ◽  
Complex Environments ◽  
Robot Interaction ◽  
Domestic Environment ◽  
Robot Controller ◽  
Planning And Control ◽  
Python Language ◽  
Real Robot ◽  
And Control

In human-robot interaction, the use of collaborative robots or cobots in many industries is of major importance to researchers in human-robot interaction (HRI). The interaction between human robot carries several challenges, the greatest being the risk of human injury. In addition to reducing the proximity between robots and humans, increased difficulty of human-robot encounters raises the likelihood of accidents only. This paper proposes a virtual collaborative robot in the simulated non-industrial workspace. The safety during human-robot interaction using simulation software was investigated by measuring the risks for planning and control. A reactive robot controller was formulated to minimize the risk during human-robot interaction. A Gazebo software is used in this article, written in Python language, to replicate complex environments that a robot can face. This paper also investigated the robot’s speed. It can be reduced before a collision with a human about to happen, and it minimized the risk of the collision or reduced the damage of the risk. After the successful simulation, this can be applied to the real robot in a practical domestic environment.

Sign in / Sign up

Export Citation Format

Share Document